תגית: crawler control

Block bad bots, control AI crawlers and review bot traffic with local detection and configurable rules, without CAPTCHAs.