MarginaliaSearch/code/features-crawl/crawl-blocklist/readme.md
2024-02-27 21:22:21 +01:00

9 lines
360 B
Markdown

# Crawl Blocklist
Contains tools for blocking links from crawling.
## Central Classes
* [GeoIpBlocklist](java/nu/marginalia/ip_blocklist/GeoIpBlocklist.java) - country blocking
* [IpBlocklist](java/nu/marginalia/ip_blocklist/IpBlockList.java) - CIDR-based blocking
* [UrlBlocklist](java/nu/marginalia/ip_blocklist/UrlBlocklist.java) - URL pattern blocking