Viktor Lofgren 02c4a2d4ba (crawler) Add a per-domain mutex for crawling ... To let up the pressure on domains with lot sof subdomains such as substack, medium, neocities, etc. a per-domain mutex is added that will limit crawling of these domains to one thread at a time.		2024-07-16 16:44:59 +02:00
..
crawl	(crawler) Add a per-domain mutex for crawling	2024-07-16 16:44:59 +02:00