Viktor Lofgren c3f726a01f (actor) Add a feed scraping actor ... Add a new actor that polls an URL every 6 hours and amends the domain database with any unseen domains, flagging them to be crawled by the next crawl job. The URLs are specified in data/scrape-urls.txt. If this file is absent, the actor shuts down.		2024-09-28 12:33:29 +02:00
..
marginalia	(actor) Add a feed scraping actor	2024-09-28 12:33:29 +02:00