Viktor Lofgren dcf9d9caad (crawler) Emulate if-modified-since for domains that don't support the header ... This will help reduce the strain on some server software, in particular Discourse.		2024-04-22 17:26:31 +02:00
..
marginalia/crawl	(crawler) Emulate if-modified-since for domains that don't support the header	2024-04-22 17:26:31 +02:00