Viktor Lofgren cf935a5331 (converter) Read cookie information ... Add an optional new field to CrawledDocument containing information about whether the domain has cookies. This was previously on the CrawledDomain object, but since the WarcFormat requires us to write a WarcInfo object at the start of a crawl rather than at the end, this information is unobtainable when creating the CrawledDomain object. Also fix a bug in the deduplication logic in the DomainProcessor class that caused a test to break.		2023-12-15 18:09:53 +01:00
..
crawl-spec	(*) WIP Add node affinity to EC_DOMAIN	2023-10-19 17:48:34 +02:00
crawling-model	(converter) Read cookie information	2023-12-15 18:09:53 +01:00
processed-data	(*) Refactor GeoIP-related code	2023-12-10 17:30:43 +01:00
work-log	(build) Move unit test configuration to root build.gradle	2023-10-04 12:46:22 +02:00