Viktor Lofgren 3a56a06c4f (warc) Add a fields for etags and last-modified headers to the new crawl data formats ... Make some temporary modifications to the CrawledDocument model to support both a "big string" style headers field like in the old formats, and explicit fields as in the new formats. This is a bit awkward to deal with, but it's a necessity until we migrate off the old formats entirely. The commit also adds a few tests to this logic.		2023-12-18 17:45:54 +01:00
..
main/java	(warc) Add a fields for etags and last-modified headers to the new crawl data formats	2023-12-18 17:45:54 +01:00
test/java/nu/marginalia/crawling	(warc) Add a fields for etags and last-modified headers to the new crawl data formats	2023-12-18 17:45:54 +01:00