MarginaliaSearch/code/process-models/crawling-model/src
Viktor Lofgren 176b9c9666 (convert) Add sizeHints to legacy serializable cawl data stream
This reduces the maximum memory usage when processing legacy crawl data
2024-01-13 15:50:36 +01:00
..
main/java (convert) Add sizeHints to legacy serializable cawl data stream 2024-01-13 15:50:36 +01:00
test/java/nu/marginalia/crawling (warc) Add a fields for etags and last-modified headers to the new crawl data formats 2023-12-18 17:45:54 +01:00