MarginaliaSearch/code/processes/crawling-process/java/nu/marginalia
Viktor Lofgren f6f036b9b1 Switch to new Slop format for crawl data storage and processing.
Replaces Parquet output and processing with the new Slop-based format. Includes data migration functionality, updates to handling and writing of crawl data, and introduces support for SLOP in domain readers and converters.
2024-12-15 19:34:03 +01:00
..
crawl Switch to new Slop format for crawl data storage and processing. 2024-12-15 19:34:03 +01:00