MarginaliaSearch/code/processes/crawling-process/model/java
Viktor Lofgren f6f036b9b1 Switch to new Slop format for crawl data storage and processing.
Replaces Parquet output and processing with the new Slop-based format. Includes data migration functionality, updates to handling and writing of crawl data, and introduces support for SLOP in domain readers and converters.
2024-12-15 19:34:03 +01:00
..
nu/marginalia Switch to new Slop format for crawl data storage and processing. 2024-12-15 19:34:03 +01:00
org/netpreserve/jwarc (wip) Extract and encode spans data 2024-07-27 11:44:13 +02:00