Mirror/MarginaliaSearch
1
0
Fork 0
mirror of https://github.com/MarginaliaSearch/MarginaliaSearch.git synced 2025-02-24 05:18:58 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
b510b7feb8
MarginaliaSearch/code/processes/crawling-process/model/test/nu/marginalia
History
Viktor Lofgren b510b7feb8 Spike for storing crawl data in slop instead of parquet 
This seems to reduce RAM overhead to 100s of MB (from ~2 GB), as well as roughly double the read speeds.  On disk size is virtually identical.
2024-12-15 15:49:47 +01:00
..
crawling (minor) Fix accidental commit errors 2024-09-23 18:03:09 +02:00
slop Spike for storing crawl data in slop instead of parquet 2024-12-15 15:49:47 +01:00