Mirror/MarginaliaSearch
1
0
Fork 0
mirror of https://github.com/MarginaliaSearch/MarginaliaSearch.git synced 2025-02-24 05:18:58 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
c2dd2175a2
MarginaliaSearch/code/processes/crawling-process/model/test/nu/marginalia/crawling
History
Viktor Lofgren 3714104976 Add loader for slop data in converter. 
Also alter CrawledDocument to not require String parsing of the underlying byte[] data.  This should reduce the number of large memory allocations quite significantly, hopefully reducing the GC churn a bit.
2024-12-17 15:40:24 +01:00
..
model (wip) Extract and encode spans data 2024-07-27 11:44:13 +02:00
parquet Add loader for slop data in converter. 2024-12-17 15:40:24 +01:00