MarginaliaSearch/code/processes/live-crawling-process/java/nu/marginalia
Viktor Lofgren f94911541a (live-crawl) Reduce the risk of id collisions with the main indexes
This is done by applying a large constant offset to the ordinals for the live crawled documents.  The chosen value still permits upto 100k documents to be fetched for a single domain with the live crawler, which is ridiculously large.
2024-11-20 16:01:10 +01:00
..
livecrawler (live-crawl) Reduce the risk of id collisions with the main indexes 2024-11-20 16:01:10 +01:00