MarginaliaSearch/code/processes/live-crawling-process/java
Viktor Lofgren bae44497fe (crawler) Add a new system property crawler.maxFetchSize
This gives the same upper limit to the live crawler and the big boy crawler, though the live crawler will reject items too large, and the big crawler will truncate at that point.
2024-12-30 15:10:11 +01:00
..
nu/marginalia/livecrawler (crawler) Add a new system property crawler.maxFetchSize 2024-12-30 15:10:11 +01:00