MarginaliaSearch/code/processes/live-crawling-process
Viktor Lofgren bae44497fe (crawler) Add a new system property crawler.maxFetchSize
This gives the same upper limit to the live crawler and the big boy crawler, though the live crawler will reject items too large, and the big crawler will truncate at that point.
2024-12-30 15:10:11 +01:00
..
java/nu/marginalia/livecrawler (crawler) Add a new system property crawler.maxFetchSize 2024-12-30 15:10:11 +01:00
test/nu/marginalia/livecrawler (live-crawler) Improve live crawler short-circuit logic 2024-12-27 20:54:42 +01:00
build.gradle (refac) Move export tasks to a process and clean up process initialization for all ProcessMainClass descendents 2024-11-21 16:00:09 +01:00