MarginaliaSearch/code/processes/live-crawling-process/java/nu/marginalia/livecrawler
2025-01-21 13:32:58 +01:00
..
LiveCrawlDataSet.java Add loader for slop data in converter. 2024-12-17 15:40:24 +01:00
LiveCrawlerMain.java Merge branch 'master' into slop-crawl-data-spike 2025-01-21 13:32:58 +01:00
LiveCrawlerModule.java (refac) Move export tasks to a process and clean up process initialization for all ProcessMainClass descendents 2024-11-21 16:00:09 +01:00
SimpleLinkScraper.java (crawler) Add a new system property crawler.maxFetchSize 2024-12-30 15:10:11 +01:00