Mirror/MarginaliaSearch
1
0
Fork 0
mirror of https://github.com/MarginaliaSearch/MarginaliaSearch.git synced 2025-02-24 21:29:00 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
6e4252cf4c
MarginaliaSearch/code/processes/live-crawler/java/nu/marginalia/livecrawler
History
Viktor Lofgren 6e4252cf4c (live-crawl) Make the actor poll for feeds changes instead of being a one-shot thing. 
Also changes the live crawl process to store the live crawl data in a fixed directory in the storage base rather than versioned directories.
2024-11-20 15:36:25 +01:00
..
LiveCrawlDataSet.java (model) Remove deprecated fields from CrawledDocument and CrawledDomain 2024-11-20 15:27:05 +01:00
LiveCrawlerMain.java (live-crawl) Make the actor poll for feeds changes instead of being a one-shot thing. 2024-11-20 15:36:25 +01:00
LiveCrawlerModule.java (live-crawler) Crude first-try process for live crawling #WIP 2024-11-19 19:35:01 +01:00
SimpleLinkScraper.java (live-crawler) Crude first-try process for live crawling #WIP 2024-11-19 19:35:01 +01:00