MarginaliaSearch/code/processes/crawling-process/java/nu/marginalia/crawl
Viktor Lofgren a91ab4c203 (live-crawler) Crude first-try process for live crawling #WIP
Some refactoring is still needed, but an dummy actor is in place and a process that crawls URLs from the livecapture service's RSS endpoints; that makes it all the way to being indexable.
2024-11-19 19:35:01 +01:00
..
fetcher (chore) Remove lombok 2024-11-11 21:14:38 +01:00
logic (crawler) Clean up the crawler code a bit, removing vestigial abstractions and historical debris 2024-10-15 17:27:59 +02:00
retreival (live-crawler) Crude first-try process for live crawling #WIP 2024-11-19 19:35:01 +01:00
warc (crawler) Code quality 2024-04-22 15:37:35 +02:00
CrawlerMain.java (chore) Remove lombok 2024-11-11 21:14:38 +01:00
CrawlerModule.java (chore) Remove lombok 2024-11-11 21:14:38 +01:00