MarginaliaSearch/code/processes/loading-process
Viktor Lofgren a91ab4c203 (live-crawler) Crude first-try process for live crawling #WIP
Some refactoring is still needed, but an dummy actor is in place and a process that crawls URLs from the livecapture service's RSS endpoints; that makes it all the way to being indexable.
2024-11-19 19:35:01 +01:00
..
java/nu/marginalia/loading (live-crawler) Crude first-try process for live crawling #WIP 2024-11-19 19:35:01 +01:00
test/nu/marginalia/loader (chore) Remove lombok 2024-11-11 21:14:38 +01:00
build.gradle (build) Fix dependency churn from testcontainers 2024-08-25 10:35:48 +02:00
readme.md (docs) Begin un-fucking the docs after refactoring 2024-02-27 21:22:21 +01:00

Loading Process

The loading process reads converted data and inserts it into the database, as well as creates a journal file that will be used to create a static index for the index-service.

Central Classes