mirror of
https://github.com/MarginaliaSearch/MarginaliaSearch.git
synced 2025-02-23 21:18:58 +00:00
a91ab4c203
Some refactoring is still needed, but an dummy actor is in place and a process that crawls URLs from the livecapture service's RSS endpoints; that makes it all the way to being indexable. |
||
|---|---|---|
| .. | ||
| api | ||
| data-extractors | ||
| java/nu/marginalia | ||
| test/nu/marginalia/svc | ||
| build.gradle | ||
| readme.md | ||
The execution subsystem is responsible for the execution of long running tasks on each index node. It lives in the executor-service module.
It accomplishes this using the message queue and actor library, which permits program state to survive crashes and reboots.
The subsystem exposes four APIs:
- Execution API - for starting and stopping tasks, also contains miscellaneous commands
- Crawl API - for managing the crawl workflow
- Sideload API - for sideloading data
- Export API - for exporting data