MarginaliaSearch/code/execution
Viktor Lofgren 738e0e5fed (process) Add option for automatic profiling
The change adds a new system property 'system.profile' that makes ProcessService automatically trigger JFR profiling of the processes it spawns.  By default, these are put in the log directory.

The change also adds a JVM parameter that makes it shut up about native access.
2024-06-27 13:58:36 +02:00
..
api (*) Lift jetty and guava-dependencies 2024-05-23 14:20:01 +02:00
java/nu/marginalia (process) Add option for automatic profiling 2024-06-27 13:58:36 +02:00
test/nu/marginalia/svc (refac) Remove src/main from all source code paths. 2024-02-23 16:13:40 +01:00
build.gradle (*) Lift jetty and guava-dependencies 2024-05-23 14:20:01 +02:00
readme.md Clean up documentation and rename domain-links to link-graph 2024-02-28 11:40:39 +01:00

The execution subsystem is responsible for the execution of long running tasks on each index node. It lives in the executor-service module.

It accomplishes this using the message queue and actor library, which permits program state to survive crashes and reboots.

The subsystem exposes four APIs:

  • Execution API - for starting and stopping tasks, also contains miscellaneous commands
  • Crawl API - for managing the crawl workflow
  • Sideload API - for sideloading data
  • Export API - for exporting data