Mirror/MarginaliaSearch
1
0
Fork 0
mirror of https://github.com/MarginaliaSearch/MarginaliaSearch.git synced 2025-02-24 05:18:58 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
9539fdb53c
MarginaliaSearch/code/services-core/executor-service
History
Viktor Lofgren 17dc00d05f (control) Partial implementation of inspection utility for crawl data 
Uses duckdb and range queries to read the parquet files directly from the index partitions.

UX is a bit rough but is in working order.
2024-05-20 18:02:46 +02:00
..
java/nu/marginalia/executor (control) Partial implementation of inspection utility for crawl data 2024-05-20 18:02:46 +02:00
test/nu/marginalia/executor (control) Partial implementation of inspection utility for crawl data 2024-05-20 18:02:46 +02:00
build.gradle (build) Java 22 and its consequences has been a disaster for Marginalia Search 2024-04-24 14:44:39 +02:00
readme.md Clean up documentation and rename domain-links to link-graph 2024-02-28 11:40:39 +01:00

readme.md

The executor service is a partitioned service responsible for executing and keeping track of long-running maintenance and operational tasks, such as crawling or data processing.

The executor service is closely linked to the control-service, which provides a user interface for much of the executor's functionality.

The service it itself relatively bare of code, but imports and exposes the execution subsystem, which is responsible for the actual execution of tasks.