Mirror/MarginaliaSearch
1
0
Fork 0
mirror of https://github.com/MarginaliaSearch/MarginaliaSearch.git synced 2025-02-24 05:18:58 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
afe56c7cf1
MarginaliaSearch/code/services-core/executor-service
History
Viktor Lofgren aebb2652e8 (wip) Extract and encode spans data 
Refactoring keyword extraction to extract spans information.

Modifying the intermediate storage of converted data to use the new slop library, which is allows for easier storage of ad-hoc binary data like spans and positions.

This is a bit of a katamari damacy commit that ended up dragging along a bunch of other fairly tangentially related changes that are hard to break out into separate commits after the fact.  Will push as-is to get back to being able to do more isolated work.
2024-07-27 11:44:13 +02:00
..
java/nu/marginalia/executor (control) Partial implementation of inspection utility for crawl data 2024-05-20 18:02:46 +02:00
test/nu/marginalia/executor (*) Clean up code related to crawl parquet inspection 2024-05-22 12:55:08 +02:00
build.gradle (wip) Extract and encode spans data 2024-07-27 11:44:13 +02:00
readme.md Clean up documentation and rename domain-links to link-graph 2024-02-28 11:40:39 +01:00

readme.md

The executor service is a partitioned service responsible for executing and keeping track of long-running maintenance and operational tasks, such as crawling or data processing.

The executor service is closely linked to the control-service, which provides a user interface for much of the executor's functionality.

The service it itself relatively bare of code, but imports and exposes the execution subsystem, which is responsible for the actual execution of tasks.