MarginaliaSearch/code/services-core
Viktor 8e1abc3f10
(index-reverse) Parallel construction of the reverse indexes. (#52)
* (index-reverse) Parallel construction of the reverse indexes.

* (array) Remove wasteful calculation of numDistinct before merging two sorted arrays.

* (index-reverse)  Force changes to disk on close, reduce logging.

* (index-reverse)  Clean up merging process and add back logging

* (run)  Add a conservative default for INDEX_CONSTRUCTION_PROCESS_OPTS's parallelism as it eats a lot of RAM

* (index-reverse)  Better logging during processing

* (array) 2GB+ compatible write() function

* (array) 2GB+ compatible write() function

* (index-reverse) We are logging like Bolsonaro and I will not have it.

* (reverse-index) Self-diagnostics

* (btree) Fix bug in btree reader to do with large data sizes
2023-10-07 10:00:00 +02:00
..
assistant-service (build) Move unit test configuration to root build.gradle 2023-10-04 12:46:22 +02:00
control-service (build) Move unit test configuration to root build.gradle 2023-10-04 12:46:22 +02:00
index-service (index-reverse) Parallel construction of the reverse indexes. (#52) 2023-10-07 10:00:00 +02:00
search-service (build) Move unit test configuration to root build.gradle 2023-10-04 12:46:22 +02:00
readme.md (control) Control service should be a core service. 2023-08-01 15:49:50 +02:00

Core Services

The cores services constitute the main functionality of the search engine.

  • The search-service parses queries, interrogates the index-service, and decorates search results with metadata from the database.

  • The index-service contains the indexes, it answers questions about which documents contain which terms.

  • The control-service provides an operator's user interface, and is responsible for orchestrating the various processes of the system.

  • The assistant-service helps the search service with spelling suggestions other peripheral functionality.