MarginaliaSearch/code
Viktor Lofgren 460998d512 (index) Move index construction to separate process.
This provides a much cleaner separation of concerns, and makes it possible to get rid of a lot of the gunkier parts of the index service.  It will also permit lowering the Xmx on the index service a fair bit, so we can get CompressedOOps again :D
2023-08-25 12:52:54 +02:00
..
api (index) Move index construction to separate process. 2023-08-25 12:52:54 +02:00
common (index) Move index construction to separate process. 2023-08-25 12:52:54 +02:00
features-convert Upgrade antique lombok plugin 2023-08-23 14:34:32 +00:00
features-crawl Upgrade antique lombok plugin 2023-08-23 14:34:32 +00:00
features-index (index) Move index construction to separate process. 2023-08-25 12:52:54 +02:00
features-search (system) Remove EdgeId<T> and similar objects 2023-08-24 17:46:02 +02:00
libraries Upgrade antique lombok plugin 2023-08-23 14:34:32 +00:00
process-models (loader) Implement new linkdb in loader 2023-08-24 13:07:54 +02:00
processes (index) Move index construction to separate process. 2023-08-25 12:52:54 +02:00
services-core (index) Move index construction to separate process. 2023-08-25 12:52:54 +02:00
services-satellite (system) Remove EdgeId<T> and similar objects 2023-08-24 17:46:02 +02:00
tools (system) Remove EdgeId<T> and similar objects 2023-08-24 17:46:02 +02:00
readme.md (docs) Add control-service to the main readme.md 2023-08-01 22:52:41 +02:00

Code

This is a pretty large and diverse project with many moving parts.

You'll find a short description in each module of what it does and how it relates to other modules. The modules each have names like "library" or "process" or "feature". These have specific meanings. See doc/module-taxonomy.md.

Overview

A map of the most important components and how they relate can be found below.

image

Services

Processes

Processes are batch jobs that deal with data retrieval, processing and loading.

Tools

Features

Features are relatively stand-alone components that serve some part of the domain. They aren't domain-independent, but isolated.

Libraries and primitives

Libraries are stand-alone code that is independent of the domain logic.

  • common elements for creating a service, a client etc.
  • libraries containing non-search specific code.
    • array - large memory mapped area library
    • btree - static btree library