Mirror/MarginaliaSearch
1
0
Fork 0
mirror of https://github.com/MarginaliaSearch/MarginaliaSearch.git synced 2025-02-24 13:19:02 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
40f42bf654
MarginaliaSearch/code/processes/loading-process
History
Viktor Lofgren dcb43a3308 (slop) Introduce table concept to keep track of positions and simplify closing 
The most common error when dealing with Slop columns is that they can fall out of sync with each other if the programmer accidentally does a conditional read and forgets to skip.

The second most common error is forgetting to close one of the columns in a reader or writer.

To deal with both cases, a new class SlopTable is added that keeps track of the lifecycle of all slop columns and performs a check when closing them that they are in sync.
2024-07-27 13:47:47 +02:00
..
java/nu/marginalia/loading (wip) Extract and encode spans data 2024-07-27 11:44:13 +02:00
test/nu/marginalia/loader (wip) Extract and encode spans data 2024-07-27 11:44:13 +02:00
build.gradle (slop) Introduce table concept to keep track of positions and simplify closing 2024-07-27 13:47:47 +02:00
readme.md (docs) Begin un-fucking the docs after refactoring 2024-02-27 21:22:21 +01:00

readme.md

Loading Process

The loading process reads converted data and inserts it into the database, as well as creates a journal file that will be used to create a static index for the index-service.

Central Classes