mirror of
https://github.com/MarginaliaSearch/MarginaliaSearch.git
synced 2025-02-24 13:19:02 +00:00
0894822b68
This is not hooked in yet, and the term metadata is still left intact. It should probably shrink to a smaller representation (byte?) with the upcoming removal of the position mask. |
||
|---|---|---|
| .. | ||
| java/nu/marginalia | ||
| test/nu/marginalia/io/processed | ||
| build.gradle | ||
| readme.md | ||
The processed-data package contains models and logic for reading and writing parquet files with the output from the converting-process.
Main models:
Since parquet is a column based format, some of the readable models are projections that only read parts of the input file.