mirror of
https://github.com/MarginaliaSearch/MarginaliaSearch.git
synced 2025-02-24 05:18:58 +00:00
6a04cdfddf
Deprecate the LoadUrl instruction entirely. We no longer need to be told upfront about which URLs to expect, as IDs are generated from the domain id and document ordinal. For now, we no longer store new URLs in different domains. We need to re-implement this somehow, probably in a different job or a as a different output. |
||
|---|---|---|
| .. | ||
| src | ||
| build.gradle | ||
| readme.md | ||
Loading Process
The loading process reads converted data and inserts it into the database, as well as creates a journal file that will be used to create a static index for the index-service.
Central Classes
- LoaderMain main class.
- Loader evaluates loading instructions.