Mirror/MarginaliaSearch

mirror of https://github.com/MarginaliaSearch/MarginaliaSearch.git synced 2025-02-24 05:18:58 +00:00

History

Viktor Lofgren 2f8488610a (loader) Fix bug where trailing deferred domain meta inserts weren't executed		2023-07-31 14:23:23 +02:00
..
src	(loader) Fix bug where trailing deferred domain meta inserts weren't executed	2023-07-31 14:23:23 +02:00
build.gradle	(minor) Re-enable monkey-patch-json for converter	2023-07-31 10:31:46 +02:00
readme.md	More restructuring, big bug fixes in keyword extraction.	2023-03-13 17:39:53 +01:00

readme.md

Converting Process

The converting process reads crawl data and extracts information to be fed into the index, such as keywords, metadata, urls, descriptions...

Central Classes

ConverterMain orchestrates the conversion process.
DocumentProcessor converts a single document.
- HtmlDocumentProcessorPlugin has HTML-specific logic related to a document, keywords and identifies features such as whether it has javascript.
- PlainTextDocumentProcessorPlugin has plain text-specific logic related to a document...
DomainProcessor converts each document and generates domain-wide metadata such as link graphs.

See Also

features-convert