Mirror/MarginaliaSearch
1
0
Fork 0
mirror of https://github.com/MarginaliaSearch/MarginaliaSearch.git synced 2025-02-24 13:19:02 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
9c06f446fb
MarginaliaSearch/code/features-convert/data-extractors/readme.md

7 lines
469 B
Markdown
Raw Normal View History

(control) New export actions for RSS/Atom feeds and term frequency data This commit also refactors the executor a bit, and introduces a new converter-feature called data-extractors for this class of jobs.
2024-01-15 13:54:26 +00:00
Contains converter-*like* extraction jobs that operate on crawled data to produce export files.
## Important classes
(docs) Begin un-fucking the docs after refactoring
2024-02-27 20:15:49 +00:00
* [AtagExporter](java/nu/marginalia/extractor/AtagExporter.java) - extracts anchor texts from the crawled data.
* [FeedExporter](java/nu/marginalia/extractor/FeedExporter.java) - tries to find RSS/Atom feeds within the crawled data.
* [TermFrequencyExporter](java/nu/marginalia/extractor/TermFrequencyExporter.java) - exports the 'TF' part of TF-IDF.
Reference in New Issue Copy Permalink