Mirror/MarginaliaSearch

mirror of https://github.com/MarginaliaSearch/MarginaliaSearch.git synced 2025-02-24 05:18:58 +00:00

History

Viktor Lofgren fa162698c2 (term-frequency) Fix concurrency issues in SentenceExtractor and TermFrequencyExporter How'd This Ever Work? (tm) TermFrequencyExporter was using Math.clamp() incorrectly, and SentenceExtractor was synchronizing on its own instance when initializing shared static members, causing rare issues when spinning multiple SE:s up at once.		2024-07-15 05:15:30 +02:00
..
java/nu/marginalia/language	(term-frequency) Fix concurrency issues in SentenceExtractor and TermFrequencyExporter	2024-07-15 05:15:30 +02:00
resources/dictionary	(*) Trim the stopwords list	2024-06-26 12:22:57 +02:00
test/nu/marginalia/language	(qs) Retire NGramBloomFilter, integrate new segmentation model instead	2024-03-19 10:42:09 +01:00
test-resources/html	(refac) Remove src/main from all source code paths.	2024-02-23 16:13:40 +01:00
build.gradle	(*) Lift jetty and guava-dependencies	2024-05-23 14:20:01 +02:00
readme.md	Clean up documentation and rename `domain-links` to `link-graph`	2024-02-28 11:40:39 +01:00

readme.md

Language Processing

This library contains various tools used in language processing.

Central Classes

SentenceExtractor - Creates a DocumentLanguageData from a text, containing its words, how they stem, POS tags, and so on.

See Also

features-convert/keyword-extraction uses this code to identify which keywords are important.