mirror of
https://github.com/MarginaliaSearch/MarginaliaSearch.git
synced 2025-02-23 21:18:58 +00:00

Previously, in order to load encyclopedia data into the search engine, it was necessary to use the encyclopedia.marginalia.nu converter to first create a .db-file. This isn't very ergonomic, so parts of that code-base was lifted in as a 3rd party library, and conversion from .zim to .db is now done automatically. The output file name is based on the original filename, plus a crc32 hash and a .db-ending, to ensure we can recycle the data on repeat loads.
21 lines
784 B
Markdown
21 lines
784 B
Markdown
# Third Party Code
|
|
|
|
This is a mix of code from other projects, that has either been aggressively modified to suite the needs of the project,
|
|
or lack an artifact, or to override some default that is inappropriate for the type of data Marginalia throws at the library.
|
|
|
|
## Sources and Licenses
|
|
|
|
### Modified
|
|
* [RDRPosTagger](rdrpostagger/) - GPL3
|
|
* [PorterStemmer](porterstemmer/) - LGPL3
|
|
* [Uppend](uppend/) - MIT
|
|
* [OpenZIM](openzim/) - GPL-2.0+
|
|
* [Commons Codec](commons-codec/) - Apache 2.0
|
|
* [encylopedia.marginalia.nu](encyclopedia-marginalia-nu/) - GPL 2.0+
|
|
### Repackaged
|
|
* [SymSpell](symspell/) - LGPL-3.0
|
|
* [Count-Min-Sketch](count-min-sketch/) - Apache 2.0
|
|
|
|
### Monkey Patched
|
|
* [Stanford OpenNLP](monkey-patch-opennlp/) - Apache-2.0
|
|
* [GSON](monkey-patch-gson/) - Apache-2.0 |