mirror of
https://github.com/MarginaliaSearch/MarginaliaSearch.git
synced 2025-02-23 13:09:00 +00:00
0307c55f9f
To avoid having to either hard-code or manually configure service addresses (possibly several dozen), and to reduce the project's dependency on docker to deal with routing and discovery, the option to use [Zookeeper](https://zookeeper.apache.org/) to manage services and discovery has been added. A service registry interface was added, with a Zookeeper implementation and a basic implementation that only works on docker and hard-codes everything. The last remaining REST service, the assistant-service, has been migrated to gRPC. This also proved a good time to clear out primordial technical debt from the root of the codebase. The 'service-client' library has been taken behind the barn and given a last farewell. It's replaced by a small library for managing gRPC channels. Since it's no longer used by anything, RxJava has been removed as a dependency from the project. Although the current state seems reasonably stable, this is a work-in-progress commit. |
||
|---|---|---|
| .. | ||
| adblock | ||
| anchor-keywords | ||
| data-extractors | ||
| keyword-extraction | ||
| pubdate | ||
| reddit-json | ||
| stackexchange-xml | ||
| summary-extraction | ||
| topic-detection | ||
| readme.md | ||
Converter Features
Major features
- keyword-extraction - Identifies keywords to index in a document
- summary-extraction - Generate an excerpt/quote from a website to display on the search results page.
Smaller features:
- adblock - Simulates Adblock
- pubdate - Determines when a document was published
- topic-detection - Tries to identify the topic of a website