mirror of
https://github.com/MarginaliaSearch/MarginaliaSearch.git
synced 2025-02-24 05:18:58 +00:00
.. | ||
adblock | ||
pubdate | ||
topic-detection | ||
readme.md |
Crawl Features
These are bits of search-engine related code that are relatively isolated pieces of business logic, that benefit from the clarity of being kept separate from the rest of the crawling code.
- adblock - Simulates Adblock
- pubdate - Determines when a document was published
- topic-detection - Tries to identify the topic of a website