mirror of
https://github.com/MarginaliaSearch/MarginaliaSearch.git
synced 2025-02-24 05:18:58 +00:00
11 lines
398 B
Markdown
11 lines
398 B
Markdown
|
# Crawl Features
|
||
|
|
|
||
|
|
These are bits of search-engine related code that are relatively isolated pieces of business logic,
|
||
|
|
that benefit from the clarity of being kept separate from the rest of the crawling code.
|
||
|
|
|
||
|
|
|
||
|
|
* [adblock](adblock/) - Simulates Adblock
|
||
|
|
* [pubdate](pubdate/) - Determines when a document was published
|
||
|
|
* [topic-detection](topic-detection/) - Tries to identify the topic of a website
|
||
|
|
|