Mirror/MarginaliaSearch
1
0
Fork 0
mirror of https://github.com/MarginaliaSearch/MarginaliaSearch.git synced 2025-02-24 05:18:58 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
21125206b4
MarginaliaSearch/code/processes/crawling-process
History
Viktor Lofgren eb2ca942d5 Up the default crawl delay to 1 second.
2023-06-07 22:02:17 +02:00
..
src Up the default crawl delay to 1 second. 2023-06-07 22:02:17 +02:00
build.gradle Yet more restructuring. Improved search result ranking. 2023-03-16 21:35:54 +01:00
readme.md More restructuring, big bug fixes in keyword extraction. 2023-03-13 17:39:53 +01:00

readme.md

Crawling Process

The crawling process downloads HTML and saves them into per-domain snapshots.

Central Classes

See Also