Mirror/MarginaliaSearch
1
0
Fork 0
mirror of https://github.com/MarginaliaSearch/MarginaliaSearch.git synced 2025-02-24 13:19:02 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
b945fd7f39
MarginaliaSearch/crawl/crawl-job-extractor-process/readme.md
Viktor Lofgren b945fd7f39 A lot of readmes, some refactoring.
2023-03-06 18:32:13 +01:00

178 B
Raw Blame History

Crawl Job Extractor

The crawl job extractor creates a file containing a list of domains along with known URLs. This is consumed by the crawling-process.