Mirror/MarginaliaSearch
1
0
Fork 0
mirror of https://github.com/MarginaliaSearch/MarginaliaSearch.git synced 2025-02-24 05:18:58 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
ad1be7c835
MarginaliaSearch/code/crawl/crawl-job-extractor-process
History
Viktor Lofgren ad1be7c835 Move all code to a code directory.
2023-03-07 17:14:32 +01:00
..
src Move all code to a code directory. 2023-03-07 17:14:32 +01:00
build.gradle Move all code to a code directory. 2023-03-07 17:14:32 +01:00
readme.md Move all code to a code directory. 2023-03-07 17:14:32 +01:00

readme.md

Crawl Job Extractor

The crawl job extractor creates a file containing a list of domains along with known URLs. This is consumed by the crawling-process.