mirror of
https://github.com/MarginaliaSearch/MarginaliaSearch.git
synced 2025-02-24 21:29:00 +00:00
6 lines
199 B
Markdown
6 lines
199 B
Markdown
|
# Crawl Job Extractor
|
||
|
|
|
||
|
|
The crawl job extractor creates a file containing a list of domains
|
||
|
|
along with known URLs.
|
||
|
|
|
||
|
|
This is consumed by [processes/crawling-process](../../processes/crawling-process).
|