Mirror/MarginaliaSearch
1
0
Fork 0
mirror of https://github.com/MarginaliaSearch/MarginaliaSearch.git synced 2025-02-24 05:18:58 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
0f9cd9c87d
MarginaliaSearch/code/process-models/crawling-model
History
Viktor Lofgren 0f9cd9c87d (warc) More accurate filering of advisory records 
Further create records for resources that were blocked due to robots.txt; as well as tests to verify this happens.
2023-12-15 21:37:02 +01:00
..
src (warc) More accurate filering of advisory records 2023-12-15 21:37:02 +01:00
build.gradle (warc) More accurate filering of advisory records 2023-12-15 21:31:16 +01:00
readme.md (refactor) Remove features-search and update documentation 2023-10-09 15:12:30 +02:00

readme.md

Crawling Models

Contains models shared by the crawling-process and converting-process.

Central Classes

Serialization