Mirror/MarginaliaSearch
1
0
Fork 0
mirror of https://github.com/MarginaliaSearch/MarginaliaSearch.git synced 2025-02-24 13:19:02 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
ecb5eedeae
MarginaliaSearch/code/processes/crawling-process/java/nu/marginalia
History
Viktor Lofgren ecb5eedeae (crawler, EXPERIMENT) Disable content type probing and use Accept header instead 
There's reason to think this may speed up crawling quite significantly, and the benefits of the probing aren't quite there.
2024-09-30 14:53:01 +02:00
..
crawl (crawler, EXPERIMENT) Disable content type probing and use Accept header instead 2024-09-30 14:53:01 +02:00