Mirror/MarginaliaSearch
1
0
Fork 0
mirror of https://github.com/MarginaliaSearch/MarginaliaSearch.git synced 2025-02-24 13:19:02 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
5b347e17ac
MarginaliaSearch/code/processes/crawling-process/java/nu/marginalia/crawl/fetcher
History
Viktor Lofgren 55d6ab933f Merge branch 'master' into slop-crawl-data-spike
2025-01-21 13:32:58 +01:00
..
socket (crawler) Migrate away from using OkHttp in the crawler, use Java's HttpClient instead. 2025-01-19 15:07:11 +01:00
warc Merge branch 'master' into slop-crawl-data-spike 2025-01-21 13:32:58 +01:00
ContentTags.java (crawler) Migrate away from using OkHttp in the crawler, use Java's HttpClient instead. 2025-01-19 15:07:11 +01:00
Cookies.java (crawler) Migrate away from using OkHttp in the crawler, use Java's HttpClient instead. 2025-01-19 15:07:11 +01:00
HttpFetcher.java (crawler) New Jsoup based sitemap parser 2025-01-20 14:37:44 +01:00
HttpFetcherImpl.java (crawler) Reduce log spam from error handling in new sitemap fetcher 2025-01-20 23:17:13 +01:00
SitemapRetriever.java (crawler) Refactor 2024-09-23 17:51:07 +02:00