Mirror/MarginaliaSearch
1
0
Fork 0
mirror of https://github.com/MarginaliaSearch/MarginaliaSearch.git synced 2025-02-24 13:19:02 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
3714104976
MarginaliaSearch/code/processes/crawling-process/java/nu/marginalia/crawl/fetcher
History
Viktor Lofgren 3714104976 Add loader for slop data in converter. 
Also alter CrawledDocument to not require String parsing of the underlying byte[] data.  This should reduce the number of large memory allocations quite significantly, hopefully reducing the GC churn a bit.
2024-12-17 15:40:24 +01:00
..
socket (chore) Remove lombok 2024-11-11 21:14:38 +01:00
warc Add loader for slop data in converter. 2024-12-17 15:40:24 +01:00
ContentTags.java (crawler) Refactor 2024-09-23 17:51:07 +02:00
Cookies.java (crawler) Refactor 2024-09-23 17:51:07 +02:00
HttpFetcher.java (chore) Remove lombok 2024-11-11 21:14:38 +01:00
HttpFetcherImpl.java (chore) Remove lombok 2024-11-11 21:14:38 +01:00
SitemapRetriever.java (crawler) Refactor 2024-09-23 17:51:07 +02:00