Viktor Lofgren ed373eef61 Refactor crawler and add special logic for some platforms ... * Break apart CrawlerRetreiver * Break apart HttpFetcher into an interface and impl for testing sanity * Add special logic for Lemmy, Mediawiki and Discourse to not waste requests on paths that aren't interesting.		2023-06-27 10:57:54 +02:00
..
crawl-job-extractor	Improved crawl-job-extractor.	2023-06-20 11:37:52 +02:00
experiment-runner	Refactor crawler and add special logic for some platforms	2023-06-27 10:57:54 +02:00
load-test	Refactor website screenshot tool and website adjacencies calculator into code/tools.	2023-04-11 16:20:27 +02:00
screenshot-capture-tool	Improving screenshots capture bot.	2023-04-17 18:04:22 +02:00
term-frequency-extractor	Remove unrelated code, break tools into their own directory.	2023-03-17 16:03:11 +01:00
website-adjacencies-calculator	Make the adjacency calculator behave like it used to in the past, when it gave better results.	2023-06-07 22:03:06 +02:00