Mirror/MarginaliaSearch
1
0
Fork 0
mirror of https://github.com/MarginaliaSearch/MarginaliaSearch.git synced 2025-02-23 21:18:58 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
3714104976
MarginaliaSearch/code/tools/experiment-runner
History
Viktor Lofgren 3714104976 Add loader for slop data in converter. 
Also alter CrawledDocument to not require String parsing of the underlying byte[] data.  This should reduce the number of large memory allocations quite significantly, hopefully reducing the GC churn a bit.
2024-12-17 15:40:24 +01:00
..
java/nu/marginalia/tools Add loader for slop data in converter. 2024-12-17 15:40:24 +01:00
build.gradle (refac) Move export tasks to a process and clean up process initialization for all ProcessMainClass descendents 2024-11-21 16:00:09 +01:00
readme.md Add experiment runner tool and got rid of experiments module in processes. 2023-03-28 16:58:46 +02:00

readme.md

Experiment Runner

This tool is a means of launching crawl data processing experiments, for interacting with crawl data.

It's launched with run/experiment.sh. New experiments need to be added to ExperimentRunnerMain in order for the script to be able to run them.