MarginaliaSearch/code/processes/website-adjacencies-calculator
Viktor Lofgren 734996002c (*) install script for deploying Marginalia outside the codebase
The changeset also makes the control service responsible for flyway migrations.  This helps reduce the number of places the database configuration needs to be spread out.  These automatic migrations can be disabled with -DdisableFlyway=true.

The commit also adds curl to the docker container, to enable docker health checks and interdependencies.
2024-01-11 12:40:03 +01:00
..
src (*) install script for deploying Marginalia outside the codebase 2024-01-11 12:40:03 +01:00
build.gradle (*) Replace EC_DOMAIN_LINK table with files and in-memory caching 2024-01-08 15:53:13 +01:00
readme.md (executor-service) Embed dist/ in executor-service's docker image 2023-10-19 17:48:34 +02:00

Website Adjacencies Calculator

This job updates the website similarity table based on the data in the domain and links-tables in the URL database.

It performs a brute force cosine similarity calculation across the entire link graph.

These adjacencies power the explorer service and random websites-functionality.