MarginaliaSearch/code/tools/website-adjacencies-calculator
Viktor 5a5cdaf70e
Improvements to the adjacency calculator and screenshots tool (#13)
* WIP: Improvements to website adjacencies loader tool.

* Improving screenshots capture bot.
2023-04-18 22:21:49 +02:00
..
src Improvements to the adjacency calculator and screenshots tool (#13) 2023-04-18 22:21:49 +02:00
build.gradle Refactor website screenshot tool and website adjacencies calculator into code/tools. 2023-04-11 16:20:27 +02:00
readme.md Refactor website screenshot tool and website adjacencies calculator into code/tools. 2023-04-11 16:20:27 +02:00

Website Adjacencies Calculator

This job updates the website similarity table based on the data in the domain and links-tables in the URL database.

It performs a brute force cosine similarity calculation across the entire link graph.

These adjacencies power the explorer service and random websites-functionality.