MarginaliaSearch/run
Viktor Lofgren bc818056e6 (run) Fix templates for mariadb
Apparently the docker image contract changed at some point, and now we should spawn mariadbd and not mysqld; mariadb-admin and not mysqladmin.
2025-01-16 15:27:02 +01:00
..
dist (control, WIP) MQFSM and ProcessService are sitting in a tree 2023-07-11 17:08:43 +02:00
env Migrate the docker compose files 2024-02-28 11:48:16 +01:00
install (run) Fix templates for mariadb 2025-01-16 15:27:02 +01:00
template/conf (*) Add single-node barebones configuration 2024-01-25 16:40:28 +01:00
test-data Make the code run properly without WMSA_HOME set, adding missing test assets. 2023-03-05 13:47:40 +01:00
.gitignore Restructuring the git repo 2023-03-04 13:19:01 +01:00
experiment-elsewhere.sh (screenshot-capture-tool) Make screenshot-capture-tool cooperate with docker 2023-11-01 16:38:55 +01:00
experiment.sh Fix experiment runner 2023-11-15 14:03:17 +01:00
install-noninteractive.sh (setup) Break out installation action into non-interactive script 2024-11-08 13:38:40 +01:00
install.sh (setup) Break out installation action into non-interactive script 2024-11-08 13:38:40 +01:00
readme.md Update readme.md 2025-01-06 18:35:13 +01:00
setup.sh (setup) Remove OpenNLP tokenization model 2024-11-28 16:03:05 +01:00

Run

This directory is a staging area for running the system. It contains scripts and templates for installing the system on a server, and for running it locally.

Requirements

x86-64 Linux - The system is only tested on x86-64 Linux. It may work on other platforms, but for lack of suitable hardware, this can not be guaranteed.

Docker - It is a bit of a pain to install, but if you follow this guide you're on the right track for ubuntu-like systems.

JDK 23 - The code uses Java 23 preview features.

The civilized way of installing this is to use SDKMAN; graalce is a good distribution choice but it doesn't matter too much.

Tailwindcss - Install NPM and run npm install -D tailwindcss

Quick Set up

https://docs.marginalia.nu/ has a more comprehensive guide for the install and operation of the search engine. This is a quick guide for the impatient.


To go from a clean check out of the git repo to a running search engine, follow these steps.

You're assumed to sit in the project root the whole time.

1. Run the one-time setup

It will create the basic runtime directory structure and download some models and data that doesn't come with the git repo because git deals poorly with large binary files.

$ run/setup.sh

2. Compile the project and build docker images

$ ./gradlew docker

3. Install the system

$ run/install.sh <install-directory>

To install the system, you need to run the install script. It will prompt you for which installation mode you want to use. The options are:

  1. Barebones - This will install a white-label search engine with no data. You can use this to index your own data. It disables and hides functionality that is strongly related to the Marginalia project, such as the Marginalia GUI.
  2. Full Marginalia Search instance - This will install an instance of the search engine configured like search.marginalia.nu. This is useful for local development and testing.
  3. Non-docker installation - This will install the system outside of docker. This is still an experimental run-mode.

It will also prompt you for account details for a new mariadb instance, which will be created for you. The database will be initialized with the schema and data required for the search engine to run.

After filling out all the details, the script will copy the installation files to the specified directory.

4. Run the system

$ cd install_directory
$ docker-compose up -d 
# To see the logs: 
$ docker-compose logs -f

You can now access a search interface at http://localhost:8080, and the admin interface at http://localhost:8081/.

There is no data in the system yet. To load data into the system, see the guide at https://docs.marginalia.nu/.