Viktor Lofgren
9351593495
(setup) Use huggingface for versioned hosting of language models
2024-11-08 13:38:40 +01:00
Viktor Lofgren
d74436f546
(setup) Use checksums for rdrpostagger and opennlp files
...
Also use versioned URLs for rdrpostagger
2024-11-08 13:38:40 +01:00
Viktor Lofgren
76e9053dd0
(setup) Move some file-downloads from setup script to the first boot of the control node of the system
...
We can only do this for files that are not required for unit tests.
As it is illegal to run more than one instance of the control service, this should be fine with regard to race conditions. The boot orchestration will also ensure that no other services will boot up before the downloading is complete.
2024-11-06 15:28:20 +01:00
Viktor Lofgren
7eb955cc42
(setup) Change mirror for opennlp
...
Seems like the estointernet mirror no longer works. Use apache.org instead.
2024-07-16 15:19:13 +02:00
Viktor Lofgren
9c49e876d5
(conf) Update the setup.sh script to also be able to perform model upgrades
2024-04-29 17:46:20 +02:00
Viktor Lofgren
d8f4e7d72b
(qs) Retire NGramBloomFilter, integrate new segmentation model instead
2024-03-19 10:42:09 +01:00
Viktor Lofgren
264e2db539
(control) UX-improvements for control service
...
This commit overhauls a lot of the UX for the control service, adding a new actions menu to the nodes views. It has many small tweaks to make the work flow better.
It also adds a new /uploads directory in each index node, from which sideloaded data can be selected. This is a bit of a breaking change, as this directory needs to exist in each index node.
2024-01-12 12:33:05 +01:00
Viktor
5bd3934d22
Merge pull request #64 from dreimolo/macos_AS_fix
...
Macos apple silicon fix, and slight improvements to sample downloader
2023-12-18 18:29:14 +01:00
Viktor Lofgren
128f550ee5
(run) Download to a temporary file to avoid corruption from aborted downloads
2023-12-18 18:28:17 +01:00
Viktor Lofgren
c92f1b8df8
(geo-ip) Revert removal of ip2location logic
...
We do both ip2location and ASN data.
The change also adds some keywords based on autonomous system information, on a somewhat experimental basis. It would be neat to be able to e.g. exclude cloud services or just e.g. cloudflare from the search results.
2023-12-17 15:03:00 +01:00
Viktor Lofgren
d7bd540683
(*) Replace the ip2location IP geolocation data with ASN information from apnic.net.
...
Doesn't really make sense to use ip2location as a middle man for information that is already freely available...
2023-12-16 21:55:04 +01:00
Viktor Lofgren
93122bdd18
(run) Add two nodes to the demo setup
2023-10-16 17:37:26 +02:00
Viktor Lofgren
16e0738731
(*) Get multi-node routing working.
2023-10-15 18:38:30 +02:00
Viktor Lofgren
4c26674ff4
(setup) Use mirrored lid.176.ftz file that is of a compatible version
2023-10-03 10:29:44 +02:00
Viktor Lofgren
23be648456
(setup) use curl instead of wget for setup.sh
2023-10-02 16:38:23 +02:00
Viktor Lofgren
194a6057dd
(index,control) Recoverable index backups
2023-08-25 14:57:43 +02:00
Viktor Lofgren
b958acb76a
(file-storage) New File Storage type for linkdb
2023-08-24 09:06:13 +02:00
Viktor Lofgren
e8c0648e04
Fix missing vol/ss dir in setup.sh
2023-08-23 17:59:40 +02:00
Viktor Lofgren
46d761f34f
(language) fasttext based language filter
2023-08-16 15:48:12 +02:00
Viktor Lofgren
cdfe284f9a
(file storage) File Storage Type for EXPORT data
...
(file storage) File Storage Type for EXPORT data
2023-08-05 14:45:03 +02:00
Viktor Lofgren
8b74e3aa0d
(*) File Storage WIP
2023-07-14 17:08:10 +02:00
Viktor
f1c6525a50
Update setup.sh
2023-04-02 14:44:43 +02:00
Viktor Lofgren
964014860a
Get suggestions working again
2023-03-22 15:11:22 +01:00
Viktor Lofgren
347f16939c
Fix broken setup script
2023-03-12 12:21:37 +01:00
Viktor Lofgren
fe0d754f2c
Make the code run properly without WMSA_HOME set, adding missing test assets.
2023-03-05 14:12:13 +01:00
Viktor Lofgren
fd1b56dbad
Make the code run properly without WMSA_HOME set, adding missing test assets.
2023-03-05 13:47:40 +01:00
Viktor Lofgren
ef87e123ba
WIP run and setup
2023-03-04 15:17:02 +01:00
Viktor Lofgren
3e5e537a6b
WIP run and setup
2023-03-04 15:13:00 +01:00
Viktor Lofgren
15754d7ae8
WIP run and setup
2023-03-04 15:02:52 +01:00
Viktor Lofgren
8d1172f56e
WIP run and setup
2023-03-04 14:45:35 +01:00
Viktor Lofgren
6aad8de316
WIP run and setup
2023-03-04 14:42:24 +01:00
Viktor Lofgren
d3fa7d5181
WIP run and setup
2023-03-04 14:35:50 +01:00
