MarginaliaSearch/code/libraries
Viktor Lofgren 7c6e18f7a7 (*) Overhaul settings and properties
Use a system.properties file to configure the system.  This is loaded statically by MainClass or ProcessMainClass.  Update the property names to be more consistent, and update the documentations to reflect the changes.
2024-01-13 17:12:18 +01:00
..
array (*) Overhaul settings and properties 2024-01-13 17:12:18 +01:00
big-string (*) Upgrade to JDK21 with preview enabled. 2023-09-24 10:38:59 +02:00
blocking-thread-pool (converter) Use SimpleBlockingThreadPool in ProcessingIterator 2024-01-03 14:27:47 +01:00
braille-block-punch-cards (*) Upgrade to JDK21 with preview enabled. 2023-09-24 10:38:59 +02:00
btree (array) Fix spurious search results 2023-10-26 15:27:02 +02:00
easy-lsh (*) Upgrade to JDK21 with preview enabled. 2023-09-24 10:38:59 +02:00
geo-ip (geo-ip) Update readme 2023-12-17 16:08:33 +01:00
guarded-regex (*) Upgrade to JDK21 with preview enabled. 2023-09-24 10:38:59 +02:00
language-processing (language-processing) Add maximum length limit for text input in SentenceExtractor 2024-01-03 14:27:47 +01:00
message-queue (test) Clean up test usage of migrations 2024-01-12 15:55:50 +01:00
next-prime (*) Upgrade to JDK21 with preview enabled. 2023-09-24 10:38:59 +02:00
random-write-funnel (*) Upgrade to JDK21 with preview enabled. 2023-09-24 10:38:59 +02:00
term-frequency-dict (build) Move unit test configuration to root build.gradle 2023-10-04 12:46:22 +02:00
test-helpers (test) Clean up test usage of migrations 2024-01-12 15:55:50 +01:00
LICENSE.txt The refactoring will continue until morale improves. 2023-03-12 10:50:31 +01:00
readme.md (mq) Refactor mq and actor library and move it to libraries out of common 2023-08-15 10:53:23 +02:00

Libraries

These are libraries that are not strongly coupled to the search engine's business logic. These libraries may not depend on features, services, processes, models, etc.

NOTE: These libraries are co-licensed under the MIT license.

Libraries

  • The array library is for memory mapping large memory-areas, which Java has bad support for. It's designed to be able to easily replaced when Java's Foreign Function And Memory API is released.
  • The btree library offers a static BTree implementation based on the array library.
  • language-processing contains primitives for sentence extraction and POS-tagging.
  • The message-queue library.

Micro libraries

  • easy-lsh is a simple locality-sensitive hash for document deduplication
  • guarded-regex makes predicated regular expressions clearer
  • big-string offers seamless string compression
  • random-write-funnel is a tool for reducing write amplification when constructing large files out of order.
  • next-prime naive brute force prime sieve.
  • braille-block-punch-cards renders bit masks into human-readable dot matrices using the braille block.