Mirror/MarginaliaSearch
1
0
Fork 0
mirror of https://github.com/MarginaliaSearch/MarginaliaSearch.git synced 2025-02-23 21:18:58 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

(loader) Fix it so that the loader doesn't explode if it sees an invalid URL

Browse Source
This commit is contained in:
Viktor Lofgren 2024-09-12 11:36:00 +02:00
parent 99523ca079
commit 2a92de29ce
1 changed files with 7 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

8
code/processes/loading-process/java/nu/marginalia/loading/documents/DocumentLoaderService.java
View File

@ -83,9 +83,15 @@ public class DocumentLoaderService {
projection.ordinal()
);
var parsedUrl = EdgeUrl.parse(projection.url());
if (parsedUrl.isEmpty()) {
logger.error("Failed to parse URL: {}", projection.url());
return;
}
documentDbWriter.add(new DocdbUrlDetail(
urlId,
new EdgeUrl(projection.url()),
parsedUrl.get(),
projection.title(),
projection.description(),
projection.quality(),