Mirror/MarginaliaSearch
1
0
Fork 0
mirror of https://github.com/MarginaliaSearch/MarginaliaSearch.git synced 2025-02-23 21:18:58 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

(crawler) Exit crawler retriever on thread interrupted

Browse Source
This commit is contained in:
Viktor Lofgren 2023-10-30 11:34:16 +01:00
parent 6bac3c75cb
commit fd5a7eac87
1 changed files with 2 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
code/processes/crawling-process/src/main/java/nu/marginalia/crawl/retreival/CrawlerRetreiver.java
View File

@ -149,7 +149,8 @@ public class CrawlerRetreiver {
while (!crawlFrontier.isEmpty()
&& !crawlFrontier.isCrawlDepthReached()
&& errorCount < MAX_ERRORS)
&& errorCount < MAX_ERRORS
&& !Thread.interrupted())
{
var top = crawlFrontier.takeNextUrl();