Issue 45624: Search indexer continually visiting subjects, datasets, lists, and navigation

issues
Status:open
Assigned To:triage
Type:Defect
Area:Search
Priority:3
Milestone:22.11
Opened:2022-06-04 17:26 by jeckels
Changed:2022-07-05 18:06 by jeckels
Resolved:
Resolution:
Related:45502
Support Ticket: 
Pull Requests:
Closed:
2022-06-04 17:26 jeckels
Title»Search indexer continually visiting subjects, datasets, lists, and navigation
Assigned To»triage
Notify»Matthew Bellew;wendyi
Type»Defect
Area»Search
Priority»3
Milestone»22.07
Now that we've fixed the indexing behavior for materials so they don't get revisited by the indexer constantly, it makes it easier to see that other, less massive data types are continually being reindexed too.

On staging.labkey.org right now, there's a steady stream of documents being reindexed. A typical example for a single hour today included:

list: 700
subject: 450
navigation: 133
assay: 73
dataset: 43
file: 1

I can believe than an ETL or other process created a file, but that's about it in terms of reasonable activity. Wendy and I are the only ones to log into the staging server today, and I doubt either of us touched 700 lists.

We need to continue to chip away at the background resource CPU and memory utilization to improve our scalability.

2022-06-04 17:27 jeckels
Related»45502

2022-07-05 18:06 jeckels
Milestone22.07»22.11