server crashing wnels2  2010-02-17 09:32
Status: Closed
 
My labkey webapp has been crashing every night after System maintenance. I have to restart tomcat to recover.
The code is from the cloud10 branch that was created just before the 10.1 branch. log file is attached. problem starts at line number 3496. The gist of the repeating error is below.
Thanks,
Bill

Exception in thread "Lucene Merge Thread #0" org.apache.lucene.index.MergePolicy$MergeException: java.io.FileNotFoundException: /usr/local/apache-tomcat-5.5.27/temp/labkey_full_text_index/_24w.cfs (Too many open files)
    at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:347)
    at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:312)
Caused by: java.io.FileNotFoundException: /usr/local/apache-tomcat-5.5.27/temp/labkey_full_text_index/_24w.cfs (Too many open files)
    at java.io.RandomAccessFile.open(Native Method)
 
 
adam responded:  2010-02-17 09:41
We've made some fixes to the 10.1 search code that should address this. I believe the relevant commits were on the trunk after you branched. Would be great if you could merge the diff between the point on the trunk at which you branched and the 10.1 branch head into your cloud10 branch and test. This should pick up all 10.1 changes since you branched and allow you to merge subsequent 10.1 changes easily.