I’m encountering an issue with my website’s SOLR-based search functionality. The search works well for smaller datasets, but when the result set exceeds 4000 elements, the webpage crashes, throwing an error 500 that seems to originate from SOLR.
I’m seeking suggestions on how to scale up my system to handle larger volumes of data and queries effectively. Here are some details about my setup:
SOLR version: 8.9.0
Website technology stack: PHP/Drupal framework

Any advice or suggestions on optimizing SOLR performance, scaling up the system, or troubleshooting the issue would be greatly appreciated. Thank you!

I’ve checked the SOLR logs, but they don’t indicate any specific problems. Additionally, I’ve attempted to address the issue by increasing the open file limit and the maximum number of processes, but this hasn’t resolved the problem.