Problem/Motivation
Setup
- Solr version:
- Drupal Core version:9.5.11
- Search API version:1.20.0
- Search API Solr version:4.3.0
- Configured Solr Connector:
Issue
I have a search api solr system that's been running for a while on 1.29.0. I just upgraded from Drupal 9.5.9 to 9.5.11.
- Upgrading drupal/search_api (1.29.0 => 1.30.0)
- Upgrading drupal/search_api_solr (4.2.10 => 4.3.0)
- Upgrading drupal/search_api_attachments (dev-9.0.x 2e29312 => dev-9.0.x 0d4f5a5)
I created a new solr core and downloaded configs.zip files to it's /conf directory before connecting it to Drupal app. Search Solr API says it can reach it.
Server Connection The Solr server could be reached.
Core Connection The Solr core could be accessed (latency: 5.519913269043 ms).
Minimal required schema version 4.3.0
Preferred schema version 4.3.0
Configured Solr Version 8.4.0
Detected Solr Version 8.4.0
However, when I queue all items for indexing and click index, the screen gets stuck on "initializing..." After a few minutes, it times out with this error:
An AJAX HTTP error occurred.
HTTP Result Code: 504
Debugging information follows.
Path: /batch?id=279&op=do_nojs&op=do
StatusText: error
ResponseText:
504 Gateway Time-out
504 Gateway Time-out
The only things I see in the logs:
File added to the queue for text extraction 1006 for file 1006.
And sometimes, this:
Text extraction failed after 5 attempts 1006 for file 1006.
So, i tried installing this version:
composer require 'drupal/search_api_attachments:^9.0'
Loading composer repositories with package information
Updating dependencies
Lock file operations: 0 installs, 1 update, 0 removals
- Upgrading drupal/search_api_attachments (dev-9.0.x 0d4f5a5 => 9.0.2)
Writing lock file
Installing dependencies from lock file (including require-dev)
Package operations: 0 installs, 1 update, 0 removals
Gathering patches for root package.
Gathering patches for dependencies. This might take a minute.
- Upgrading drupal/search_api_attachments (dev-9.0.x 0d4f5a5 => 9.0.2): Checking out 9.0.2
No change.
Steps to reproduce
I upgraded my site core from 9.5.9 to 9.5.11.
Upgrading drupal/search_api_attachments (dev-9.0.x 2e29312 => dev-9.0.x 0d4f5a5)
Started failing, then:
Upgrading drupal/search_api_attachments (dev-9.0.x 0d4f5a5 => 9.0.2): Checking out 9.0.2
I changed the Solr core as per the search solr api upgrade release notes.
And, text extraction apparently has stopped working. But just on this site as it continues to work fine on another almost duplicate site.
Need some help in how to troubleshoot from here.
Update:
I looked at my server logs, and discovered this might be the cause of the timeouts. But, still no clue as to why now?
[Fri Oct 27 21:38:57.415327 2023] [php:error] [pid 2594] [client 172.31.29.184:57214] PHP Fatal error: Maximum execution time of 600 seconds exceeded in /var/www/html/websites/drupal9/demo9/web/modules/contrib/search_api/src/Plugin/search_api/processor/HtmlFilter.php on line 255, referer: https://demo9.mysite.com/batch?id=285&op=start
[Fri Oct 27 21:39:15.770739 2023] [php:error] [pid 4789] [client 172.31.29.184:24808] PHP Fatal error: Maximum execution time of 240 seconds exceeded in /var/www/html/websites/drupal9/demo9/web/modules/contrib/search_api/src/Plugin/search_api/processor/HtmlFilter.php on line 244, referer: https://demo9.mysite.com/admin/reports/dblog
[Fri Oct 27 21:41:22.826438 2023] [php:error] [pid 4843] [client 172.31.29.184:48294] PHP Fatal error: Maximum execution time of 600 seconds exceeded in /var/www/html/websites/drupal9/demo9/web/modules/contrib/search_api/src/Plugin/search_api/processor/HtmlFilter.php on line 257, referer: https://demo9.mysite.com/batch?id=287&op=start
[Fri Oct 27 21:45:02.948096 2023] [php:error] [pid 2837] [client 172.31.29.184:3918] PHP Fatal error: Maximum execution time of 600 seconds exceeded in /var/www/html/websites/drupal9/demo9/web/modules/contrib/search_api/src/Plugin/search_api/processor/HtmlFilter.php on line 255, referer: https://demo9.mysite.com/batch?id=289&op=start
[Fri Oct 27 21:48:08.510133 2023] [php:error] [pid 4843] [client 172.31.29.184:60288] PHP Fatal error: Maximum execution time of 240 seconds exceeded in /var/www/html/websites/drupal9/demo9/web/modules/contrib/search_api/src/Plugin/search_api/processor/HtmlFilter.php on line 257, referer: https://demo9.mysite.com/admin/config/search/search-api
[Fri Oct 27 21:52:21.345170 2023] [php:error] [pid 5980] [client 172.31.29.184:42414] PHP Fatal error: Maximum execution time of 240 seconds exceeded in /var/www/html/websites/drupal9/demo9/web/modules/contrib/search_api/src/Plugin/search_api/processor/HtmlFilter.php on line 244, referer: https://demo9.mysite.com/admin/reports/auditfiles/notindatabase
[Fri Oct 27 21:57:20.341342 2023] [php:error] [pid 5892] [client 172.31.29.184:21814] PHP Fatal error: Maximum execution time of 600 seconds exceeded in /var/www/html/websites/drupal9/demo9/web/modules/contrib/search_api/src/Plugin/search_api/processor/HtmlFilter.php on line 247, referer: https://demo9.mysite.com/batch?id=291&op=start
[Fri Oct 27 22:04:03.521759 2023] [php:error] [pid 6087] [client 172.31.29.184:47994] PHP Fatal error: Maximum execution time of 240 seconds exceeded in /var/www/html/websites/drupal9/demo9/web/modules/contrib/search_api/src/Plugin/search_api/processor/HtmlFilter.php on line 247
[Fri Oct 27 22:08:16.122301 2023] [php:error] [pid 6023] [client 172.31.29.184:41248] PHP Fatal error: Maximum execution time of 240 seconds exceeded in /var/www/html/websites/drupal9/demo9/web/modules/contrib/search_api/src/Plugin/search_api/processor/HtmlFilter.php on line 244, referer: https://demo9.mysite.com/admin/config/search/search_api_attachments
[Fri Oct 27 22:13:31.912796 2023] [php:error] [pid 5887] [client 172.31.29.184:64594] PHP Fatal error: Maximum execution time of 240 seconds exceeded in /var/www/html/websites/drupal9/demo9/web/modules/contrib/search_api/src/Plugin/search_api/processor/HtmlFilter.php on line 257, referer: https://demo9.mysite.com/admin/reports/dblog
[Fri Oct 27 22:17:10.749856 2023] [php:error] [pid 5958] [client 172.31.29.184:27208] PHP Fatal error: Maximum execution time of 600 seconds exceeded in /var/www/html/websites/drupal9/demo9/web/modules/contrib/search_api/src/Plugin/search_api/processor/HtmlFilter.php on line 247, referer: https://demo9.mysite.com/admin/config/search/search-api/index/default_solr_index
[Fri Oct 27 22:17:45.783720 2023] [php:error] [pid 6023] [client 172.31.29.184:62384] PHP Fatal error: Maximum execution time of 240 seconds exceeded in /var/www/html/websites/drupal9/demo9/web/modules/contrib/search_api/src/Plugin/search_api/processor/HtmlFilter.php on line 257, referer: https://demo9.mysite.com/admin/reports/dblog
[Fri Oct 27 22:20:04.735114 2023] [php:error] [pid 5980] [client 172.31.29.184:31570] PHP Fatal error: Maximum execution time of 600 seconds exceeded in /var/www/html/websites/drupal9/demo9/web/modules/contrib/search_api/src/Plugin/search_api/processor/HtmlFilter.php on line 257, referer: https://demo9.mysite.com/batch?id=293&op=start
[Fri Oct 27 22:17:10.749856 2023] [php:error] [pid 5958] [client 172.31.29.184:27208] PHP Fatal error: Maximum execution time of 600 seconds exceeded in /var/www/html/websites/drupal9/demo9/web/modules/contrib/search_api/src/Plugin/search_api/processor/HtmlFilter.php on line 247, referer: https://demo9.mysite.com/admin/config/search/search-api/index/default_solr_index
[Fri Oct 27 22:17:45.783720 2023] [php:error] [pid 6023] [client 172.31.29.184:62384] PHP Fatal error: Maximum execution time of 240 seconds exceeded in /var/www/html/websites/drupal9/demo9/web/modules/contrib/search_api/src/Plugin/search_api/processor/HtmlFilter.php on line 257, referer: https://demo9.mysite.com/admin/reports/dblog
[Fri Oct 27 22:20:04.735114 2023] [php:error] [pid 5980] [client 172.31.29.184:31570] PHP Fatal error: Maximum execution time of 600 seconds exceeded in /var/www/html/websites/drupal9/demo9/web/modules/contrib/search_api/src/Plugin/search_api/processor/HtmlFilter.php on line 257, referer: https://demo9.mysite.com/batch?id=293&op=start