We are having issues where the index is failing due to the file size being too large: Status: Request Entity Too Large
We have configured the module to index with File attachments Entityreference
With the following options
Excluded file extensions: aif art avi bmp gif ico mov oga ogv png psd ra ram rgb flv mtl obj mp3 mp4 jpg
Maximum file size: 512
Number of file indexed per file field: 0
Exclude file entity bundles: audio,image,video
we've had the index failing due to the following errors
Jan 15 08:59:37 srv-6889 fooge33cuh67z: https://www.mywebsite.com|1547542777|search_api_attachments|162.222.155.111|https://www.mywebsite.com/batch?id=33231&op=do|https://www.mywebsite.com/batch?op=start&id=33231|1||SearchApiException: "413" Status: Request Entity Too Large: Request Entity Too Large<html> <head><title>413 Request Entity Too Large</title></head> <body bgcolor="white"> <center><h1>413 Request Entity Too Large</h1></center> <hr><center>nginx</center> </body> </html> in SearchApiSolrConnection->checkResponse() (line 546 of /mnt/www/html/fooge33cuh67z/docroot/sites/all/modules/contrib/search_api_solr/includes/solr_connection.inc). request_id="v-e149e2d2-18a3-11e9-a219-0ad867b0f764"
Jan 15 08:59:37 srv-6889 fooge33cuh67z: https://www.mywebsite.com|1547542777|php|162.222.155.111|https://www.mywebsite.com/batch?id=33231&op=do|https://www.mywebsite.com/batch?op=start&id=33231|1||Warning: in_array() expects parameter 2 to be array, null given in SearchApiAttachmentsEntityreferenceAlterSettings->getFilesContent() (line 141 of /mnt/www/html/fooge33cuh67z/docroot/sites/all/modules/contrib/search_api_attachments/contrib/search_api_attachments_entityreference/includes/callback_attachments_entityreference_settings.inc). request_id="v-e149e2d2-18a3-11e9-a219-0ad867b0f764"
Jan 15 08:59:41 srv-6889 fooge33cuh67z: https://www.mywebsite.com|1547542781|php|162.222.155.111|https://www.mywebsite.com/batch?id=33231&op=do|https://www.mywebsite.com/batch?op=start&id=33231|1||Warning: in_array() expects parameter 2 to be array, null given in SearchApiAttachmentsEntityreferenceAlterSettings->getFilesContent() (line 141 of /mnt/www/html/fooge33cuh67z/docroot/sites/all/modules/contrib/search_api_attachments/contrib/search_api_attachments_entityreference/includes/callback_attachments_entityreference_settings.inc). request_id="v-e149e2d2-18a3-11e9-a219-0ad867b0f764"
Jan 15 08:59:44 srv-6889 fooge33cuh67z: https://www.mywebsite.com|1547542784|php|162.222.155.111|https://www.mywebsite.com/batch?id=33231&op=do|https://www.mywebsite.com/batch?op=start&id=33231|1||Warning: in_array() expects parameter 2 to be array, null given in SearchApiAttachmentsEntityreferenceAlterSettings->getFilesContent() (line 141 of /mnt/www/html/fooge33cuh67z/docroot/sites/all/modules/contrib/search_api_attachments/contrib/search_api_attachments_entityreference/includes/callback_attachments_entityreference_settings.inc). request_id="v-e149e2d2-18a3-11e9-a219-0ad867b0f764"
Jan 15 08:59:45 srv-6889 fooge33cuh67z: https://www.mywebsite.com|1547542785|php|162.222.155.111|https://www.mywebsite.com/batch?id=33231&op=do|https://www.mywebsite.com/batch?op=start&id=33231|1||Warning: fwrite(): SSL: Broken pipe in drupal_http_request() (line 962 of /mnt/www/html/fooge33cuh67z/docroot/includes/common.inc). request_id="v-e149e2d2-18a3-11e9-a219-0ad867b0f764"
Jan 15 08:59:45 srv-6889 fooge33cuh67z: https://www.mywebsite.com|1547542785|search_api_attachments|162.222.155.111|https://www.mywebsite.com/batch?id=33231&op=do|https://www.mywebsite.com/batch?op=start&id=33231|1||Exception occurred sending public://1957.pdf to Solr. request_id="v-e149e2d2-18a3-11e9-a219-0ad867b0f764"
Jan 15 08:59:45 srv-6889 fooge33cuh67z: https://www.mywebsite.com|1547542785|search_api_attachments|162.222.155.111|https://www.mywebsite.com/batch?id=33231&op=do|https://www.mywebsite.com/batch?op=start&id=33231|1||SearchApiException: "413" Status: Request Entity Too Large: Request Entity Too Large<html> <head><title>413 Request Entity Too Large</title></head> <body bgcolor="white"> <center><h1>413 Request Entity Too Large</h1></center> <hr><center>nginx</center> </body> </html> in SearchApiSolrConnection->checkResponse() (line 546 of /mnt/www/html/fooge33cuh67z/docroot/sites/all/modules/contrib/search_api_solr/includes/solr_connection.inc). request_id="v-e149e2d2-18a3-11e9-a219-0ad867b0f764"
Jan 15 08:59:45 srv-6889 fooge33cuh67z: https://www.mywebsite.com|1547542785|php|162.222.155.111|https://www.mywebsite.com/batch?id=33231&op=do|https://www.mywebsite.com/batch?op=start&id=33231|1||Warning: in_array() expects parameter 2 to be array, null given in SearchApiAttachmentsEntityreferenceAlterSettings->getFilesContent() (line 141 of /mnt/www/html/fooge33cuh67z/docroot/sites/all/modules/contrib/search_api_attachments/contrib/search_api_attachments_entityreference/includes/callback_attachments_entityreference_settings.inc). request_id="v-e149e2d2-18a3-11e9-a219-0ad867b0f764"
And we've seen the memory usage spike also:
- - 15/Jan/2019:08:59:49 +0000 "POST /index.php" 200 memory_kb=2048 %cpu=67.86 duration_ms=29.472 request_id="v-e9fa62a8-18a3-11e9-a265-0ad867b0f764"
- - 15/Jan/2019:08:59:50 +0000 "POST /index.php" 200 memory_kb=6144 %cpu=84.74 duration_ms=35.401 request_id="v-ea891f84-18a3-11e9-9a7d-0ad867b0f764"
- - 15/Jan/2019:08:59:34 +0000 "POST /index.php" 500 memory_kb=205296 %cpu=6.92 duration_ms=18944.153 request_id="v-e149e2d2-18a3-11e9-a219-0ad867b0f764"
- - 15/Jan/2019:09:00:10 +0000 "POST /index.php" 302 memory_kb=6144 %cpu=18.54 duration_ms=1024.642 request_id="v-f6ab9076-18a3-11e9-add7-0ad867b0f764"
- - 15/Jan/2019:09:00:09 +0000 "POST /index.php" 200 memory_kb=2048 %cpu=24.57 duration_ms=2686.694 request_id="v-f5cce6b4-18a3-11e9-a102-0ad867b0f764"
- - 15/Jan/2019:09:00:19 +0000 "POST /index.php" 302 memory_kb=2048 %cpu=58.21 duration_ms=429.482 request_id="v-fbb36166-18a3-11e9-b04d-0ad867b0f764"
I've tried setting the Maximum file size field to a number of different values, 0, 512, 10 MB none of them seem to make any difference, the index keeps on breaking. The file that it's failing on is 40.43 MB in size, although many are larger. It's fine if some of the files are too large to index but we're unable to set the file size limit.
We are on the latest version of Drupal and search_api module on Acquia.
Closed: cannot reproduce
1.18
Code
Not all content is available!
It's likely this issue predates Contrib.social: some issue and comment data are missing.