Request Entity Too Large

Created on 15 January 2019, almost 6 years ago
Updated 20 November 2024, about 1 month ago

We are having issues where the index is failing due to the file size being too large: Status: Request Entity Too Large

We have configured the module to index with File attachments Entityreference

With the following options

Excluded file extensions: aif art avi bmp gif ico mov oga ogv png psd ra ram rgb flv mtl obj mp3 mp4 jpg
Maximum file size: 512
Number of file indexed per file field: 0
Exclude file entity bundles: audio,image,video

we've had the index failing due to the following errors

Jan 15 08:59:37 srv-6889 fooge33cuh67z: https://www.mywebsite.com|1547542777|search_api_attachments|162.222.155.111|https://www.mywebsite.com/batch?id=33231&op=do|https://www.mywebsite.com/batch?op=start&id=33231|1||SearchApiException: "413" Status: Request Entity Too Large: Request Entity Too Large<html>  <head><title>413 Request Entity Too Large</title></head>  <body bgcolor="white">  <center><h1>413 Request Entity Too Large</h1></center>  <hr><center>nginx</center>  </body>  </html>   in SearchApiSolrConnection->checkResponse() (line 546 of /mnt/www/html/fooge33cuh67z/docroot/sites/all/modules/contrib/search_api_solr/includes/solr_connection.inc). request_id="v-e149e2d2-18a3-11e9-a219-0ad867b0f764"
Jan 15 08:59:37 srv-6889 fooge33cuh67z: https://www.mywebsite.com|1547542777|php|162.222.155.111|https://www.mywebsite.com/batch?id=33231&op=do|https://www.mywebsite.com/batch?op=start&id=33231|1||Warning: in_array() expects parameter 2 to be array, null given in SearchApiAttachmentsEntityreferenceAlterSettings->getFilesContent() (line 141 of /mnt/www/html/fooge33cuh67z/docroot/sites/all/modules/contrib/search_api_attachments/contrib/search_api_attachments_entityreference/includes/callback_attachments_entityreference_settings.inc). request_id="v-e149e2d2-18a3-11e9-a219-0ad867b0f764"
Jan 15 08:59:41 srv-6889 fooge33cuh67z: https://www.mywebsite.com|1547542781|php|162.222.155.111|https://www.mywebsite.com/batch?id=33231&op=do|https://www.mywebsite.com/batch?op=start&id=33231|1||Warning: in_array() expects parameter 2 to be array, null given in SearchApiAttachmentsEntityreferenceAlterSettings->getFilesContent() (line 141 of /mnt/www/html/fooge33cuh67z/docroot/sites/all/modules/contrib/search_api_attachments/contrib/search_api_attachments_entityreference/includes/callback_attachments_entityreference_settings.inc). request_id="v-e149e2d2-18a3-11e9-a219-0ad867b0f764"
Jan 15 08:59:44 srv-6889 fooge33cuh67z: https://www.mywebsite.com|1547542784|php|162.222.155.111|https://www.mywebsite.com/batch?id=33231&op=do|https://www.mywebsite.com/batch?op=start&id=33231|1||Warning: in_array() expects parameter 2 to be array, null given in SearchApiAttachmentsEntityreferenceAlterSettings->getFilesContent() (line 141 of /mnt/www/html/fooge33cuh67z/docroot/sites/all/modules/contrib/search_api_attachments/contrib/search_api_attachments_entityreference/includes/callback_attachments_entityreference_settings.inc). request_id="v-e149e2d2-18a3-11e9-a219-0ad867b0f764"
Jan 15 08:59:45 srv-6889 fooge33cuh67z: https://www.mywebsite.com|1547542785|php|162.222.155.111|https://www.mywebsite.com/batch?id=33231&op=do|https://www.mywebsite.com/batch?op=start&id=33231|1||Warning: fwrite(): SSL: Broken pipe in drupal_http_request() (line 962 of /mnt/www/html/fooge33cuh67z/docroot/includes/common.inc). request_id="v-e149e2d2-18a3-11e9-a219-0ad867b0f764"
Jan 15 08:59:45 srv-6889 fooge33cuh67z: https://www.mywebsite.com|1547542785|search_api_attachments|162.222.155.111|https://www.mywebsite.com/batch?id=33231&op=do|https://www.mywebsite.com/batch?op=start&id=33231|1||Exception occurred sending public://1957.pdf to Solr. request_id="v-e149e2d2-18a3-11e9-a219-0ad867b0f764"
Jan 15 08:59:45 srv-6889 fooge33cuh67z: https://www.mywebsite.com|1547542785|search_api_attachments|162.222.155.111|https://www.mywebsite.com/batch?id=33231&op=do|https://www.mywebsite.com/batch?op=start&id=33231|1||SearchApiException: "413" Status: Request Entity Too Large: Request Entity Too Large<html>  <head><title>413 Request Entity Too Large</title></head>  <body bgcolor="white">  <center><h1>413 Request Entity Too Large</h1></center>  <hr><center>nginx</center>  </body>  </html>   in SearchApiSolrConnection->checkResponse() (line 546 of /mnt/www/html/fooge33cuh67z/docroot/sites/all/modules/contrib/search_api_solr/includes/solr_connection.inc). request_id="v-e149e2d2-18a3-11e9-a219-0ad867b0f764"
Jan 15 08:59:45 srv-6889 fooge33cuh67z: https://www.mywebsite.com|1547542785|php|162.222.155.111|https://www.mywebsite.com/batch?id=33231&op=do|https://www.mywebsite.com/batch?op=start&id=33231|1||Warning: in_array() expects parameter 2 to be array, null given in SearchApiAttachmentsEntityreferenceAlterSettings->getFilesContent() (line 141 of /mnt/www/html/fooge33cuh67z/docroot/sites/all/modules/contrib/search_api_attachments/contrib/search_api_attachments_entityreference/includes/callback_attachments_entityreference_settings.inc). request_id="v-e149e2d2-18a3-11e9-a219-0ad867b0f764"

And we've seen the memory usage spike also:

- -  15/Jan/2019:08:59:49 +0000 "POST /index.php" 200 memory_kb=2048 %cpu=67.86 duration_ms=29.472 request_id="v-e9fa62a8-18a3-11e9-a265-0ad867b0f764"
- -  15/Jan/2019:08:59:50 +0000 "POST /index.php" 200 memory_kb=6144 %cpu=84.74 duration_ms=35.401 request_id="v-ea891f84-18a3-11e9-9a7d-0ad867b0f764"
- -  15/Jan/2019:08:59:34 +0000 "POST /index.php" 500 memory_kb=205296 %cpu=6.92 duration_ms=18944.153 request_id="v-e149e2d2-18a3-11e9-a219-0ad867b0f764"
- -  15/Jan/2019:09:00:10 +0000 "POST /index.php" 302 memory_kb=6144 %cpu=18.54 duration_ms=1024.642 request_id="v-f6ab9076-18a3-11e9-add7-0ad867b0f764"
- -  15/Jan/2019:09:00:09 +0000 "POST /index.php" 200 memory_kb=2048 %cpu=24.57 duration_ms=2686.694 request_id="v-f5cce6b4-18a3-11e9-a102-0ad867b0f764"
- -  15/Jan/2019:09:00:19 +0000 "POST /index.php" 302 memory_kb=2048 %cpu=58.21 duration_ms=429.482 request_id="v-fbb36166-18a3-11e9-b04d-0ad867b0f764"

I've tried setting the Maximum file size field to a number of different values, 0, 512, 10 MB none of them seem to make any difference, the index keeps on breaking. The file that it's failing on is 40.43 MB in size, although many are larger. It's fine if some of the files are too large to index but we're unable to set the file size limit.

We are on the latest version of Drupal and search_api module on Acquia.

🐛 Bug report
Status

Closed: cannot reproduce

Version

1.18

Component

Code

Created by

🇬🇧United Kingdom mijpcw

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

Not all content is available!

It's likely this issue predates Contrib.social: some issue and comment data are missing.

Production build 0.71.5 2024