Fix compatibility with OpenSearch 3

Created on 23 May 2025, 6 months ago

Problem/Motivation

It isn't possible to save a Search API using Opensearch as the AI backend, it gives this error:

An error occurred: "OpenSearch error: mapper_parsing_exception - Failed to parse mapping [_doc]: nmslib engine is deprecated in OpenSearch and cannot be used for new index creation in OpenSearch from 3.0.0. - Request: PUT http://opensearch:9200/mysite_ai - Body: {"settings":{"index":{"number_of_shards":1,"number_of_replicas":1,"knn":true,"max_result_window":20000}},"mappings":{"properties":{"vector":{"type":"knn_vector","dimension":2,"method":{"name":"hnsw","space_type":"innerproduct","engine":"nmslib","parameters":{"ef_construction":128,"m":16}}}}}}"

Steps to reproduce

Set up OpenSearch 3 on the server.
Go through the process to set up a index.
When saving an AI search_api index with OpenSearch, it will fail.

Proposed resolution

Make the module compatible with Opensearch 3.

Remaining tasks

Fix the API issues.

User interface changes

TBD

API changes

TBD

Data model changes

TBD

πŸ› Bug report
Status

Active

Version

1.0

Component

Code

Created by

πŸ‡ΊπŸ‡ΈUnited States damienmckenna NH, USA

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Merge Requests

Comments & Activities

  • Issue created by @damienmckenna
  • πŸ‡ΊπŸ‡ΈUnited States damienmckenna NH, USA

    It might be best to have a selector to choose the engine that is used, e.g. "faiss" or "lucene".

    FWIW manually changing it to "faiss" lets it save without errors.

  • Pipeline finished with Failed
    about 1 month ago
    Total: 242s
    #621091
  • Pipeline finished with Failed
    30 days ago
    Total: 212s
    #621170
  • Pipeline finished with Failed
    29 days ago
    #622327
  • Pipeline finished with Success
    29 days ago
    Total: 202s
    #622353
  • Status changed to Needs review 23 days ago
Production build 0.71.5 2024