mirror of
https://github.com/BerriAI/litellm.git
synced 2026-11-16 09:22:22 +00:00
* feat(opensearch): map vector store search filters to k-NN filters and add hybrid search * test(code-quality): allow the bounded OpenSearch filter recursion * fix(opensearch): retry an unfilterable engine without filters under drop_params, match strings on keyword subfields, keep per-request field keys Under drop_params, a 400 'does not support filters' from an nmslib or older engine re-runs the search once without filters, as filtered searches behaved before. String eq, ne, in and nin match the key's .keyword subfield, falling back to the key where no subfield is mapped. Only the index name, search pipeline and hybrid flag are registration-only, so opensearch_text_field and opensearch_embedding_field pass through per request again * fix(opensearch): match string filters on the exact keyword field and embed once on the filter retry String filters now read the index mapping and compare the exact keyword field, refusing a key the index cannot match exactly. The drop_params retry reuses the first embedding and also covers OpenSearch before 2.4. An index that refuses filters without drop_params answers litellm's own 400, and a filters value that is not an object stays a 400 under drop_params. The Admin UI store form gains the search pipeline and hybrid search fields * test(ui): expect the OpenSearch search pipeline and hybrid search fields in the provider field list * fix(opensearch): drop string filters under drop_params when the mapping read fails, and skip normalized keyword fields * fix(opensearch): name the permissions a refused index mapping read needs instead of returning OpenSearch's body * fix(opensearch): check the index mapping for every filter, resolve aliases, and keep failed mapping reads from dropping filters * fix(opensearch): keep an alias filter's own name and refuse rewrites that reach an index without the alias * fix(vector_stores): sign the caller's headers as given and reject filters on keys only some OpenSearch indexes map A null or non-str extra_headers value no longer fails Bedrock Knowledge Base, S3 Vectors, or other provider searches before signing. The mapping read gets only the string-valued headers. A filter on a key that some of a store's indexes map and others do not answers 400 (drops under drop_params), since OpenSearch returns its k-NN hits on some calls and none on others. * fix(opensearch): send the caller's headers on the index mapping read as given and name the fix for keys only some indexes map A header httpx cannot send now fails the filtered search on the mapping read, the same way it fails the search, before the query is embedded. Bytes headers now reach the mapping read too. * test(opensearch): pin that a timeout on the index mapping read answers 408 without embedding the query * fix(opensearch): answer 400 for a filter key inside a nested field or naming an object A root-level term query on a field under a nested mapping, or on an object field, matches nothing, so the search answered 200 with no hits. These keys now answer 400 naming the mapping, or drop the filters under drop_params * fix(opensearch): filter on a nested field whose values OpenSearch copies to the root A nested field mapped with include_in_root, or include_in_parent on it and every nested field above it, has its values in the root document, so a root term query matches it. Those filters now search instead of answering 400. A key that names an object or nested field answers that it holds fields rather than values before the nested check, so its remedy no longer leads into a second 400 --------- Co-authored-by: mateo-berri <277851410+mateo-berri@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| azure_client_usage_test.py | ||
| ban_constant_numbers.py | ||
| ban_copy_deepcopy_kwargs.py | ||
| bedrock_pricing.py | ||
| callback_manager_test.py | ||
| check_data_replace_usage.py | ||
| check_e2e_no_raw_requests.py | ||
| check_endpoint_coverage.py | ||
| check_fastuuid_usage.py | ||
| check_get_model_cost_key_performance.py | ||
| check_guardrail_apply_decorator.py | ||
| check_licenses.py | ||
| check_migrations_lock_timeout.py | ||
| check_migrations_no_data_rewrites.py | ||
| check_no_none_string_error_fields.py | ||
| check_no_publicly_known_master_key.py | ||
| check_prisma_binary_cache.py | ||
| check_provider_folders_documented.py | ||
| check_py310_typing_imports.py | ||
| check_spanattributes_value_usage.py | ||
| check_telemetry_imports.py | ||
| check_unbounded_in_lists.py | ||
| check_unsafe_enterprise_import.py | ||
| check_workflow_job_name_collisions.py | ||
| check_workflow_startup_safety.py | ||
| code_qa_check_tests.py | ||
| dependency_license_cache.json | ||
| enforce_llms_folder_style.py | ||
| ensure_async_clients_test.py | ||
| info_log_check.py | ||
| liccheck.ini | ||
| license_cache.json | ||
| litellm_logging_code_coverage.py | ||
| log.txt | ||
| memory_test.py | ||
| prevent_key_leaks_in_exceptions.py | ||
| recursive_detector.py | ||
| router_code_coverage.py | ||
| router_enforce_line_length.py | ||
| router_litellm_globals_check.py | ||
| router_surface_allowlist.json | ||
| router_surface_check.py | ||
| test_aio_http_image_conversion.py | ||
| test_ban_set_verbose.py | ||
| test_chat_completion_imports.py | ||
| test_check_no_none_string_error_fields.py | ||
| test_check_no_publicly_known_master_key.py | ||
| test_e2e_idp_stack.py | ||
| test_e2e_junit_report.py | ||
| test_e2e_metadata.py | ||
| test_generate_provider_endpoints_support.py | ||
| test_merge_smoke.py | ||
| test_no_hardcoded_secrets.py | ||
| test_provider_cache.py | ||
| test_provider_replay_harness.py | ||
| test_proxy_types_import.py | ||
| test_router_strategy_async.py | ||
| test_unit_passed_gate.py | ||
| test_workflow_job_name_collisions.py | ||
| unbounded_in_baseline.txt | ||