Repository navigation
[docs] Add Lance hybrid search best practices and correct type mappings - #4182
Merged
Gabriel39 merged 1 commit intoSep 30, 2026
Merged
Conversation
Gabriel39
temporarily deployed
to
Production
September 30, 2026 03:29 — with
GitHub Actions
Inactive
This was referenced Sep 30, 2026
This branch was previously deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Filtered Lance retrieval can repeat scalar-index work when scalar segments cross search-split boundaries. Add an English/Chinese guide explaining filter placement, physical-segment split planning, fragment-coverage alignment, construction and maintenance workflows, shared-cache pressure, and profile diagnosis.
The guide distinguishes fragment-scoped V2 scalar pruning from legacy reader paths, treats segment sizing as a workload experiment, and explains why logical indexes do not automatically align different columns. It includes filtered vector/FTS SQL and a clearly labeled SDK orchestration pattern with separate per-index commits.
Also correct the Catalog type mapping to document Arrow/Lance JSON as Doris JSON, together with the already-supported Duration, nullable Null, and BFloat16 mappings. Preserve storage-type checks, unsupported-extension restrictions, and the distinction between JSON extensions and ordinary strings containing JSON text. Remove JSON from the unsupported-column exclusion example. Type behavior was checked against the current branch-4.1 converter and reader, including apache/doris#67325.
Validation:
currentcounterparts. These pages intentionally follow the existing 4.x-only Lance Catalog placement and retain its documented experimental/4.2 availability boundary.Self-review: