You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
[Feature](lance) Support additional Lance and Arrow data types #66496
Tracked by #66340. Core Arrow and Lance scalar, nested, and vector types were introduced by #65730.
Scope
Lance Blob v2.
Arrow JSON Extension.
Lance BFloat16 Extension.
Arrow null.
Arrow duration.
Preserve extension metadata and define Doris type mappings and unsupported-column behavior.
Completion criteria
FE schema conversion and BE Arrow deserialization are implemented safely.
Unit and regression tests cover schema discovery, projection, nullability, and malformed input.
User documentation describes mappings, precision, and limitations.
Representative datasets for every listed type are verified.
Partial completion — 2026-09-30
#67325 merged FE/BE mappings and tests for Arrow/Lance JSON, BFloat16, Null, and Duration into branch-4.1; #67921 added nested nullable Arrow Null support and regression coverage. Both PRs have successful recorded External Regression statuses. English and Chinese mapping/precision/limitation documentation is synchronized by merged apache/doris-website#4182.
These four type items are complete. JSON requires compatible extension storage, BFloat16 widens to FLOAT, Duration preserves the signed count in its declared unit, and unsupported extensions/storage combinations remain rejected. The current catalog documentation still explicitly lists Lance Blob v2 as unsupported.
Keep this issue open for Blob v2. The general extension-metadata and all-types completion criteria remain unchecked because they include that outstanding type. Completion on branch-4.1 satisfies the parent tracker's branch criterion; this audit does not claim a fresh test run.
Activity
wangzhaobo957-cloud commentedon Aug 24, 2026
I'd like to work on this issue. Please assign it to me.
[fix](lance) Complete additional type support apache#66496
[fix](lance) Complete Doris-side additional type handling apache#66496
[feature](lance) Support additional Lance and Arrow data types
[fix](lance) Complete Doris-side additional type handling apache#66496
[fix](lance) Map Blob v2 to a descriptor struct instead of VARBINARY a…
[fix](lance) Address Blob schema and nested normalization review apac…
[fix](lance) Remove Blob v2 support from additional types apache#66496
[style](lance) Apply clang-format apache#66496
[test](lance) Cover additional type edge cases apache#66496
[fix](lance) Normalize sliced nested values apache#66496
28 remaining items
[test](lance) Fix exact backend selection test apache#66496
[feature](lance) Support additional Lance and Arrow data types
[fix](lance) Complete Doris-side additional type handling apache#66496
[fix](lance) Remove Blob v2 support from additional types apache#66496
[style](lance) Apply clang-format apache#66496
[test](lance) Cover additional type edge cases apache#66496
[fix](lance) Normalize sliced nested values apache#66496
[fix](lance) Handle sliced values and mixed-BE execution apache#66496
[fix](lance) Handle registered extensions and upgrade routing apache#…
[fix](lance) Complete additional type upgrade compatibility apache#66496
[test](lance) Fix exact backend selection test apache#66496
[fix](lance) Track Arrow normalization memory apache#66496
[Feature](lance) Support additional Arrow and Lance data types (#67325)
[Feature](lance) Support nested Arrow Null types (#67921)
[Feature](lance) Support nested Arrow Null types (#67921)