Skip to content

Tiered index converts to padded on every search call #2434

Description

@aamijar

Every tiered index search() call does an internal conversion to padded dataset first.

One solution is to make the owning storage of tiered index padded. New vectors as part of the initial build or extend can still accept standard datasets but can internally be copied into the padded storage.

During search, tiered index currently calls "attach_dataset" (not directly but through a helper called convert_standard_to_padded_index). We are planning to remove these helpers and the "attach_dataset" shortly in favor of update_dataset.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions