Skip to content

Auto-chunking in embeddings lib #190

Description

@donhardman

Proposal:

Research how other databases do auto-chunking, then design + implement it in our embeddings lib. Goal: insert one doc → we chunk it under the hood → return N embeddings + offsets, so it's searchable as a single doc. This is the lib side only — storing/searching the N vectors per row is the daemon's part (separate task).

Checklist:

To be completed by the assignee. Check off tasks that have been completed or are not applicable.

Details
  • Implementation completed
  • Tests developed
  • Documentation updated
  • Documentation reviewed
  • OpenAPI YAML updated and issue created to rebuild clients

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions