SPFresh-style incremental hot index rebalance #80

Activity

1. codeforstartups

   added

   enhancementNew feature or requestNew feature or request

   help wantedGood for contributorsGood for contributors

   difficulty: advancedDeep / large scopeDeep / large scope

   area: hot-tierArea: hot-tierArea: hot-tier

   on Sep 6, 2026
2. Kaap10 commented on Sep 8, 2026

   

   Kaap10

   on Sep 8, 2026

   Collaborator

   More actions

   Hi @codeforstartups,

   I would love to take this up!

   Plan:

   1. Design Note: Document the SPFresh-style incremental rebalancing model for dynavec's in-memory hot tier, covering dynamic split/merge criteria, centroid drift tracking, and thread safety.
   2. Prototype & Tests: Implement a pure Python/NumPy prototype (SPFreshRebalancer / dynamic partition index) with unit tests for incremental insertions, deletes, and rebalancing.

   Could you please assign this issue to me? Thanks!
3. codeforstartups

   assigned

   Kaap10

   on Sep 8, 2026
4. codeforstartups commented on Sep 8, 2026

   

   codeforstartups

   on Sep 8, 2026

   OwnerAuthor

   More actions

   Sure as you are very early contributor to this project - I would give this to you. Please make sure to research about SPNN / SPFresh / HNSW and other algorithms that helps in search of embeddings.

   👍React with 👍1Reacted by Vardhman Gupta
5. codeforstartups

   added a commit that references this issue on Sep 8, 2026

   feat(hot-tier): SPFresh incremental hot index rebalancing (#80) (#170)

   00a64f0
6. codeforstartups

   closed this as completedin #170on Sep 8, 2026