Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
lance-format
lance
Repository navigation
Code
Issues
854
(854)
Pull requests
490
(490)
Discussions
Actions
Wiki
Security and quality
Insights
More
items
perf: use hnsw for memtable vector index
- #6701
#6701
Merged
jackye1995
merged 27 commits into
lance-format:main
lance-format/lance:main
from
touch-of-grey:mem-wal-hnsw
touch-of-grey/lance:mem-wal-hnsw
Copy head branch name to clipboard
May 7, 2026
Conversation
Commits
27
(27)
Checks
Files changed
Merged
perf: use hnsw for memtable vector index
#6701
jackye1995
merged 27 commits into
lance-format:main
lance-format/lance:main
from
touch-of-grey:mem-wal-hnsw
touch-of-grey/lance:mem-wal-hnsw
Copy head branch name to clipboard
Commits
Commits on May 5, 2026
feat(mem-wal): replace in-memory IVF-PQ with online HNSW
Show description for 15af5ff
touch-of-grey
committed
15af5ff
View commit details
Copy full SHA for 15af5ff
Browse repository at this point
bench: add focused mem_wal_vector LSM bench
Show description for 29d5690
touch-of-grey
committed
29d5690
View commit details
Copy full SHA for 29d5690
Browse repository at this point
bench: use Float32Array for indexed base-table query
Show description for 4a33a56
touch-of-grey
committed
4a33a56
View commit details
Copy full SHA for 4a33a56
Browse repository at this point
fix(mem-wal): coerce single-row FSL query to Float32 in LsmVectorSearchPlanner
Show description for abd0a58
touch-of-grey
committed
abd0a58
View commit details
Copy full SHA for abd0a58
Browse repository at this point
fix(mem-wal): make flushed HNSW index actually loadable and queryable
Show description for f067e4b
touch-of-grey
committed
f067e4b
View commit details
Copy full SHA for f067e4b
Browse repository at this point
fix(mem-wal): close concurrency races in HnswMemIndex storage and search
Show description for 86ec8bc
touch-of-grey
committed
86ec8bc
View commit details
Copy full SHA for 86ec8bc
Browse repository at this point
Commits on May 6, 2026
bench: add MemTable index microbench (write/query/flush)
Show description for 8d6c8b6
touch-of-grey
committed
8d6c8b6
View commit details
Copy full SHA for 8d6c8b6
Browse repository at this point
bench: route mem_wal_index_micro write phase through ShardWriter
Show description for 3180988
touch-of-grey
committed
3180988
View commit details
Copy full SHA for 3180988
Browse repository at this point
bench: bump recursion_limit on mem_wal_index_micro for Linux rustc
Show description for eaa47da
touch-of-grey
committed
eaa47da
View commit details
Copy full SHA for eaa47da
Browse repository at this point
bench: measure wall time including WAL/index catchup, not just put()
Show description for 136918f
touch-of-grey
committed
136918f
View commit details
Copy full SHA for 136918f
Browse repository at this point
bench: tighten max_wal_flush_interval so the last batch isn't stranded
Show description for e4c0515
touch-of-grey
committed
e4c0515
View commit details
Copy full SHA for e4c0515
Browse repository at this point
bench: heartbeat dummy puts to drain final batch through WAL pipeline
Show description for dce05b2
touch-of-grey
committed
dce05b2
View commit details
Copy full SHA for dce05b2
Browse repository at this point
perf: zero-copy in-memory HNSW storage and SQ8 on-disk flush
Show description for ff7b7ac
touch-of-grey
committed
ff7b7ac
View commit details
Copy full SHA for ff7b7ac
Browse repository at this point
chore(bench): report RSS at checkpoints and on-disk bytes after flush
Show description for c7c72d7
touch-of-grey
committed
c7c72d7
View commit details
Copy full SHA for c7c72d7
Browse repository at this point
chore(bench): add DATASET_PREFIX and BENCH_DURABLE_WRITE env support to mem_wal_index_micro
Show description for 2dfcc82
touch-of-grey
committed
2dfcc82
View commit details
Copy full SHA for 2dfcc82
Browse repository at this point
fix: address CI clippy/rustdoc/lockfile failures
Show description for 0606cc6
touch-of-grey
committed
0606cc6
View commit details
Copy full SHA for 0606cc6
Browse repository at this point
fix: drop dead ivf_index_partition_capacity_safety_factor binding
Show description for c9acf17
touch-of-grey
committed
c9acf17
View commit details
Copy full SHA for c9acf17
Browse repository at this point
chore: remove stale IVF-PQ memtable references in docs and comments
Show description for a0f67fe
touch-of-grey
committed
a0f67fe
View commit details
Copy full SHA for a0f67fe
Browse repository at this point
chore(mem-wal): clean up flush.rs SQ metadata path
Show description for d6bf788
touch-of-grey
committed
d6bf788
View commit details
Copy full SHA for d6bf788
Browse repository at this point
fix: address review-round-1 P1 findings on mem_wal hnsw
Show description for 383217e
touch-of-grey
committed
383217e
View commit details
Copy full SHA for 383217e
Browse repository at this point
chore(bench): add mem_wal_recall_hnsw recall benchmark
Show description for b4f32bf
touch-of-grey
committed
b4f32bf
View commit details
Copy full SHA for b4f32bf
Browse repository at this point
chore(bench): coerce parquet openai column to FixedSizeList<Float32, 1536>
Show description for 4b23777
touch-of-grey
committed
4b23777
View commit details
Copy full SHA for 4b23777
Browse repository at this point
chore(bench): mem_wal_recall_hnsw runs checkpoints [100k, 500k, 1M]
Show description for 3e13523
touch-of-grey
committed
3e13523
View commit details
Copy full SHA for 3e13523
Browse repository at this point
chore(bench): retry transient HF shard downloads with exponential backoff
Show description for ff78329
touch-of-grey
committed
ff78329
View commit details
Copy full SHA for ff78329
Browse repository at this point
chore(bench): clamp checkpoints to dataset rows minus query reserve
Show description for da00a50
touch-of-grey
committed
da00a50
View commit details
Copy full SHA for da00a50
Browse repository at this point
chore(bench): use non-zero base-table vectors for IVF/PQ training
Show description for 2a46679
touch-of-grey
committed
2a46679
View commit details
Copy full SHA for 2a46679
Browse repository at this point
chore(bench): print per-checkpoint recall + per-25-query progress, flush stdout
Show description for 981420c
touch-of-grey
committed
981420c
View commit details
Copy full SHA for 981420c
Browse repository at this point
You can’t perform that action at this time.
