VDBBench 1.0.21 release

VDBBench 1.0.21 adds Lindorm, PolarDB, Apache Pinot, VectorChord, and Intel SVS support; migrates Milvus benchmarks to MilvusClient; adds concurrent insert support; upgrades to Pydantic v2; improves Streamlit error
surfacing; and refreshes benchmark results for Milvus, ElasticCloud, ZillizCloud, and turbopuffer.

What's Changed

New database and index support

• Added Lindorm benchmark support (#718)
• Added PolarDB benchmark support (#737)
• Added Apache Pinot vector search client (#757)
• Added VectorChord benchmark support (#745)
• Added Intel SVS support (#749)
• Added SQ4U scalar quantization type for Milvus HNSW indexes

Benchmark runner improvements

• Added concurrent insert support for performance cases (#741)
• Fixed concurrent insert runner behavior for non-thread-safe databases (#764)
• Capped default insert workers to min(cpu, 4) to avoid overloading clients by default (#767)
• Added maintenance_work_mem and max_parallel_workers parameters for PgVector IVFFlat (#736)

Milvus and database client updates

• Migrated Milvus integration from PyMilvus ORM to MilvusClient (#738)
• Skipped Milvus compaction when permission errors occur (#753)
• Added label-filter support for PgDiskANN (#724)
• Fixed Qdrant timeout propagation (#725)
• Fixed pgvector index type normalization and ivf_flat → ivfflat mapping (#760, #763)
• Added self-hosted Elasticsearch support through --host / --port options in ElasticCloud commands (#761)
• Improved turbopuffer region handling, SDK compatibility, pickle/ID compatibility, and benchmark results

UI, dependency, and compatibility updates

• Upgraded to Pydantic v2 (#750)
• Restored ujson dependency (#744)
• Upgraded Streamlit and improved Run Test page error surfacing (#766)

Benchmark results and leaderboard updates

• Refreshed benchmark results for Milvus 2.6.14, ElasticCloud 8.17, ZillizCloud, and turbopuffer
• Filled missing Milvus and ZillizCloud build durations (#751, #754)
• Unified result timestamps and run_id values across result files
• Aligned streaming leaderboard labels with vector-search results
• Updated ZillizCloud benchmark results with Cardinal backend results

Docs and CI

• Added missing pgvector reranking CLI options to README (#726)
• Added stale-issue auto-close workflow (#730)
• Added /keep-open comment workflow for stale issues

Full Changelog

v1.0.20...v1.0.21

VDBBench 1.0.20 release

What's Changed

• Added Endee Client Support by @MithunEndee in #711
• fix: Use StrEnum instead of str, Enum by @XuanYang-cn in #722
• Feat/endee version by @MithunEndee in #715
• fix: Fix benchmark results display for paswordless AWS OpenSearch benchmarks by @javiervegas in #721
• feat: add Pinecone cli support by @Pitrick3141 in #717

New Contributors

• @MithunEndee made their first contribution in #711
• @javiervegas made their first contribution in #721
• @Pitrick3141 made their first contribution in #717

Full Changelog: v1.0.19...v1.0.20

VDBBench 1.0.19 release

What's Changed

• Add Chroma cli to VectorDBBench by @bjpietrzak in #610
• enhance: Change the Authors and Emails by @XuanYang-cn in #697
• feat: Update CockroachDB logo for better visibility by @viragtripathi in #702
• enhance: fix coding styles by @XuanYang-cn in #703
• fix: update logging messages to reflect correct vector counts in Qdrant by @Yinwei-Yu in #704
• Use SPDX license in pyproject.toml by @FantasqueX in #707
• enhance: pickle the iterator if something failed by @XuanYang-cn in #708
• feat: add zvec support by @egolearner in #692

New Contributors

• @bjpietrzak made their first contribution in #610
• @Yinwei-Yu made their first contribution in #704
• @FantasqueX made their first contribution in #707

Full Changelog: v1.0.18...v1.0.19

v1.0.18

What's Changed

• feat: add OceanBase UI config settings by @alwayslove2013 in #691
• support restful by @alwayslove2013 in #690

Full Changelog: v1.0.17...v1.0.18

v1.0.17

What's Changed

• feat(oss-opensearch): Add memory-optimized search configuration option by @Akhil-Pathivada in #673
• feat: Add QPS-Latency tradeoff metrics for Streaming Tests by @Akhil-Pathivada in #670
• feat(oss-opensearch): Add Disk-based vector search support by @Akhil-Pathivada in #680
• feat(milvus): add SCANN index support by @JackLCL in #682
• feat(milvus): add nprobe parameter for SCANN index by @JackLCL in #686
• Fix: correct description for rbq-bits-query in milvus client. by @Light-V in #684
• feat(oss-opensearch): Add Scalar Quantization support by @Akhil-Pathivada in #685

New Contributors

• @JackLCL made their first contribution in #682
• @Light-V made their first contribution in #684

Full Changelog: v1.0.16...v1.0.17

v1.0.16

What's Changed

• expose turbopuffer through CLI and make compatible with latest sdk by @lantingchiang in #667
• Custom log file placement by @mottosen in #669
• make collection name configurable by @lantingchiang in #671

New Contributors

• @lantingchiang made their first contribution in #667
• @mottosen made their first contribution in #669

Full Changelog: v1.0.15...v1.0.16

v1.0.15

What's Changed

• fix(cockroachdb): Handle 30s timeout and ensure vector index usage by @viragtripathi in #647
• fix es quant & rescore settings by @alwayslove2013 in #648
• Update cli.py fix bug (#649) by @WSL0809 in #651
• Several modifications to the AliSQL client by @JoeJRW in #657
• feat(cockroachdb): Add complete UI configuration and cloud support by @viragtripathi in #655
• cli for elastic by @Denise2004 in #662
• feat(oss-opensearch): Add KNN derived source configuration option by @Akhil-Pathivada in #632
• feat(aws_opensearch): Add some optimizations when load data into aws opensearch by @norrishuang in #663
• doris: update index properties by @uchenily in #664
• feat: Add Custom Dataset support for Streaming Tests by @Akhil-Pathivada in #660

New Contributors

• @WSL0809 made their first contribution in #651
• @Denise2004 made their first contribution in #662
• @uchenily made their first contribution in #664

Full Changelog: v1.0.14...v1.0.15

v1.0.14

What's Changed

• fix v1.0.13 by @alwayslove2013 in #644
• Feature: support doris benchmark by @zhiqiang-hhhh in #631
• feat: Add CockroachDB vector database support by @viragtripathi in #630
• feat: support turbopuffer client by @alwayslove2013 in #646
• fix lint issues; remove client dependency from runner by @alwayslove2013 in #645

New Contributors

• @zhiqiang-hhhh made their first contribution in #631
• @viragtripathi made their first contribution in #630

Full Changelog: v1.0.13...v1.0.14

v1.0.13

What's Changed

• feat(oss-opensearch): Add version compatibility for 2.x and 3.x by @Akhil-Pathivada in #635
• Add TencentES client by @morning-color in #623
• feat: add ujson dependency and fix lint issues by @alwayslove2013 in #643
• set default milvus-partition-key to false by @alwayslove2013 in #642
• [Feature] Add Alibaba Cloud RDS MySQL client by @JoeJRW in #636

New Contributors

• @morning-color made their first contribution in #623
• @JoeJRW made their first contribution in #636

Full Changelog: v1.0.12...v1.0.13

v1.0.12

What's Changed

• fixing README.md file to update pip install command by @towfeeqfayaz11 in #622
• aws opensearch added ondisk mode and binary quantization 32x compression by @norrishuang in #625
• cli support run LabelFilterPerformanceCase by @egolearner in #626
• feat(oss-opensearch): Add replication type configuration option by @Akhil-Pathivada in #627

New Contributors

• @towfeeqfayaz11 made their first contribution in #622
• @egolearner made their first contribution in #626
• @Akhil-Pathivada made their first contribution in #627

Full Changelog: v1.0.11...v1.0.12