Vector Database Developments

Brief mentions of Milvus features for RAG, vector indexing in DuckDB, and general traction of vector databases in AI ecosystem

The conversation highlights DuckDB’s rising prominence in the AI ecosystem, where its VSS extension provides a convenient, if early-stage, solution for analytical vector indexing. While its traction mirrors the early growth of dedicated vector databases, users note that it remains a specialized tool requiring careful management to avoid technical pitfalls like memory exhaustion. Meanwhile, established platforms like Milvus are rapidly maturing by introducing sophisticated features such as hybrid search and BM25 to specifically cater to the complex demands of RAG and AI agent development.

View on HN · Topics

very interesting. whats the vector indexing story like in duckdb these days?

also are there sqlite-duckdb sync engines or is that an oxymoron

View on HN · Topics

https://duckdb.org/docs/stable/core_extensions/vss

It's not bad if you need something quick. I haven't had a large need of ANN in duckdb since it's doing more analytical/exploratory needs, but it's definitely there if you need it.

View on HN · Topics

Also somewhat surprised. DuckDB traction is impressive and on par with vector databases in their early phases. I think there's a good chance it will earn an honorable mention next year if adoption holds and becomes more mainstream. But my impression is that it's still early in its adoption curve where only those "in the know" are using it as a niche tool. It also still has some quirks and foot-guns that need moderately knowledgeable systems people to operate (e.g. it will happily OOM your DB)

View on HN · Topics

I would like to mention that vector databases like Milvus got lots of new features to support RAG, Agent development, features like BM25, hybrid search etc..

Summarizer