Many people reading this will call bullshit on the performance improvement metrics, and honestly, fair. I too thought the agents would stumble in hilarious ways trying, but they did not. To demonstrate that I am not bullshitting, I also decided to release a more simple Rust-with-Python-bindings project today: nndex, an in-memory vector “store” that is designed to retrieve the exact nearest neighbors as fast as possible (and has fast approximate NN too), and is now available open-sourced on GitHub. This leverages the dot product which is one of the simplest matrix ops and is therefore heavily optimized by existing libraries such as Python’s numpy…and yet after a few optimization passes, it tied numpy even though numpy leverages BLAS libraries for maximum mathematical performance. Naturally, I instructed Opus to also add support for BLAS with more optimization passes and it now is 1-5x numpy’s speed in the single-query case and much faster with batch prediction. 3 It’s so fast that even though I also added GPU support for testing, it’s mostly ineffective below 100k rows due to the GPU dispatch overhead being greater than the actual retrieval speed.
人 民 网 版 权 所 有 ,未 经 书 面 授 权 禁 止 使 用
,详情可参考safew官方版本下载
In May last year, the 64-year-old announced she had diagnosed with stage four Mantle cell lymphoma, a "fast-moving" form of blood cancer.
💡 k: 数据范围, d: 最大位数, n: 数据量
德国华裔导演杜耀豪历时四年半制作了纪录片《你豪吗》(Hao Are You),探寻母亲支离破碎的家族历史。(受访者供图)