Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Yep, there are numbers in the blog post and repo. We are able to index MS-MARCO v2 (138M documents, around 50GB of raw data) in a bit under 18 minutes.


For 2M scale dataset, you should be able to index in about 1 minute on low-end hardware. See the MS-MARCO v1 (8M documents) numbers, measured on cheap Github runners.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: