Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

>Realistically, how useful is local LLM usage?

For me, none really, just as a toy. I don't get much use out of online either. There was Kaggle competition to find issues with OpenAI's open weights model, but because my RTX gpu didn't have enough memory i had to run it very slowly from with CPU/ram.

Maybe other people have actual uses, but i don't



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: