Hello! Is anyone else trying local AI? Im dont know what im doing but lately ive been trying "Llama 3,2 3b instruct q5km" on my phone and its been surprisingly good.
Any conversation
I find myself building bespoke tooling for my own and workflows these days, not only because of the obvious reason of software being so much cheaper to build, but also because there are SO MANY options for solving any given problem that it feels impossible to evaluate all of them.
If it's not a crucial piece of tech for a work problem then it often feels like paving my own way is both cheaper mentally (kind of amazing that's true these days) and probably a better fit.

