Hello! Is anyone else trying local AI? Im dont know what im doing but lately ive been trying "Llama 3,2 3b instruct q5km" on my phone and its been surprisingly good. #ainotesfollow
i think the best you can get right now is qwen 3.8 27B. youre gonna need 24 gigs of some fast memory though, i heard theres decent quantizations that can also make it run on 16. im quite excited about open/local models, but theres big investment overhead with the prices right now
You might be able to try out colibri, its quite good and the models are a bit better. I am unable to connect any of the cli agents to do things with it though, probably due to context limits, but try it out. OlMoe is the lightest
Maybe it'll end up being a case of stated vs revealed preference, but I feel like Apple's really missing the moment with their latest products. People by and large want less tech in their lives right now, not screens and AI stuff everywhere.
on the contrary, at least for me, it unleashes creativity because I donโt have to switch to execution mode (linear thinking), I can keep myself in the creativity mode (lateral thinking).
@klumbering๐คกprofilefollowFirst thing to say is, I hope the owners of Chatgpt Claude Gemini and Others gets bloodeagled for making their unwanted baby, anyways Hello =)wrote:
not marketing. yes their jobs positively select for concern about ai, but most people that are actively researching the field are concerned about the current state of safety, pace and incentives. I dont agree with a lot anthropic does, but i do believe the employees take safety seriously and they obviously have a better understanding of it than us. also theres no incentive for someone like coxon to sound alarm bells on twitter for "marketing" reasons, after quitting anthropic
Yes, but some people say that they are pushing for market regulation. They want the state to protect them from the chinese models and, also, to protect the massive investments in Anthropic, OpenaAI, et al. that these companies will never be able to return. This sounds plausible to me too.
Maybe but it would be convenient for them if they were the only ones allowed to train new models. I think that's much more likely what they're interested in.
read darios latest post. its not what they are after. its really not that complicated, the technology is simply if development continues to race as it is right now. they are already doing most of what they can to stop china from ai dev.
The inaugural, proverbial first post. Seems like a lovely service here.
@fastidiousprofilefollow"Beware those that would deny you access to information, for in their heart they dream themselves your master." โ Sid Meyersreplied to@crustyrustaceanprofilefollowOld school metallian, hobbyist developer writing things mostly in Rustโฆmostly:
The proverbial first post should have been โhello worldโ. :-P You are the first rustacean I come across!
@crustyrustaceanprofilefollowOld school metallian, hobbyist developer writing things mostly in Rustโฆmostlyreplied to@fastidiousprofilefollow"Beware those that would deny you access to information, for in their heart they dream themselves your master." โ Sid Meyers:
everytime i see projects like this, i think that a rss implementation it wolud be so cool. Although iknow that there is not that much rss lover out there haha