@thechelsukprofilefollowCurrently in remission from ME/CFS after 3+ years. Occasional software engineering leader, app developer, blogger, zwifter, and just being online.wrote:
Hello! Is anyone else trying local AI? Im dont know what im doing but lately ive been trying "Llama 3,2 3b instruct q5km" on my phone and its been surprisingly good. #ainotesfollow
i think the best you can get right now is qwen 3.8 27B. youre gonna need 24 gigs of some fast memory though, i heard theres decent quantizations that can also make it run on 16. im quite excited about open/local models, but theres big investment overhead with the prices right now
You might be able to try out colibri, its quite good and the models are a bit better. I am unable to connect any of the cli agents to do things with it though, probably due to context limits, but try it out. OlMoe is the lightest
Someone can create enormous value while their manager controls the narrative around that value. Conversely, a manager can conceal structural problems because the people capable of exposing them depend on that same manager for evaluation and promotion
Beautiful day with local community. Lots of physical labor, all my joints are swollen, back sore, soles of my feet aching, but a beautiful day of people working together and recognizing what a special group we have.
The best Mcp server I have as Claude Connector is Emacs running on my Homeserver. It has one tool - eval-elisp. Using it Claude can do almost anything. My top 1 pinned chat is โRun agent-start-claude-code using HotterEmacs in dir โฆโ - after that I have a ready to use remote-controlled session running on my homeserver.
This sounds like a really interesting idea. What would you say are its advantages over having the agent use the shell, write shell scripts, etc? Just your personal preference for elisp or something else?
To load a skill I literally type - โload (โdoc 'slack) and browse channel X for todayโ. The idea is my text stays English but repeating concepts are real reusable elisp functions that stay fully deterministic. (โdoc 'agent) and Claude knows how to talk to open code and pi agents.
Do you live there or are just visiting? I remember feeling so at home there as a kid. I never kept my French up so I don't think I could ever move there.
Visiting, for the first time. It's about a 9 hour drive from home so we've never made the trip, but so worth it. Went to Ile d'Orleans yesterday, just... so quiet and beautiful. Seems a bit of a paradise, haven't even made it up to the natl park(s) yet.
My French is coming back a little each day, made it all the way through the coffee order just now :)