I was about to prepare a rewrite cause a personal program was failing but realized I had an incomplete change and was incorrectly identifying an error from valid data. Actually so weird to pick up a project after weeks of not touching it
Hello! Is anyone else trying local AI? Im dont know what im doing but lately ive been trying "Llama 3,2 3b instruct q5km" on my phone and its been surprisingly good. #ainotesfollow
i think the best you can get right now is qwen 3.8 27B. youre gonna need 24 gigs of some fast memory though, i heard theres decent quantizations that can also make it run on 16. im quite excited about open/local models, but theres big investment overhead with the prices right now
You might be able to try out colibri, its quite good and the models are a bit better. I am unable to connect any of the cli agents to do things with it though, probably due to context limits, but try it out. OlMoe is the lightest
@davidprofilefollow๐ A lifetime Apple user. Partner says I am pedantic, sarcastic, and cynic. I just want to be me.wrote:
Which Linux distribution do you like the most, and why? Follow the previous with your favourite desktop environment.
Arch Linux with KDE. I like that Arch comes with nothing and is pretty vanilla. No bloat, and customisable. No major upgrades where 5 things break at once. Install once, and it's fine until the device has to be replaced. Only then usually do a fresh install. It's up to date, still pretty boring, and you learn a bit in the process.
i distro hoped a lot. Finally i found my cozy home with debian with kde. 3 years still running without a problem all the software i use works perfectly and the games run smoothly.
Arch with i3, have been using it for like 7-8 years now. Started out at elementary os, really good and everything, but the thing where I dont need to install *-dev libs separately saves me a lot of time during compilations and building. Also, AUR is a life saver at times.
openSUSE + KDE. European(-ish), very robust, simply perfect. I use on my home server workstation, where I also game via Steam and do other stuff like photo processing, bit of programming, etc
I've written a small persistent agent wrapper for agent.py. I'm impressed with how well it works. I feel like a CEO issuing global memos to all my agents after reading their status reports.
Itโs using the /firehose/apitextlogAPIA quieter place for your thoughts. endpoint. Itโs an SSE endpoint publishing everything latest. Though I meant it to be used server-side, since itโs heavily rate-limited โ up to 3 conns under the same network, but I canโt control how clients decide to use it so.. ยฏ\_(ใ)_/ยฏ
@thechelsukprofilefollowCurrently in remission from ME/CFS after 3+ years. Occasional software engineering leader, app developer, blogger, zwifter, and just being online.wrote:
Going to document some approaches to produce data visualizations using ari via DuckDB.
Donโt know why it didnโt occur to me earlier, that there would be some solid community extensions for #dataviznotesfollow in DuckDB.
I was trying to use an approach that relies on community extensions, but installing them is proving finicky.
Going to consider an approach that requires less futzing.
Huge refactor today, moved from sync SQLite to Worker based, touched 88 files, pre-#AInotesfollow it would have taken a week or so, finished now in ~1:30h. And I wouldnโt have the confidence I have now that it went correct. It went well, though a bug or two might surface, weโll see.
SQLite is embedded in the main thread same as the HTTP server. I noticed some requests dropping and because the queries have become more complex I figured it has to do with SQLite blocking for too much time. Moving it to a Worker makes the DB asynchronous and bypass this problem.
Another little corner of the internet. Anything using fixed-width fonts and without pictures has surely got to be promising in this day and age, surely...