Trying to gently work my way back to the target intensity needed for the Norwegian 4x4 to get my weekly dose of suck and feel accomplished after. Chronic left leg pain unfortunately likes reminding me it's there though.
@asmund๐ฅทprofilefollowFather, getting older every day, technologist, enterprise architect @ work, like to explore tech. Like to keep it simple and work in the shell, write in vim, prefer Debian if I have the choice. Plays saxophone and clarinet. Enjoy motorcycle riding, photography, hiking. Christian.wrote:
@carbonwriterprofilefollow(\ (\
( โข โข)
โโชโชโโโโ
Full of mostly true stories, I occasionally write them down. Habit of talking to anyone. Bipolar. Author. what are some of you favorite teas? #teanotesfollow
did they silently decrease the subscription limits on codex? (in addition to reintroducing the 5h limit?) subscription models suck so bad when they can just change the terms and make the product shittier.
ive been dual wielding 2 accounts with some fallback shenanigans. on average its enough for me, but on heavy weeks its annoying. + it feels intransparent
What did I build with claude yesterday - kanban board for my agents, Hamster Jerob game, imgproxy for thumbs in my photo sharing app, and ghostel-shell-command helper.
Today - digital detox day.
There's a really good one run by someone in the Netherlands. He forked the software and made a ton of improvements. I was on there six years ago. I wish I could remember the name.
I hate crawlers that donโt advertise theyโre crawlers. โn badly written. They donโt respect the canonical URLs so they keep getting themselves into a loop instead of actually crawling the site properly. They make the logs really hard to read. Canโt block them theyโre distributed.
I am curious what an actual solution to this problem could be. Everything I've read about it feels like a bandaid โ from robots.txt to cloudflare turnstile โ there has to be a better way!
For this particular problem though, I feel like if the crawlers are coming from domestic / residential IP addresses and they lack a distinctive http header or user agent, it is indistinguishable from a denial of service attack and must be treated as such.
It would require permaban on IPs which would require permalogging of IPs in order to track them, and we are currently obfuscating them before hitting the DB with daily rotating salt so an anonymous user canโt be tracked. So weโd have to give up privacy/security :/
But as long as people can still use the site it's OK, right? Seems like the problem is often self-inflicted, either because the site is so bloated that answering even GET-requests is burdensome, or because they're trying to monetize the data and so must block non-paying scrapers.
Going to document some approaches to produce data visualizations using ari via DuckDB.
Donโt know why it didnโt occur to me earlier, that there would be some solid community extensions for #dataviznotesfollow in DuckDB.
I was trying to use an approach that relies on community extensions, but installing them is proving finicky.
Going to consider an approach that requires less futzing.