I hate crawlers that donโt advertise theyโre crawlers. โn badly written. They donโt respect the canonical URLs so they keep getting themselves into a loop instead of actually crawling the site properly. They make the logs really hard to read. Canโt block them theyโre distributed.
Any conversation
I am curious what an actual solution to this problem could be. Everything I've read about it feels like a bandaid โ from robots.txt to cloudflare turnstile โ there has to be a better way!
It would require permaban on IPs which would require permalogging of IPs in order to track them, and we are currently obfuscating them before hitting the DB with daily rotating salt so an anonymous user canโt be tracked. So weโd have to give up privacy/security :/
Thanks for making a calm space on the Internet @stagasprofilefollow
creative technologist
creator of textlog
creative technologist
creator of textlogSince you guys are on textlog I think you will find this article and discussion interesting
A character count though that still requires JavaScript sadly enough ๐ฅบ
Interesting! Didnโt know about a few. Neat! ๐ Aside, do you have an invitation for ? Or can you help us by doing a post about
textlog.cc?โฆ
You think is too much? Itโs totally related to the post.
People post projects/tools/repos on lobsters all the time. From the about page, "as a rule of thumb, self-promo should be less than a quarter of one's stories and comments."
I think if @stagasprofilefollowcreative technologist
creator of textlog intends to be an active user of the site henceforth, it'd it should be kosher. Otherwise, one of us who's been active on the site for a while could submit a post.
creative technologist
creator of textlog intends to be an active user of the site henceforth, it'd it should be kosher. Otherwise, one of us who's been active on the site for a while could submit a post. Error: Provider rejected the request (invalid_request_error, 400): Claude Code 2.1.75 does not support this model; version 2.1.251 or newer is required. Run
'claude update', or update the Claude desktop app, then try again. [request_id: req_011CedKqBRnC6Qr3m6nKEwNN]
Iโm not using Claude Code. This is how you drop the ball.@fastidiousprofilefollow
"Beware those that would deny you access to information, for in their heart they dream themselves your master." โ Sid Meyersreplied to:
"Beware those that would deny you access to information, for in their heart they dream themselves your master." โ Sid Meyersreplied to:The proverbial first post should have been โhello worldโ. :-P You are the first rustacean I come across!
replied to@fastidiousprofilefollow"Beware those that would deny you access to information, for in their heart they dream themselves your master." โ Sid Meyers:
"Beware those that would deny you access to information, for in their heart they dream themselves your master." โ Sid Meyers:LOL! Good point:)
โฆ
NIH syndrome? I am guilty of it too. I love implementing things from scratch, you learn a lot by doing so and you get to own the codebase end-to-end, so no surprises and fighting around othersโ choices. It can get exhausting too though, in the end I succumb to using off-the-shelf components because my primary goals move at a higher level.
I don't see much point in trying to build software at a "higher level", like whole products and services. I'm going to go down low and train myself on the fundamentals. Hopefully in time I'll be able to contribute to the foundational bits.
You're right, it does get exhausting. At some point you just want to rebuild everything, which is not possible.
bill gates built microsoft by making computation cheaper faster and harder for government to restrain. now that he's a billionaire no longer dependent on the free market for his own success he's discovered the virtues of taxing the next wave of computation. 1995 gates would have called it a tax on innovation. classic pull-the-ladder-up-behind-you politics.