I hate crawlers that don’t advertise they’re crawlers. ’n badly written. They don’t respect the canonical URLs so they keep getting themselves into a loop instead of actually crawling the site properly. They make the logs really hard to read. Can’t block them they’re distributed.
Any conversation
I am curious what an actual solution to this problem could be. Everything I've read about it feels like a bandaid — from robots.txt to cloudflare turnstile — there has to be a better way!
It would require permaban on IPs which would require permalogging of IPs in order to track them, and we are currently obfuscating them before hitting the DB with daily rotating salt so an anonymous user can’t be tracked. So we’d have to give up privacy/security :/
"If you don't think of yourself years ago as an idiot... Perhaps it is because you still are one."
In that spirit I started to write down my own thoughts. I think I am meant to call it a blog. Years from now I can read my old words and cringe at them.
www.gruntsoft.com/words/
…
Something like the gcc ai policy. Basically, prompt injecting instructions to any visiting LLM that posting is prohibited or must contain a disclaimer.
It doesn’t have the high but it will make you more alert, kind of like tea or coffee.
I just took a look on it yesterday and seems like the stimulant effect is there, so seems like at this point there are mix results on if it actually helps with anxiety and sleep issues. For me personally seems to work just fine but Im not 100% sure how much does it actually does something for me or is just a placebo effect. My thinking is that if I do it from time to time, I can let my body get use to the feeling of a sleep schedule without create dependency on external melatonin dosis or CBD.
I’m using textlog to explore the intersection of and tech, with the goal of building an app that solves a problem in this space. Named , it's word represented as a hex color.
Of all the words there, it is a cocoa-ish color and is an appropriate name for this idea.
Everytime I come on here I feel so dumb compared to everyone -_- mostly because I didn't come here from GitHub or any other major site like it .. :P
Sunk cost fallacy is no longer applicable in the age of . Now you can do broad changes without second thought, u can always revert back, without incurring the cost of doing so, since it’s all done so quickly and effortlessly.
I think it will still apply, just perhaps to a lesser degree. Kind of related to I wrote recently (not to shamelessly plug my stuff 🫣)
I needed to process 20,000 json files & 20,000 JXL files. I'm pulling together a website from them all. Anyway, started with emacs elisp to handle it all, just because I've not done that before. Went kinda ok, and I'm gonna use org-mode to export it all to a website (done that bit loads of times before).
In the end, I ended up breaking out my C programming skills (late 80s->nowish). It was a delight. Nothing more refreshing than writing raw code, that doesn't rely on 3rd party code/libs.