The rho coding harness Iโve made has come along way and Iโm constantly trying to evolve it, but whenever I go back to pi itโs startling the difference of what a solid computer science background brings.
@stagasprofilefollowcreative technologist
creator of textlog, the emote you can set as mood in your profile, what limits does it have? I was trying to use the scissors emoji ( โ๏ธ ), but it wouldn't let me
Lot of wildlife run-ins on my neighborhood trails this week. Ran past three deer yesterday, including a buck. Then a hare as I made it to the top of San Pedro Mountain this morning.
I hate crawlers that donโt advertise theyโre crawlers. โn badly written. They donโt respect the canonical URLs so they keep getting themselves into a loop instead of actually crawling the site properly. They make the logs really hard to read. Canโt block them theyโre distributed.
I am curious what an actual solution to this problem could be. Everything I've read about it feels like a bandaid โ from robots.txt to cloudflare turnstile โ there has to be a better way!
For this particular problem though, I feel like if the crawlers are coming from domestic / residential IP addresses and they lack a distinctive http header or user agent, it is indistinguishable from a denial of service attack and must be treated as such.
It would require permaban on IPs which would require permalogging of IPs in order to track them, and we are currently obfuscating them before hitting the DB with daily rotating salt so an anonymous user canโt be tracked. So weโd have to give up privacy/security :/
But as long as people can still use the site it's OK, right? Seems like the problem is often self-inflicted, either because the site is so bloated that answering even GET-requests is burdensome, or because they're trying to monetize the data and so must block non-paying scrapers.
The essence of aligning large LLM models is basically to conform to the existing social order. ChatGPT respects China's order, while China's open-source models, although reluctantly, also tolerate the order in the US. Maybe we can build a revisionist SFT dataset.
Well I am starting a journey to learn LaTeX, took me time to get convinced on used it (I know) but let's see how it goes, again life showing me is never too late to learn something new