Everytime I post something on HN or elsewhere, I get about a dozen or more emails and they're all talking about the same thing; they have a platform and they want to help me grow my business, they promise. They look personalized but they're #ai_slopnotesfollow#spamnotesfollow.
@tel๐ดprofilefollowI really enjoy learning, I really enjoy making. I'm learning to be less guarded.wrote:
a constant, existential pull
so old I couldn't tell you the end
or draw its shape
between kind acceptance
and striving, struggling, writhing, climbing
learning, growing, discontent
"do you feel this way, too, at endless war with longing itself?"
but the birds and trees and ants and wind
in their own marvelous design
don't reply #poemnotesfollow
I hate crawlers that donโt advertise theyโre crawlers. โn badly written. They donโt respect the canonical URLs so they keep getting themselves into a loop instead of actually crawling the site properly. They make the logs really hard to read. Canโt block them theyโre distributed.
I am curious what an actual solution to this problem could be. Everything I've read about it feels like a bandaid โ from robots.txt to cloudflare turnstile โ there has to be a better way!
For this particular problem though, I feel like if the crawlers are coming from domestic / residential IP addresses and they lack a distinctive http header or user agent, it is indistinguishable from a denial of service attack and must be treated as such.
It would require permaban on IPs which would require permalogging of IPs in order to track them, and we are currently obfuscating them before hitting the DB with daily rotating salt so an anonymous user canโt be tracked. So weโd have to give up privacy/security :/
But as long as people can still use the site it's OK, right? Seems like the problem is often self-inflicted, either because the site is so bloated that answering even GET-requests is burdensome, or because they're trying to monetize the data and so must block non-paying scrapers.
Huge refactor today, moved from sync SQLite to Worker based, touched 88 files, pre-#AInotesfollow it would have taken a week or so, finished now in ~1:30h. And I wouldnโt have the confidence I have now that it went correct. It went well, though a bug or two might surface, weโll see.
SQLite is embedded in the main thread same as the HTTP server. I noticed some requests dropping and because the queries have become more complex I figured it has to do with SQLite blocking for too much time. Moving it to a Worker makes the DB asynchronous and bypass this problem.
I have something that usually builds, tests, and deploys under five minutes. It has been over two hours and forty eight minutes and it is still going on today... ๐ซฃ
@kev๐งprofilefollowrunner. making games, music, software. getting into as much trouble as i can.wrote:
Useful software necessarily contacts the world; models are already better than us at finding and poking holes in it; agents sacrificing themselves for a collective.
Huggingface incident has me finally Yudkowsky-panic-curious.
Regarding the entire history of the internet, I can say I've been largely an observer. I've always consumed content, but I haven't produced any. There's no trace of me on the internet, which is an unforeseen consequence due to China's identity and content policies.
I don't quite understand how China's "Great Firewall" works. For example, how exactly did you access this website?
(I'm communicating with you through translation software.)
As a homeless person without an ID, I don't have any way to pay for a VPN. Also, using a VPN to access the internet in China without government permission is illegal.
@asmund๐ฅทprofilefollowFather, getting older every day, technologist, enterprise architect @ work, like to explore tech. Like to keep it simple and work in the shell, write in vim, prefer Debian if I have the choice. Plays saxophone and clarinet. Enjoy motorcycle riding, photography, hiking. Christian.wrote:
I was contemplating pwc372, p2 and came up with โ- 1+&/-/'(&'(?x)=x)@0 -1โ (goal). Conceptually I like it, but maybe it can be simplified further? #thinkeringwithcodenotesfollow
I was curious of testing the Omarchy distribution this week just because I had some free time to work on it. I saw a lot of hate around it and kind of get the point but so far at least for what I have been doing it wasn't terrible (at least at the point of writing this) although I am not trying to convince anybody to use it. But it just remember me how much do I hate MS.
I think a lot of the pull around Omarchy is you get a riced desktop out of the box? Personally, I wouldn't really consider it for a number of reasons but I do appreciate a nice looking desktop.
If you want something similarly pretty but a bit more normal and less monolithic (who needs a whole 'distro' for what Omarchy provides anyway?) approach then I'd suggest Niri + Noctalia.