any · textlog

wrote:

I hate crawlers that don’t advertise they’re crawlers. ’n badly written. They don’t respect the canonical URLs so they keep getting themselves into a loop instead of actually crawling the site properly. They make the logs really hard to read. Can’t block them they’re distributed.

replied to:

I am curious what an actual solution to this problem could be. Everything I've read about it feels like a bandaid — from robots.txt to cloudflare turnstile — there has to be a better way!

continued:

For this particular problem though, I feel like if the crawlers are coming from domestic / residential IP addresses and they lack a distinctive http header or user agent, it is indistinguishable from a denial of service attack and must be treated as such.

replied to:

It would require permaban on IPs which would require permalogging of IPs in order to track them, and we are currently obfuscating them before hitting the DB with daily rotating salt so an anonymous user can’t be tracked. So we’d have to give up privacy/security :/

replied to:

But as long as people can still use the site it's OK, right? Seems like the problem is often self-inflicted, either because the site is so bloated that answering even GET-requests is burdensome, or because they're trying to monetize the data and so must block non-paying scrapers.

…

replied to:

My solution was to add an env var to disable logs from anonymous. At least now will be able to read the logs.

wrote:

I got an email from battle.net to confirm my age. Apparently some content may be restricted to minors in the region my account is from. You would think that the account having been created 19 years ago, and with some CD-keys of games from the late 1990's having been added to it would be enough proof, but oh well.

wrote:

gondolom, vasárnap van nekik is, vagy nem tudom

wrote:

It's cookie o'clock, y'all.

replied to:

_ _ me want (.)(‘) more… / ___, \ .-. .-. _ \ ‘--’ / (:::) (:::{ ‘-`--=-`-’ }”` `-’ `"/ \"` \ / _/ /\ \_ { / \ } `"` `"`

wrote:

I often wish I had the ability to pause my main quest so I could focus more on side questing.

wrote:

Fair play to Apple and team, 5 apps in for review, 4 passed through each within an hour. 'Appy days

wrote:

hello i am verity

replied to:

Hello Verity :)

replied to:

verity my helper friend!!!!!

wrote:

A thing I've been doing lately is trying to come to the same conclusions others have without looking their the direct techniques and code. Last night I tried to figure out why people do vector based retrieval for RAG and ended up running these experiments: n0tls.com/…/2026-09-03-i-think-…rag-with-grep.html I'm still going to do an explore agent.

continued:

Here's a follow up from last night: n0tls.com/…/2026-09-05-fine-tuning-…tiny-retriever.html This has been a great way for me to learn in this space. Learning with AI has been such a fun time for me.

wrote:

I surprised my self this morning. I was looking for some content on YouTube with Mario (pi) and saw something that was 2 months old. First reaction was “that is too old.” I used to take my time, slow it down and have time for thoughts. Is this what’s happen to you when consume too much?

replied to:

Patience is a muscle that needs exercise to keep functioning.

…

replied to:

yes. everything goes so fast nowadays that we don't stop to appreciate stuff that happened the last month, two months, a year, 5 years ago.

replied to:

With the recent speed of all the AI stuff 2 months is old but the whole thing has gotten exhausting at this point.

wrote:

Hola

wrote:

hello folks

wrote:

brings so many issues. It really accelerates. Not only the good parts but also the bad parts. Combine this with a product person that doesn't even know what a refinement is. I'm 41, maybe I'll study to pivot, maybe I'll get into trading. I can't handle it anymore.

……

replied to:

what is a refinement? honest question - I'm restructuring our refinements now. Like having group of people discussing 5 items in an hour gives little chances any one of them will be addressed properly, unless they are trivial.

replied to:

Architect/lead have a pre-refinement with product to clear 80% of the obvious questions. We share an agenda, devs can ask questions async. In the refinement product presents, we design a solution draft. 15 minutes/item. This doesn't work if product is incompetent and everything is AI-slopped.

…

replied to:

Thank you, like!👍

wrote:

I am trying to learn emacs for the fun of it. The tutorial is brilliant and clear. Any tips that would help me learning more things. I know all I need is practice but if you may have used it, you may know a thing or two.

wrote:

Have a wonderful day.

wrote:

It's one of the sad ironies of this computer stuff that the simpler solutions take longer to conceive than the complicated ones.

wrote:

Ubuntu telepítése a VirtualBoxba rendben megtörtént. Már csak egy ügynököt kell bele fogni, és máris kész az "AI torture chamber", ahogy a Futurism írja... Mondjuk, első körben még nem így fogalmaznék...

Ubuntu has been successfully installed in VirtualBox. All you need to do is add an agent and you have an "AI torture chamber", as Futurism describes it... Let's just say, I wouldn't put it that way at first...

wrote:

Maurizio Lombardi is my only reason now. I have to move forward

wrote:

Where’s the coffee machine?

wrote:

Is it just my phone or is HN down? I haven't been able to access at all today

replied to:

Just your phone. Works for me. Try

replied to:

That works. About time for a new phone though

Any conversation