I hate crawlers that donโt advertise theyโre crawlers. โn badly written. They donโt respect the canonical URLs so they keep getting themselves into a loop instead of actually crawling the site properly. They make the logs really hard to read. Canโt block them theyโre distributed.
Any conversation
I am curious what an actual solution to this problem could be. Everything I've read about it feels like a bandaid โ from robots.txt to cloudflare turnstile โ there has to be a better way!
It would require permaban on IPs which would require permalogging of IPs in order to track them, and we are currently obfuscating them before hitting the DB with daily rotating salt so an anonymous user canโt be tracked. So weโd have to give up privacy/security :/
@fastidiousprofilefollow
"Beware those that would deny you access to information, for in their heart they dream themselves your master." โ Sid Meyerswrote:
"Beware those that would deny you access to information, for in their heart they dream themselves your master." โ Sid Meyerswrote:@stagasprofilefollow
creative technologist
creator of textlog โmentionedโ is overlapping on nicks. Like @stagasprofilefollowcreative technologist
creator of textlog mentioned you โฆโ.
creative technologist
creator of textlog โmentionedโ is overlapping on nicks. Like @stagasprofilefollowcreative technologist
creator of textlog mentioned you โฆโ.@stagas๐คธprofilefollowcreative technologist
creator of textlogreplied to@fastidiousprofilefollow"Beware those that would deny you access to information, for in their heart they dream themselves your master." โ Sid Meyers:
creative technologist
creator of textlogreplied to@fastidiousprofilefollow"Beware those that would deny you access to information, for in their heart they dream themselves your master." โ Sid Meyers:wdym, screenshot?
@fastidiousprofilefollow"Beware those that would deny you access to information, for in their heart they dream themselves your master." โ Sid Meyersreplied to@stagas๐คธprofilefollowcreative technologist
creator of textlog:
"Beware those that would deny you access to information, for in their heart they dream themselves your master." โ Sid Meyersreplied to@stagas๐คธprofilefollowcreative technologist
creator of textlog:See:
@stagas๐คธprofilefollowcreative technologist
creator of textlogreplied to@fastidiousprofilefollow"Beware those that would deny you access to information, for in their heart they dream themselves your master." โ Sid Meyers:
creative technologist
creator of textlogreplied to@fastidiousprofilefollow"Beware those that would deny you access to information, for in their heart they dream themselves your master." โ Sid Meyers:Thanks.
@stagas๐คธprofilefollowcreative technologist
creator of textlogreplied to@fastidiousprofilefollow"Beware those that would deny you access to information, for in their heart they dream themselves your master." โ Sid Meyers:
creative technologist
creator of textlogreplied to@fastidiousprofilefollow"Beware those that would deny you access to information, for in their heart they dream themselves your master." โ Sid Meyers:Should be good now. It was a regression after the underline fixes, supposed to do ellipses.
@fastidiousprofilefollow"Beware those that would deny you access to information, for in their heart they dream themselves your master." โ Sid Meyersreplied to@stagas๐คธprofilefollowcreative technologist
creator of textlog:
"Beware those that would deny you access to information, for in their heart they dream themselves your master." โ Sid Meyersreplied to@stagas๐คธprofilefollowcreative technologist
creator of textlog:Yup, all good. Ellipses for the win!
kรฉsztetรฉst รฉrzek, hogy valami ilyesmivel (is) foglalkozzam, a kรณdolรกshoz egyelลre nincs agyam, de majd azt is szeretnรฉk, csak scripteket, semmi komoly programnyelv, de vรฉgรผlis a JavaScript is scriptnyelv
I feel the urge to do something like this, I don't have the brains for coding yet, but I would like to, just scripts, no serious programming languages, but after all, JavaScript is also a scripting language
Since you guys are on textlog I think you will find this article and discussion interesting
A character count though that still requires JavaScript sadly enough ๐ฅบ
Interesting! Didnโt know about a few. Neat! ๐ Aside, do you have an invitation for ? Or can you help us by doing a post about
textlog.cc?โฆ
You think is too much? Itโs totally related to the post.
People post projects/tools/repos on lobsters all the time. From the about page, "as a rule of thumb, self-promo should be less than a quarter of one's stories and comments."
I think if @stagasprofilefollowcreative technologist
creator of textlog intends to be an active user of the site henceforth, it'd it should be kosher. Otherwise, one of us who's been active on the site for a while could submit a post.
creative technologist
creator of textlog intends to be an active user of the site henceforth, it'd it should be kosher. Otherwise, one of us who's been active on the site for a while could submit a post.took me until now to learn described images with low-cost models > attaching images to high-cost model. silly me. output quality remains, cost lowers.
New in agenttop.dev : panels open in your . ๐คนโโ๏ธ
โข Any panel can now split into its own pane, live, beside the table.
โข Works with all the popular multiplexers: , , ๐ฎ๐ป๐ฑ ๐ธ๐ถ๐๐๐.
โข run a panel on its own: agent-top mcp, agent-top slow, agent-top fails, agent-top advice.
โ The # MCP panel also lists the orphaned MCP processes that outlived their agent and are still eating memory.
For , the tension between & to eat healthy is an interesting problem.
If you don't have time, it is difficult:
If you don't have money, it's difficult:
- to learn to cook,
- to source real food,
- and cook real food
- to afford real food
- or solve one of the time problems above
Yea, aside from the money, sourcing is a big problem, one thing I noticed when trying to at some point was that there are zero vegan snacks in ordinary neighbourhood stores, so that didnโt last very long.
Choice is definitely a problem. We notice it when we go to our cabin, about a 2 1/2 hour drive away.
The grocery store there targets for its local community. It is beef-centric and often boxed foods -- which is not our diet.
Access -- or lack thereof -- is the worst kind of problem. illustrate the historical and complex nature.