A credit union wants to get their own data out of a vendor's online system. Vendor wants $160,000. I wrote a #pythonnotesfollow script with #Playwrightnotesfollow to download the data just as though a user would. It's going to run for about 6 weeks to download around 250k records and 70GB of images.
you could split to buckets like alphanumerically and parallelize it if you don't want to wait that long. Probably need to launch a few instances but still cheaper lol.
The slowness is intentional. I wanted to make it look more like a user doing it than a script so it doesn't set off any alarms. I have it waiting from 1 to 3 seconds between clicks to slow it down. :-) So far so good!
@fastidiousprofilefollow"Beware those that would deny you access to information, for in their heart they dream themselves your master." โ Sid Meyerswrote:
There is someone absolutely rotten and fetid in this airplane. Every 10 minutes. Dear Spaghetti Monster!
#AInotesfollow brings so many issues. It really accelerates. Not only the good parts but also the bad parts. Combine this with a product person that doesn't even know what a refinement is. I'm 41, maybe I'll study to pivot, maybe I'll get into trading. I can't handle it anymore.
what is a refinement? honest question - I'm restructuring our refinements now. Like having group of people discussing 5 items in an hour gives little chances any one of them will be addressed properly, unless they are trivial.
Architect/lead have a pre-refinement with product to clear 80% of the obvious questions. We share an agenda, devs can ask questions async. In the refinement product presents, we design a solution draft. 15 minutes/item. This doesn't work if product is incompetent and everything is AI-slopped.
โPassion has little to do with euphoria and everything to do with patience. It is not about feeling good. It is about endurance. Like patience, passion comes from the same Latin root: pati. It does not mean to flow with exuberance. It means to suffer.โ
โ Mark Z. Danielewski, Ho
@fastidiousprofilefollow"Beware those that would deny you access to information, for in their heart they dream themselves your master." โ Sid Meyerswrote:
Maybe implementing a subset of Markdown would be a good thing. I am thinking about bold, italics, inline code, and code block, mostly. Oh, and links.
I agree that minimalism is hard. Thatโs why the subset was explicitly recommended small. Yet, I believe it is extremely useful to have.
@fastidiousprofilefollow"Beware those that would deny you access to information, for in their heart they dream themselves your master." โ Sid Meyerscontinued:
I've tested MD and honestly I don't like it. Bold/italics add unnecessary noise/clutter and the font is already monospace, suited for code, so inline code & code fences are not needed. If 3rd party clients want to implement them it's fine but I'm sensitive to visual noise.
I agree with this. The core you're building is around a deliberate minimalist philosophy. I was happy to build an opinionated client for my own use-case, but it should imo stay on the fringes for those seeking it.
This is my first note, there are many like it, but this one is mine.
@thechelsukprofilefollowCurrently in remission from ME/CFS after 3+ years. Occasional software engineering leader, app developer, blogger, zwifter, and just being online.wrote:
textlog runs on a 2.5โฌ/mo vps 1 core/2gb ram, using just one instance of Bun with its embedded SQLite. Works perfect and I run a few other apps as well on that machine.
@carbonwriter๐งprofilefollow(\ (\
( โข โข)
โโชโชโโโโ
Full of mostly true stories, I occasionally write them down. Habit of talking to anyone. Bipolar. Author.wrote: