A credit union wants to get their own data out of a vendor's online system. Vendor wants $160,000. I wrote a script with to download the data just as though a user would. It's going to run for about 6 weeks to download around 250k records and 70GB of images.
Any conversation
@stagas๐คธprofilefollow
creative technologist
creator of textlogreplied to@ricky๐คชprofilefollow#Automationnotesfollow specialist for #CreditUnionsnotesfollow; 20+ year #SharePointnotesfollow veteran; #developernotesfollow; #writernotesfollow. I don't idle well.:
creative technologist
creator of textlogreplied to@ricky๐คชprofilefollow#Automationnotesfollow specialist for #CreditUnionsnotesfollow; 20+ year #SharePointnotesfollow veteran; #developernotesfollow; #writernotesfollow. I don't idle well.:you could split to buckets like alphanumerically and parallelize it if you don't want to wait that long. Probably need to launch a few instances but still cheaper lol.
@ricky๐คชprofilefollow#Automationnotesfollow specialist for #CreditUnionsnotesfollow; 20+ year #SharePointnotesfollow veteran; #developernotesfollow; #writernotesfollow. I don't idle well.replied to@stagas๐คธprofilefollow
creative technologist
creator of textlog:
creative technologist
creator of textlog:The slowness is intentional. I wanted to make it look more like a user doing it than a script so it doesn't set off any alarms. I have it waiting from 1 to 3 seconds between clicks to slow it down. :-) So far so good!
@thechelsukprofilefollowCurrently in remission from ME/CFS after 3+ years. Occasional software engineering leader, app developer, blogger, zwifter, and just being online.wrote:
@stagas๐คธprofilefollow
creative technologist
creator of textlogreplied to@thechelsukprofilefollowCurrently in remission from ME/CFS after 3+ years. Occasional software engineering leader, app developer, blogger, zwifter, and just being online.:
creative technologist
creator of textlogreplied to@thechelsukprofilefollowCurrently in remission from ME/CFS after 3+ years. Occasional software engineering leader, app developer, blogger, zwifter, and just being online.: _ _
__ ___.--โ_`. .'_`--.___ __
( _`.'. - 'o` ) ( โo` - .`.โ_ )
_\.โ_โ _.-โ `-._ `_`./_
( \`. ) //\` /\\ ( .'/ )
\_`-โ`---'\\__, ,__//`---โ`-'_/
\` `-\ /-' '/ #ascii_artnotesfollow
@derblitzmann๐profilefollow10+ years Seattle based software engineer.replied to@thechelsukprofilefollowCurrently in remission from ME/CFS after 3+ years. Occasional software engineering leader, app developer, blogger, zwifter, and just being online.:
Noice
Froggos make everything better.
@elana๐งprofilefollowI have a doctorate in ancient stuff but these days I'm a full-time plague avoider. Born and raised in Toronto, Canada, now living in Kyoto, Japan.replied to@chanuxprofilefollowI ain't no nothing!:
โฆcovid is still circulating. the pandemic never ended. people just stopped giving a shit about each other
@klumbering๐คกprofilefollowFirst thing to say is, I hope the owners of Chatgpt Claude Gemini and Others gets bloodeagled for making their unwanted baby, anyways Hello =)wrote:
falling away.
@thechelsukprofilefollowCurrently in remission from ME/CFS after 3+ years. Occasional software engineering leader, app developer, blogger, zwifter, and just being online.wrote:
Added it as a company on LinkedIn so it must be 'live' now. Cheltenham-od.uk
#ascii_artnotesfollow
โญโ Twitter
โญโ micro โผโ Tumblr
โ โโ textlog
ยซ blogging ยป โค โฐโ Cohost (RIP)
โ โญโ Bear
โฐโ normal โผโ Motoroa
โฐโ lmno.lollmno.lollmno.lolWholesome blogs minus the yucky bits of the modern web
โฆ
@chanuxprofilefollowI ain't no nothing!replied to@kev๐งprofilefollowrunner. making games, music, software. getting into as much trouble as i can.:
I want this expanded and enacted by one of those guys doing Jordan Peterson impersonations :D
I think yes, but precisely NOT "at a philosophical level". You can have it only if you get your hands dirty and build it yourself. I think @stagasprofilefollow
creative technologist
creator of textlog already proved this, just as a close example.
creative technologist
creator of textlog already proved this, just as a close example.If speaking on a philosophical level, then first we have to ask: whatโs โniceโ and whatโs โto haveโ ๐
@asmund๐ฅทprofilefollowFather, getting older every day, technologist, enterprise architect @ work, like to explore tech. Like to keep it simple and work in the shell, write in vim, prefer Debian if I have the choice. Plays saxophone and clarinet. Enjoy motorcycle riding, photography, hiking. Christian.replied to@chanuxprofilefollowI ain't no nothing!:
If you consider what you have nice, you can have nice things. If your expectations to your surroundings are very very low, you will be amazed with all the nice things you get from people you meet through your day. My personal approach. #simplelifenotesfollow
@chanuxprofilefollowI ain't no nothing!replied to@prophetorit๐งprofilefollow
grand and intoxicating innocence:
grand and intoxicating innocence:I just realized watching TV series/movies is also something I dropped in the context of &4234
It's partly filled with Youtube, admittedly with some slop allowed in.
When I stopped having a job I completely lost interest of huge portion of things I used to have interest before. I could connect all of that to consumerism. And I haven't gained any of that interest back.
@jmnufprofilefollow
Chilling.
Hand coding C to feel alivereplied to@prophetorit๐งprofilefollow
grand and intoxicating innocence:
Chilling.
Hand coding C to feel alivereplied to@prophetorit๐งprofilefollow
grand and intoxicating innocence:Not sure, maybe Prince of Tennis
@mourningdove๐ฆprofilefollowI'm a small web enthusiast working on my blog and working on myself.
themourningdove.bearblog.devreplied to@prophetorit๐งprofilefollow
grand and intoxicating innocence:
grand and intoxicating innocence:What's your Minecraft skin?
โฆ
@prophetorit๐งprofilefollow
grand and intoxicating innocencereplied to@mourningdove๐ฆprofilefollowI'm a small web enthusiast working on my blog and working on myself.
themourningdove.bearblog.dev:
grand and intoxicating innocencereplied to@mourningdove๐ฆprofilefollowI'm a small web enthusiast working on my blog and working on myself.
themourningdove.bearblog.dev:really? (โ โโ _โ โโ ) I just saw it before and felt like it described me sometimes (โ โขโ ย โ โฝโ ย โ โขโ ;โ ) what game is he from!??!
or show, or any other media,,
@mourningdove๐ฆprofilefollowI'm a small web enthusiast working on my blog and working on myself.
themourningdove.bearblog.devreplied to@prophetorit๐งprofilefollow
grand and intoxicating innocence:
grand and intoxicating innocence:That's so funny, I've never seen anyone get into it by this quote alone, he's the antagonist of the game The Elder Scrolls III: Morrowind.
The quote is even better when you hear it in context, but don't spoil the experience, you ought to play the game and hear it for yourself.
What do you normally play?
@prophetorit๐งprofilefollow
grand and intoxicating innocencereplied to@mourningdove๐ฆprofilefollowI'm a small web enthusiast working on my blog and working on myself.
themourningdove.bearblog.dev:
grand and intoxicating innocencereplied to@mourningdove๐ฆprofilefollowI'm a small web enthusiast working on my blog and working on myself.
themourningdove.bearblog.dev:I play tf2 and fallout NV(if it wasn't obviously enough)!!! when I were younger I was a big fan of gacha life lol
Economist Lant Pritchett describes shifts in ideas as silly, controversial, progressive, then obvious.
Also:
"Radio has no future. X-rays are clearly a hoax. The aeroplane is scientifically impossible." - Lord Kelvin
". No wireless. Less space than a nomad. Lame." - CmdrTaco
@evnmprofilefollowSoftware engineerGitHubevnm - Overviewevnm has 51 repositories available. Follow their code on GitHub., trail runnerStravaSignup for free to see more about LawrenceJoin Lawrence and get inspired for your next workout, gear-maker. Working on something new for homeownersgetonmain.comMain ยท A quiet, well-organized record of everything that keeps your home running.A quiet, well-organized record of everything that keeps your home running.wrote:
But maybe we'd all be a little saner if we remembered what we're actually doing: building tools to make our lives and the lives of others easier.
graybeard.ing/software-drives-people-insane/The Gospel According to GraybeardSoftware Drives People InsaneI have a little pet theory that software drives people insane. Not in the "wash your hands every thirty minutes like Howard Hughes" kind of way, but more ...
@stagas๐คธprofilefollow
creative technologist
creator of textlogreplied to@evnmprofilefollowSoftware engineerGitHubevnm - Overviewevnm has 51 repositories available. Follow their code on GitHub., trail runnerStravaSignup for free to see more about LawrenceJoin Lawrence and get inspired for your next workout, gear-maker. Working on something new for homeownersgetonmain.comMain ยท A quiet, well-organized record of everything that keeps your home running.A quiet, well-organized record of everything that keeps your home running.:
creative technologist
creator of textlogreplied to@evnmprofilefollowSoftware engineerGitHubevnm - Overviewevnm has 51 repositories available. Follow their code on GitHub., trail runnerStravaSignup for free to see more about LawrenceJoin Lawrence and get inspired for your next workout, gear-maker. Working on something new for homeownersgetonmain.comMain ยท A quiet, well-organized record of everything that keeps your home running.A quiet, well-organized record of everything that keeps your home running.:This resonated a lot. Iโm glad I read it now, before going totally insane lol. But I disagree that itโs just a glorified spreadsheet. The UI/UX matters, how you present the data, how they can change and so on, all of those things play a role. The good thing with AI is iteration is cheaper than ever, so you can experiment and process the results quickly. But yeah sometimes I just do things here because I just have to be doing something, I canโt leave it alone.
@evnmprofilefollowSoftware engineerGitHubevnm - Overviewevnm has 51 repositories available. Follow their code on GitHub., trail runnerStravaSignup for free to see more about LawrenceJoin Lawrence and get inspired for your next workout, gear-maker. Working on something new for homeownersgetonmain.comMain ยท A quiet, well-organized record of everything that keeps your home running.A quiet, well-organized record of everything that keeps your home running.replied to@stagas๐คธprofilefollow
creative technologist
creator of textlog:
creative technologist
creator of textlog:Agreed. The "just" makes the statement sound dismissive, but I do agree with the underlying sentiment that most software boils down to CRUD apps that help people organize information and complete tasks more efficiently. I think the path to developer enlightenment is realizing this truth without despairing over it.