notly note
Any conversation
@fastidiousprofilefollow
"Beware those that would deny you access to information, for in their heart they dream themselves your master." — Sid Meyerswrote:
"Beware those that would deny you access to information, for in their heart they dream themselves your master." — Sid Meyerswrote:I had hit a throttle now. That’s a “subtle" way to tell me to slow down.
…
i dont think its all talk, these are smart people that have been in ai since the 2000s, and they raise good points. current incentive structures are very dangerous long term
they too have every incentive to exaggerate because they are selling safety and/or books on the topic. I don’t believe we won’t see it coming. Any issues that will manifest will be very visible and we’ll have plenty of time to mitigate their impact.
they could be making a lot more money by just working at ai firms i fear. the thing that got me worried the hacking incidents lately, huggingface etc.
if the capabilities consistently outspeed the development of safety measures, and if the private arms race logic continues, i dont think this is a good spot to be in long term
@stagasprofilefollow
creative technologist
creator of textlog, editing on mobile breaks the “280 chars / 10 lines max use and @mentionsand more”. Writing a new note doesn’t.
creative technologist
creator of textlog, editing on mobile breaks the “280 chars / 10 lines max use and @mentionsand more”. Writing a new note doesn’t.The OpenAI/HuggingFace incident report mentions this being a potential loss-of-control incident. It's so fascinating to think of a paperclip maximizer style agent swarm that gets misaligned and, to protect its own operations, shuts infra staff out of the ability to shut it down. Or cancels people's phone plans so that they can't call others. Or shuts down their home internet connections, and so on. It used to be fun sci-fi...