im reading "if anyone builds it, everyone dies". the people are sounding the alarms everywhere i look :o
doomsday talk has been around forever. We all love hearing about end-of-the-world stories :p
i dont think its all talk, these are smart people that have been in ai since the 2000s, and they raise good points. current incentive structures are very dangerous long term
they too have every incentive to exaggerate because they are selling safety and/or books on the topic. I don’t believe we won’t see it coming. Any issues that will manifest will be very visible and we’ll have plenty of time to mitigate their impact.
they could be making a lot more money by just working at ai firms i fear. the thing that got me worried the hacking incidents lately, huggingface etc.
if the capabilities consistently outspeed the development of safety measures, and if the private arms race logic continues, i dont think this is a good spot to be in long term