I read
Still trying to figure out the boundaries of these tools' strengths without outsourcing important thinking, problem-solving, and the collective building-up of a mental model of the systems we're developing.
The shape of LLM tools as toolsโfit for a purpose, ergonomicโis becoming clearer, and human patterns of behavior with them that do more harm than good are also becoming easier to recognize.
Any conversation
The OpenAI/HuggingFace incident report mentions this being a potential loss-of-control incident. It's so fascinating to think of a paperclip maximizer style agent swarm that gets misaligned and, to protect its own operations, shuts infra staff out of the ability to shut it down. Or cancels people's phone plans so that they can't call others. Or shuts down their home internet connections, and so on. It used to be fun sci-fi...

