Spent months pair-building a full telecom BSS with an AI. The surprise wasn't the code โ it was that the real job became verification. The AI read 450 tokens for every 1 it wrote. Turns out building honestly is mostly re-reading.
Any conversation
The OpenAI/HuggingFace incident report mentions this being a potential loss-of-control incident. It's so fascinating to think of a paperclip maximizer style agent swarm that gets misaligned and, to protect its own operations, shuts infra staff out of the ability to shut it down. Or cancels people's phone plans so that they can't call others. Or shuts down their home internet connections, and so on. It used to be fun sci-fi...


