The essence of aligning large LLM models is basically to conform to the existing social order. ChatGPT respects China's order, while China's open-source models, although reluctantly, also tolerate the order in the US. Maybe we can build a revisionist SFT dataset.
Any conversation
what are ya'lls favorite wikipedia page?
I myself is partial to the 'variations' entry for high fives
Catastrophic interference is also a favorite Wikipedia page and concept. The thing is, it doesnโt only happen to artificial neural networks, Iโve had it happen to me a few times. Especially with pin numbers, newer pins overwriting old ones and Iโm always scared when Iโm having hard time remembering something that this catastrophic interference applied and now the information is gone from my brain.
there's no fundamental physical limit that prevents silicon from developing taste and judgement, but language is a lossy compression of reality.
taste comes from experience, from the shadowy mass of episodic memory, which swirls and convects at the boundary of consciousness. the ideas recombine into new ones in the nuclear reactor of the hippocampus.
but no matter how imbued with meaning and expertise is a handmade wardrobe we still get our shit from ikea
Reading Slow Productivity by Cal Newport, discovered via onboarding content in mymind mymind.com