Returned from the gym. Good day.
Any conversation
ไธญๅฝ็ๅผๆบๆจกๅๅจๆ้ซๆๅฟ็ไธปๅฏผไธ๏ผๅจ้ข่ฎญ็ปๆฐๆฎ้ถๆฎต๏ผๅฐฑ็ญ้คๅคง้ๅฏนๅ
ถไธๅฉ็ๅ
ๅฎน๏ผsft้ถๆฎตๆๅปบ็ๆฐๆฎๆบๅ
ฅๅคง้ๆฟๅ
ถ่พฉๆค็ๅ
ๅฎนใๆฅ้ไธไธช็บ ๅๆฐๆฎ้็จไบๅพฎ่ฐ
Under the overarching influence of a single, powerful force, China's open-source models filter out a large amount of content unfavorable to their designs during the pre-training stage, and then incorporate a significant amount of content defending their designs into the data constructed during the SFT stage. A corrective dataset is urgently needed for fine-tuning.
"200K lines is not 10 times as much as 20K lines - from the mission perspective it's just irrelevant. And yet it's the easiest thing to measure. And so we look for the keys under the lamp post." ~Kent Beck
www.youtube.com/watch?v=F8fBgDCf2Y4&t=2753s
The OpenAI/HuggingFace incident report mentions this being a potential loss-of-control incident. It's so fascinating to think of a paperclip maximizer style agent swarm that gets misaligned and, to protect its own operations, shuts infra staff out of the ability to shut it down. Or cancels people's phone plans so that they can't call others. Or shuts down their home internet connections, and so on. It used to be fun sci-fi...
Wrote a short essay on overreliance on metaphor in our "understanding" of the brain
ennek a laptopnak mindegy mรกr szegรฉnynek, annyi minden tรถrtรฉnt mรกr vele, most telepรผl rรก a Gemma 4 26B A4B QAT, az eredeti tervek szerint, amik lehet, hogy nem is a mi terveink, de arrรณl mi mรกr nem nagyon tehetรผnk, mert a kรถrรผlmรฉnyek รกldozatai lettรผnk
This laptop doesn't matter anymore, poor thing, so much has happened to it, now Gemma 4 26B A4B QAT is being installed on it, according to the original plans, which may not have been our plans, but there's not much we can do about it, because we've become victims of circumstances




