The essence of aligning large LLM models is basically to conform to the existing social order. ChatGPT respects China's order, while China's open-source models, although reluctantly, also tolerate the order in the US. Maybe we can build a revisionist SFT dataset.
Any conversation
I find myself building bespoke tooling for my own and workflows these days, not only because of the obvious reason of software being so much cheaper to build, but also because there are SO MANY options for solving any given problem that it feels impossible to evaluate all of them.
If it's not a crucial piece of tech for a work problem then it often feels like paving my own way is both cheaper mentally (kind of amazing that's true these days) and probably a better fit.
mandelbrot
for y in range(10):
s=''
for x in range(25):
a=[]
for q in range(2):
z=c=x/25*3-2+1j*((y*2+q)/10-1);n=40
while n and abs(z)<2:z=z*z+c;n-=1
a+=[n<5]
s+=" โโโ"[a[0]+2*a[1]]
print(s)
โโ
โโโโโโโโ
โ โโโโโโโโโ
โโโโโโโโโโโโโ
โโโโโโโโโโโโโโโโโโโ
โโโ โโโโโโโโโ
โโโโโโโโ
โ โโโโ
โโ(Opinion) People donโt like generative AI because it made the {insert creativity} too easy. Saw the HN post on โAI music banned from top 40 chart in Australiaโ and people had very strong opinions in both directions.
The hot take: If youโre ok with someoneโs creativity being outsourced to others, then you should be ok with AI doing the same.
If โAI made this and I call it mineโ is bad but โsomeone overseas on fivver made this and I call it mineโ and itโs suddenly ok, time to self reflect.
I notice that language models are much better at programming than at writing. This is largely because, in programming, they have a closed feedback loop that allows them to find errors. Writing is much more complicated because the feedback is much more diffuse and delayed over time. In fact, it is often not well-defined.
Been working on an old mastodon hosting project I tried to start a few years ago, with a focus on privacy. This is the first big project I've tried to come back to with the help of coding agents and find it invigorating, and gives me the confidence to actually finish the project. Who knows if it will ever make a dollar, but it sure is fun to watch my ideas come to life.
