NovaBlog

[Interesting content] InstructGPT, RLHF and SFT

Arize invited Long Ouyang and Ryan Lowe to their podcast to talk about InstructGPT, the model ChatGPT is based on, and the whole content is 🔥. Key takeaways: The concept of alignment (a term popularised by Stuart Russell from Berkeley, I link an interview with him in the comments). InstructGPT is based on GPT-3, but it is aware that it is getting instructions while the older model was only "tricked" into performing them.

"Empty Cups" is Charlie Puth's Magnum Opus

“Two words, nine letters. Say it and I’m yours.” -Not Blair Waldorf but me, re: “Empty Cups” After weeks, months, and seemingly years of teasing new music on TikTok in an extremely cringey yet flustering fashion, Charlie Puth finally released an all-new single last week entitled “Light Switch,” the first piece of the puzzle that is his now-confirmed upcoming album, Charlie. Now that the TikTok macroinfluencer is finally answering my years-long prayer for a follow-up to his last full-length album, Voicenotes, and since recently adding my favorite Puth-made track and the subject of this post back into my daily repertoire thanks to a Harry Styles- and Shawn Mendes-induced meltdown with the group chat the other night, it’s finally time I speak my truth.

"Mama Tried" - by Debra Esolen

I had to struggle a bit to decide on a song for this week, with “justice” as our word. The fact is there aren’t many songs about that specific topic to choose from unless we veer into the realm of social protest music, which by its topical nature often doesn’t outlive the cause it is written to serve. Then I thought, what better time to revisit Country and Western music, with its focus on some of the big virtues and their counterparts, the big vices?

"Nobody wants to meet with me. Nobody came to me and say, 'I'm sorry. We messed up. We made a mistak

"It is part of the Twilight Zone-like unreality into which this issue has plunged much of the Western world that a mother telling the story of her daughter’s suicide while under the influence of cross-sex hormones — crucially, in her mother’s account, doled out in lieu of counseling to address underlying mental health difficulties — is seen by the forces aligned with the right-thinking in our society as a purveyor of hate and harm.

"Theres so much horror in some beauty procedures..."

I first met award-winning artist, photographer and London native Juno Calypso a couple of months ago at an art fair. I joined a giant queue of people who, like me, had only bought entry tickets to get their hands on one of her limited edition prints. Thankfully I arrived early enough to snag one, or I would have legit cried tears of blood. (How dramatic! How goth! etc) There’s a distinct reason for her popularity; not only is she unbelievably talented but the way she captures the complexities of beauty standards and rituals through captivating and emotive self portraiture is unrivalled, and highly relatable.