12:59 pm Monday Nov 20, 2023: The absolutely bizzare story of Sam Altman’s forced ousting by OpenAI Board got even weirder and stranger over the weekend. If you are not in tech, I envy you. Your tech friends just binge watched 3 seasons of Succession and got left on a cliff hanger! But anyway, here are the sequence of events since Sam’s forced ousting on Friday

….And we are half way over yet with Monday.

“Concluding” Thoughts, aka WTF?

I’m sure the story will continue to develop, hence the “concluding” is in quotation marks. But here are some of my thoughts on this absolutely insane story. And this time - I would like you, the readers - to help answer/shed some lights on some of them.

“We call it Reinforcement Learning from Human Feedback. We can say that in the pre-training process, you want to learn everything about the world. With reinforcement learning from human feedback, we care about the outputs. We say, anytime the output is inappropriate, don't do this again. Every time the output does not make sense, don't do this again.And it learns quickly to produce good outputs. But it's the level of the outputs, which is not the case during the language model pre-training process. Now on the point of hallucinations, it has a propensity of making stuff up from time to time, and that's something that also greatly limits their usefulness.But I'm quite hopeful that by simply improving this subsequent reinforcement learning from human feedback step, we can teach it to not hallucinate. Now you could say is it really going to learn? My answer is, let's find out.

The danger of leaving AI’s fate in a few: AI might be the most important technology of this decade, and the decades to come. But the story unfolded this past weekend just shows us how incredibly flawed the people under peril of whose it’s being controlled are. Savvy tech + flawed humans = pretty disastrous combo, imho. Whether or not you feel hopeful or doomed about the future, going forward, very much depends on your predisposition and existing temperament to begin with. If Ilya the scientist can make a u-turn, i guess so can the future of humanity.

PS: So sorry that this story was extremely twitter-screenshot heavy. It’s not my fault that tech rank-and-files still latch on to that platform like moths despite everything. So I will leave you with this screenshot, from threads, instead. Until next time!