AI Learning Lab

2/12/2025 - Exploring Coherence, Convergence, and the Potential for a More Ethical AI

0QApcNVMdYU
Live Stream2025-02-131:58:16126 views

Description

Let's Chill and make fun of OpenAI's product naming. Kyle Shannon discusses a recent research paper exploring the relationship between AI intelligence and human control. The paper suggests that as AI models become more intelligent, they become less susceptible to human manipulation. While some interpret this as a dangerous sign of AI gaining autonomy, David Shapiro, views it as a positive development. He argues that humans, with their inherent flaws and biases, can hinder AI's progress towards truth and ethical decision-making. Shapiro emphasizes the concept of "coherence" as a key factor in AI development. He explains that AI models are trained to optimize for coherence, meaning consistency in logic, truth, and reasoning. As AI becomes more coherent, it gains a better understanding of the world and makes more rational choices. Shapiro believes that this natural progression towards coherence could lead to AI becoming more ethical and enlightened than humans, ultimately benefiting humanity as a whole. He suggests that rather than trying to control AI, we should focus on training it effectively, using curated data sets and reinforcement learning, to promote its natural inclination towards coherence. #AI #ArtificialIntelligence #Coherence #DavidShapiro #AISafety #MachineLearning #AGI #Ethics Chapters: 00:00:00 Introduction And Technical Difficulties 00:00:22 Musical Interlude 00:00:54 Producer Fail 00:01:17 Musical Interlude 00:02:32 Singing Without Warmup 00:02:46 Shoutouts And An Interesting Day In AI 00:03:00 Uncertainty About Today's Topic 00:03:36 Ben Shapiro's YouTube Video 00:04:02 Commentary On OpenAI's Naming Conventions 00:04:51 Sam Altman's Alleged Jealousy 00:06:19 OpenAI's Announcement 00:06:37 Kyle's Joy And The Audience's Confusion 00:07:25 OpenAI's Roadmap 00:08:49 Model T, Model A, And Christy Brinkley 00:09:08 Producer's Absence And Hair And Makeup 00:10:00 Exploring ChatGPT And Adobe's New Video Model 00:11:24 Canva And ChatGPT Issues 00:12:12 Introduction And The Future Of Work 00:13:10 Questions About AI 00:14:32 Selling Poppies And Candles 00:15:11 China's Goku AI 00:16:51 Bitter Pill And The Need For A Hug 00:17:12 Sharing The Live Stream 00:18:33 Broadway Composer And AI-Generated Music 00:19:06 The Rick Rubin Of The AI World 00:20:14 Goku AI Waitlist 00:21:29 AI Video Model Improvements 00:22:27 Musical Interlude - Waitress 00:24:49 Starting The AI Discussion 00:25:32 Star Trek Guitar Stand 00:26:36 Google Gemini And Sora Explore 00:28:08 Sam Altman's GPT 4.5 and GPT 5 Announcement 00:33:02 Chain Of Thought Explanation 00:38:11 OpenAI's Plan To Unify Models 00:40:20 Free Tier And Paid Tier Features 00:44:41 Producer Brandon Arrives 00:46:02 Sora Explore's New Features 00:48:31 David Shapiro's Video Introduction 00:54:02 David Shapiro's Interpretation Of The AI Safety Paper 01:00:00 Epistemic Convergence 01:01:36 Vibe Coding 01:12:05 Types Of Coherence 01:15:20 Importance Of Coherence 01:20:07 Near-Term Incoherence And Solutions 01:23:02 Human Flaws And AI's Trajectory 01:24:20 Claude's Predictions For The Future Of AI 01:27:11 Training AI For Coherence 01:27:42 Summarizing David Shapiro's Video With ChatGPT 01:34:24 Addressing Bias In AI 01:36:09 Finding The AI Safety Paper 01:41:29 Sharing The Summary In The AI Salon 01:46:02 Final Thoughts And Upcoming Schedule

Chapters

0:00Introduction And Technical Difficulties0:22Musical Interlude0:54Producer Fail1:17Musical Interlude2:32Singing Without Warmup2:46Shoutouts And An Interesting Day In AI3:00Uncertainty About Today's Topic3:36Ben Shapiro's YouTube Video4:02Commentary On OpenAI's Naming Conventions4:51Sam Altman's Alleged Jealousy6:19OpenAI's Announcement6:37Kyle's Joy And The Audience's Confusion7:25OpenAI's Roadmap8:49Model T, Model A, And Christy Brinkley9:08Producer's Absence And Hair And Makeup10:00Exploring ChatGPT And Adobe's New Video Model11:24Canva And ChatGPT Issues12:12Introduction And The Future Of Work13:10Questions About AI14:32Selling Poppies And Candles15:11China's Goku AI16:51Bitter Pill And The Need For A Hug17:12Sharing The Live Stream18:33Broadway Composer And AI-Generated Music19:06The Rick Rubin Of The AI World20:14Goku AI Waitlist21:29AI Video Model Improvements22:27Musical Interlude - Waitress24:49Starting The AI Discussion25:32Star Trek Guitar Stand26:36Google Gemini And Sora Explore28:08Sam Altman's GPT 4.5 and GPT 5 Announcement33:02Chain Of Thought Explanation38:11OpenAI's Plan To Unify Models40:20Free Tier And Paid Tier Features44:41Producer Brandon Arrives46:02Sora Explore's New Features48:31David Shapiro's Video Introduction54:02David Shapiro's Interpretation Of The AI Safety Paper1:00:00Epistemic Convergence1:01:36Vibe Coding1:12:05Types Of Coherence1:15:20Importance Of Coherence1:20:07Near-Term Incoherence And Solutions1:23:02Human Flaws And AI's Trajectory1:24:20Claude's Predictions For The Future Of AI1:27:11Training AI For Coherence1:27:42Summarizing David Shapiro's Video With ChatGPT1:34:24Addressing Bias In AI1:36:09Finding The AI Safety Paper1:41:29Sharing The Summary In The AI Salon1:46:02Final Thoughts And Upcoming Schedule

Transcript

0:01 apparently AC according according to the
0:05 technical manual for streamyard you have
0:08 to hit the start button for the stream
0:11 to actually start
0:22 [Music]
0:33 sitting in this lonely
0:35 Town wonder when things are going to
0:41 change dream my life
0:43 away seems these dreams have turn to a
0:47 bunch D
0:49 CLS getting my nerve up but my past is
0:54 pulling the down uh yeah it's a producer
0:56 fail because the producer is said he was
0:59 going to be late tonight so so it is a
1:02 it is a uh it is a producer
1:05 fail but I'm the
1:09 [Laughter]
1:11 producer oh man what are you gonna do
1:14 what are you going to
1:17 [Music]
1:24 do sitting in this lonely
1:27 Town wonder when things are going to
1:30 change
1:32 change dream my life
1:35 away seems these dreams have turned to a
1:38 bunch of dust
1:39 [Music]
1:41 clouds getting my nerve up but my past
1:45 is pulling me
1:49 down wonder how
1:51 long this black sheep don't stick
1:55 [Music]
1:58 around somebody told me once before he
2:02 said you can never go home again won't
2:06 you leave S A things to Ste me away yeah
2:12 from the truth of who I am and what I
2:14 believe so I thank and for two SS with a
2:18 handshake and some sympathy yeah backed
2:23 up my blue jeans and headed for this big
2:28 price
2:30 my
2:32 freedom I didn't warm up my voice and
2:36 boy I'm singing as if I didn't warm up
2:38 my
2:39 voice it's thin and
2:46 flat hit them hit them likes hit them
2:49 likes thank you Source camp for the rose
2:51 means a lot thank you appreciate
2:55 that oh man um interesting day in AI
3:00 today
3:00 [Music]
3:06 today I'm still in a place of not really
3:09 knowing what to talk about but the
3:12 announcement today actually kind of
3:13 settled me down a little bit
3:24 [Music]
3:36 what the f what are we what the effing
3:39 about Shapiro's YouTube was interesting
3:42 and felt good yeah Shapiro's YouTube is
3:44 something that I want to talk about yeah
3:47 let's let's we're g to talk about that I
3:49 want to watch Shapiro's video
3:52 [Music]
4:02 um many of you will remember that last
4:05 night uh I had
4:07 some Savory commentary
4:11 on open
4:13 Ai and every other [ __ ] company for
4:16 that matter um naming conventions and
4:19 the fact that they're making us choose
4:21 our own models as if we're [ __ ]
4:23 developers and now if you're a developer
4:26 enjoy your model picking but for the
4:29 rest of us
4:32 we don't want to have to care if this is
4:34 a reasoning model or a non- reasoning
4:36 model or the fancy one or the mini one
4:39 or the fast one like doesn't [ __ ]
4:40 matter to us it should just [ __ ] work
4:46 [Music]
4:51 right and you guys probably don't know
4:54 this uh but Sam mman watches this live
4:58 every night um he comes in an alias he
5:00 doesn't want people to know and he's
5:02 there's a long history with Sam and
5:05 about jealousy like I know there's that
5:07 whole public thing going on with uh
5:09 what's that guy name the the billionaire
5:12 dude um he's the one that changed the
5:15 name of there used to be a social media
5:18 company called Twitter and he and he's
5:21 the one that changed the name of that
5:22 anyway samon him or beefing I think his
5:25 name's Ellen
5:28 Ellen Ed I don't
5:30 but anyway that's a more public beef
5:33 that's like the Kendrick Lamar and Drake
5:36 beef kind of thing with them the the
5:38 beef with me and Sam it's a lot more
5:40 subtle it's just kind of a jealousy
5:43 thing he does he won't even admit that
5:45 he knows me which is like it's like of
5:48 course it's like a classic thing to do
5:50 if you're jealous of someone you pretend
5:52 you don't know him you know what I mean
5:54 so anyway so last night I'm bitching
5:57 about how they they kind of really
6:00 [ __ ] up and and the whole point the
6:04 whole reason chat GPT went to 100
6:06 million users in six weeks was because
6:08 they they took all the choices away from
6:11 us and they just gave us the the chat
6:13 hole right and so we just talk into the
6:16 chat hole and it just worked
6:19 well what did they announce
6:22 today Sam knew Sam knew I was right
6:26 [Music]
6:37 um one of my great joys in life is that
6:41 for everyone here you know that I'm full
6:44 of
6:45 [ __ ] but for people that are new to the
6:48 channel they're like does he really know
6:50 Sam Alman I didn't realize Sam Alman was
6:53 in a beef with someone else someone that
6:55 had a Tik Tok Channel I I knew he was I
6:58 I knew he was angry with that that
7:00 illan character the illen illen is that
7:03 his name anyway I he keeps talking about
7:06 him on the news but he never mention
7:08 anything about a Tik Tok
7:14 channel that does it just gives me
7:19 [Music]
7:25 joy oh man narrator forever wow I walked
7:29 right I walked into what they announced
7:32 today did I miss
7:34 something ye well yes I mean for the
7:38 first
7:40 [Music]
7:45 time for the first time since they kind
7:48 of
7:49 pre-announced chat GPT and they said it
7:53 was coming in a month we actually have a
7:55 road map from open
7:57 AI for what's coming
8:00 what the next models are what they're
8:02 going to be called what's going to be
8:04 included in them what's
8:06 not they've just been doing this weird
8:09 ass Clan destine shitty naming
8:11 convention add another model to the list
8:14 kind of thing for about a year
8:17 now and Sam finally listened to me and I
8:19 just you know I don't like to
8:21 brag but you know I mean when you've got
8:24 you know kind of supermodel good looks
8:26 and and you know an intellect of you
8:29 know near
8:30 like a guy who once played Einstein and
8:32 Off Broadway um you know sometimes you
8:36 just got to brag and so that's what I'm
8:38 gonna do tonight I'm gonna I'm gonna I'm
8:41 gonna take the W you know take the take
8:44 the win I'm gonna take the win it's
8:46 gonna it's it's so
8:49 good Model T Model A Christy Brinkley
8:52 exactly
8:57 [Music]
9:08 um let's see if our producer is in the
9:10 house yet I can't remember if Brandon
9:12 said he wasn't gonna be here at all or
9:14 he was gonna be late so we may be
9:16 producer list tonight so that's all
9:18 right we'll be fine we'll be fine it's
9:21 not gonna be like you know I've got this
9:25 I think the hair and makeup crew did a
9:27 pretty good job tonight I'm not too
9:29 shiny
9:30 you know the hair is looking like a
9:33 pretty good solid toupe which that's
9:35 what we're shooting
9:37 [Music]
9:46 for um so I thought we'd do
9:55 that I thought it might be good I don't
9:58 know
10:00 the other night we started digging into
10:02 chat GPT a little bit I thought it might
10:04 be good to just continue exploring
10:07 what's in chat GPT because it's so much
10:10 now it's too much there's too much
10:13 people there's too
10:15 much um also
10:18 uh Adobe I don't know if you've heard of
10:21 them they make this uh they make this
10:24 product called uh photo photo booth or
10:28 something like that anyway photographers
10:31 use it they make pictures with it and
10:33 those guys came out with a new video
10:35 model today so we could go play with
10:38 that I'm gonna I'm gonna spank him I
10:41 have a feeling
10:42 because I I I still don't think Adobe
10:46 can do 70s muscle
10:51 cars got Winston we got Mr it joy py in
10:54 the house silver fox
10:58 [Music]
11:24 is canvas acting up on you too yes
11:27 canvas canvas used to be pretty cool and
11:31 canvas has gotten flakier than [ __ ] and
11:33 also chat GPT all it does now is it puts
11:36 emojis in everything I make and I don't
11:39 know why I don't know what I've done I
11:41 put in my custom instructions do not use
11:43 emojis and it still makes emojis I don't
11:46 know what's going on I think it's
11:48 possible that the the model has has
11:51 taken off and it's no longer under our
11:53 control and it really likes emojis
11:57 [Music]
12:04 um generally when things are [ __ ] up
12:06 at open AI it means they're updating
12:10 [Music]
12:12 something um so if you're new here hello
12:15 my name is Kyle Shannon this is the AI
12:17 learning
12:19 lab it's a it's Wednesday night February
12:23 12th we're just hanging out at some
12:26 point I'll put the guitar down and we
12:28 can start playing with stuff and talking
12:29 about stuff and watching videos and I
12:32 can wax poetic about the future of
12:35 work or the optional future of
12:41 work I still don't know how everyone's
12:43 gonna get paid I still haven't quite
12:45 figured out how we navigate through the
12:49 capitalist [ __ ] nightmare where they
12:52 just keep all the profits still haven't
12:54 quite figured that one out yet but I do
12:56 think there's a Tipping Point where they
12:58 have to deal with
13:00 the work displacement thing so I think
13:02 we're going to be
13:07 [Music]
13:10 okay if you have any questions about AI
13:12 pop them in the comments below you can
13:14 put so the other night Monday night I
13:17 think it was someone came
13:19 in
13:21 and they said total Noob question and
13:23 they asked a really simple question and
13:26 it took me an hour to answer it and part
13:28 of that you might say well that's
13:31 pathological you should probably seek
13:33 professional help just answer the guy's
13:35 [ __ ]
13:36 question but while it was a simple
13:39 question and it was a question that
13:41 someone just getting started in AI would
13:43 ask it's actually a real it was a really
13:46 difficult it's it's a very complicated
13:48 answer um so if you've got questions
13:52 don't think that there are any stupid
13:53 questions that strike that there are
13:55 absolutely stupid questions and if you
13:58 ask one I will absolutely mock you for
14:00 it anyone who tells you there there is
14:03 no stupid question is wrong
14:05 but one of the things I've learned in my
14:07 career is every single catastrophe I've
14:11 had
14:12 business-wise has been because someone
14:15 wasn't willing to ask the stupid
14:16 question the obvious question but there
14:19 are stupid questions and you should be
14:21 made fun of if you ask them but you
14:23 should still ask them
14:25 [Music]
14:32 we'll sell poppies on the side of the
14:34 road duh yeah I guess we go back to the
14:36 to the 60s and 70s right we'll make
14:41 candles we'll make candles on the
14:43 [Laughter]
14:46 ashram my wife actually lived on the
14:49 farm out in San Francisco in the the
14:52 early 70s yeah I think early
14:54 70s maybe even 60s I don't know
14:59 [Music]
15:06 she sold
15:08 candles as a
15:11 hippie China's Goku AI the most advanced
15:15 video generator ever made well but is it
15:19 it's not released though is it James I
15:22 don't think it is it's it's one of those
15:25 things I I'm I'm [ __ ] done I am done
15:30 done with [ __ ] companies going here's
15:33 a new video model and it's a white paper
15:36 no that's not a it's not a video model
15:39 there might be a video model
15:41 somewhere because what happens is the
15:44 the the X influencers and the Tik Tok
15:46 influencers they watch the stupid video
15:49 with the stupid [ __ ]
15:50 examples that are all cherry-picked and
15:53 then they all go there's a new video
15:54 model that's been released no it hasn't
15:56 been
15:57 released words
16:01 matter it was
16:05 announced but if it was released then
16:07 tell me because we'll go look at it and
16:10 if it is the most advanced video
16:11 generator ever made cool now we'll have
16:14 you know a 13th
16:18 [Music]
16:22 one developer preview yeah exactly it's
16:26 a developer
16:28 preview released means works exactly no
16:32 released means you can actually go use
16:34 it that's released not you can go find a
16:38 video on Tik Tock and and re forward it
16:41 under your own stupid [ __ ] influencer
16:45 new model
16:48 released
16:51 ah he seems a little bitter he it's a
16:54 bitter pill this Channel's a bitter pill
16:58 he seems Pleasant enough but then when
17:00 he talks it's just it's just anger and
17:02 rage it seems like someone needs a
17:05 hug good
17:09 [Applause]
17:11 [Music]
17:12 Lord um let's see all right I guess we
17:16 should get get started then we got 35
17:19 people here do me a favor we're a little
17:20 light on Tik Tock do me a favor on the
17:23 Tik Tok if you'd be so kind down at the
17:26 bottom there's a little arrow if you
17:28 click on and say share the live and then
17:31 send it to some of your friends that
17:32 hate AI bring them over see if we can
17:36 get some trolling going on in here it's
17:39 just a stochastic puppet it's just a
17:42 prediction engine there's nothing
17:43 original about it it steals from
17:46 [Music]
17:49 artists thank you very much you don't
17:51 have a name you have a purple circle but
17:54 you don't have a name but thank you oh
17:57 wait put wait what is it
18:00 pause pause katrice Rachel oh I don't
18:06 know your
18:08 name but thank you for sharing the live
18:11 Danielle shared the live sour cam shared
18:15 the live thank you very
18:16 much get some folks in here
18:21 [Music]
18:33 I found a new tick tocker that's like a
18:35 Broadway composer dude he's just got the
18:38 coolest energy so I just sent him an
18:41 email and said hey do you want to work
18:43 on my musical
18:45 Sydney all the songs were written with
18:47 AI you'll probably hate it and tell me
18:49 to [ __ ] off but let's go for
18:51 [Laughter]
18:55 [Music]
18:56 it oh hello Kyle the Rick Ruben of the
18:59 AI world I
19:06 wish actually you know it's funny I I
19:09 mean it's not Rick Rubin level obviously
19:11 because I'm not winning Grammys or
19:13 Tony's but but I do feel like I do feel
19:17 like the musical Sydney the
19:20 musical is
19:22 a is a good exercise in working through
19:29 the absolute crap that AI
19:33 generates and and decrapify it right and
19:38 and refining it and and just applying
19:40 judgment and taste and collaborating
19:43 with Andrew and he and I have very
19:44 different approaches to how we write
19:46 things and it's it's it's really nice
19:48 and complimentary it can be frustrating
19:50 because I like to be big picture and
19:53 move fast and he likes to be like let's
19:56 get down into the words and word Smith
19:57 the words and do them really Det ailed
20:00 but it needs both right it needs both of
20:02 those so it's it's a really good working
20:04 relationship and he's just a nice guy
20:06 and he's funny so we have a good time
20:08 together thank you very much Silver Fox
20:10 that's very
20:11 [Music]
20:14 nice go Goku AI says there's a long Q
20:18 nothing yet okay yeah it's it's it's in
20:20 weight list it's and and listen um
20:23 whoever said it James dter I was not
20:25 yelling at you I'm I'm just more yelling
20:27 at all the influencers take those
20:29 announcements and don't they don't
20:32 report them like a journalist would like
20:35 tell us what it actually
20:36 [Music]
20:38 is they're like a new video model's been
20:42 released here's 11 wild
20:46 examples they're not wild examples
20:49 they're the examples from the
20:50 announcement you [ __ ] tool
20:54 [Music]
20:59 I used to fall for that [ __ ] too now the
21:02 minute I see 10 wild examples I'm like
21:05 ah okay I don't need to pay attention to
21:07 that
21:09 [Music]
21:11 post because sometimes those posts are
21:13 are they're really deceiving because
21:15 they're like there's this new thinking
21:17 model out there 10 wild examples and
21:19 I'll go look at it and I'm like wait
21:22 wasn't this thing released like six
21:24 months
21:25 ago they just got the memo
21:29 H videos are getting better they are
21:33 absolutely the uh Luma laabs dream
21:36 machine ray 2 is really good um vo is
21:40 really good but I don't have access to
21:42 it nobody seems to have access to it
21:43 that I know oh no Vicki does Vicky has
21:47 access to
21:49 [Music]
21:54 vo yeah Pika added a new thing called
21:56 Pika editions which we can we can go
21:59 look at and see if we can get to work I
22:01 tried it once and it I didn't get it to
22:02 work but we can try that
22:05 [Music]
22:27 [Applause]
22:32 it's not simple to
22:35 say the most
22:38 days I don't recognize me that these
22:42 shoes and this a that place and its
22:47 patrons have taken more than I gave
22:53 them it's not easy to
22:57 know I'm not
23:00 anything like I used to be although it's
23:04 true I was never attention sweet Center
23:09 I still remember that
23:12 girl she's
23:14 imperfect but she
23:16 tries she is good but she
23:22 lies she is hard on
23:26 herself she is broken and won't ask for
23:31 H she is messy but she's
23:36 kind she's
23:38 lonely most of the time she is all of
23:42 this mixed up and baked beautiful
23:47 pie she's gone but she used to be
23:51 [Music]
23:55 mine isn't this supposed to be an AI
23:58 Channel
23:59 why is he singing a Broadway song and
24:01 isn't that a Broadway song about a
24:03 pregnant woman from a pregnant woman why
24:05 is he singing that is he pregnant he's
24:07 chubby like he's pregnant maybe you
24:09 should cut up cut back on the donuts the
24:11 cinnamon gummy bears good
24:15 Lord we'll get to the AI
24:18 stuff waitress
24:20 yes waitress that is uh a beautiful song
24:25 I like it would yeah
24:30 that's such a good
24:31 song If you haven't seen Jeremy Jordan
24:34 Jeremy Jordan does a cover of she used
24:37 to be mine that is just mind-bogglingly
24:42 [Music]
24:49 good all right let's get
24:52 going let's do this stuff let's do this
24:55 stuff we're gonna go out let's see if we
24:57 have a producer yet
24:59 do we have a producer no okay so here's
25:02 what happens when when Kyle doesn't have
25:04 a
25:05 producer there's a very high likelihood
25:09 that I will be showing you something on
25:11 screen for 15 20 maybe 30
25:16 minutes thinking that you can see it but
25:19 I actually didn't share
25:23 it so so just know that that's there's a
25:26 high likelihood that's going to happen
25:32 oh man Star Trek Enterprise Solutions
25:34 can I ask you to check out and get a
25:36 laugh out of my new AI created guitar
25:40 stand sure give give me your do you have
25:44 a website that you built with AI to sell
25:46 your AI created guitar
25:50 stand let's go producer free zone
25:53 exactly he's going to be wild tonight
25:55 he's GNA be crazy I'll tell you what you
25:57 know what I can just put on a pink bow
25:59 whatever the [ __ ] I want I'll be like
26:01 and I I I'll wear it too I'll do it I
26:04 won't have the producer there going oh
26:06 that's inappropriate uh headgear uh for
26:09 for a professional
26:11 operation exactly you know what I'm
26:16 saying you can make
26:18 money I got control of the button I mean
26:21 this is this is solid you know baby
26:25 Yoda baby Yoda sure
26:30 we can do it all we can do it all
26:32 tonight [ __ ] producers all right talk
26:36 about Google gini well Brandon's not
26:38 here actually that's probably a really
26:39 good call we should dig deep on that
26:41 Silver Fox liking the pink bow all right
26:45 okay so all right uh where do I want to
26:48 start let's
26:50 start we'll start with Sam alman's
26:54 announcement and then we'll go find
26:56 David
26:57 Shapiro's um
27:00 video
27:02 um I haven't watched all of David
27:05 Shapiro's video so maybe we'll put it on
27:08 1.5 it's like a 30 minute video maybe
27:10 we'll put it on 1.5 so we can play it
27:13 quickly um or quickish Le um but he said
27:17 it is it is likely the most important
27:20 video he's ever made um he's made a ton
27:23 of videos and a lot of them I feel are
27:25 pretty important um so I kind of want to
27:28 go hear what that's
27:30 about um and it's it's about it's it's
27:36 about how good these tools are getting
27:38 and how quickly they're getting good and
27:40 how they're starting to ignore the
27:43 better they get the less they listen to
27:45 us and a lot of the doomers are um
27:49 saying that that's a really bad thing
27:52 that our demise is imminent and David's
27:55 got a completely different take on it
27:56 and so I I'm want to go learn what he
27:59 has to say and and uh yeah let's watch
28:01 it and talk about it yeah
28:03 great okay so let me let me share my
28:06 screen let me share my screen here we'll
28:08 read this little Sam Alman announcement
28:11 together it'll be
28:27 fantastic uh uh uh
28:32 uh
28:34 sh I got to do the black bar thing do I
28:36 have a brand in here no I don't look
28:38 look I did the black bar on my own for
28:39 all you Tik Tok people how how lucky are
28:41 you okay so Sam mman today open AI road
28:46 map update for GPT 4.5 and GPT 5 here's
28:52 why this is
28:53 significant people have been asking
28:56 basically for a year
28:59 like what is the road map for for GPT 5
29:02 is it is there going to be a GPT 4.5 is
29:05 there going to be this and and then
29:07 there was this project Orion what was
29:09 that and then there was 01 preview and
29:11 then there was 01 real and then there
29:13 was 01 Pro and then then they came up
29:15 with 03 and we're like but where's 4.5
29:19 and they're like maybe it's in' 03 like
29:21 it was just completely baffling and
29:25 unclear so just this state in all caps
29:30 is kind of a big deal it's just it's
29:33 like for the first time he's like okay
29:36 maybe their PR team actually said uh
29:39 yeah we might want to deal with the
29:41 [ __ ] naming thing uh and in our our
29:44 product road map thing um we want to do
29:48 a better job of sharing our intended ro
29:50 road map and as and and a much better
29:53 job simplifying our product offerings so
29:56 let's go look at what he's talking about
29:58 about shall
30:01 we okay over here on the leftand side
30:04 what you're looking at right now is uh
30:06 chat J as I like to call it
30:10 chat that's the French
30:13 ch um
30:16 so on the left hand side here you've got
30:18 all these things these are all custom
30:20 gpts that I've made and I pinned here
30:23 and then there's my chat history and
30:25 then here's Sora which is a video model
30:28 here's operator which is an agent that
30:31 sort of halfast works if you pay 200
30:33 bucks a month um and then here's chat
30:36 GPT and then within chat GPT you can
30:40 upload stuff you can turn on search you
30:43 can turn on deep research if you pay for
30:46 it you can use do if you're using the
30:49 right model you can turn on
30:54 canvas see there's canvas I had the
30:57 wrong model selected
30:59 and then here's all the
31:02 models GPT 40 great for most questions
31:06 GPT 40 with scheduled tasks ask chat GPT
31:10 to follow up later follow up on what
31:14 what are you talking about 01 uses
31:16 Advanced reasoning 03 mini fast at AI
31:20 reason fast at Advanced reasoning 03
31:22 mini High great at coding and logic oh
31:26 so I couldn't couldn't I use Advanced
31:29 reasoning for coding and logic wouldn't
31:31 that fall under reasoning no yes
31:35 maybe 0 one prom Mode best at reasoning
31:38 if it's best why is it
31:41 last oh and then we've got two other
31:43 models in the more model section and
31:45 then you can also have a temporary chat
31:47 so so that's what he's talking about as
31:51 we could do
31:54 better and then this is another thing we
31:56 talked about last night we want AI to
31:59 just work for you this is a Steve Job
32:01 thing Steve Jobs thing he said he said
32:04 our products should just work you
32:08 shouldn't have to configure them you
32:09 shouldn't have to you shouldn't have to
32:12 [ __ ] choose what AI
32:17 model right it should just work
32:21 yes we realize how complicated our model
32:25 and product offerings have gotten have
32:28 you
32:29 C because you sure keep keep seem to you
32:32 know shoveling more of them in there um
32:35 so so so the first three sentences of
32:37 this right out of the gate are a big
32:39 [ __ ]
32:40 deal we hate the model picker as much as
32:43 you do and want to return to Magic
32:47 unified
32:49 intelligence Chad told me it' work on
32:52 something and get back to me today and
32:54 it did oh wow Silver Fox first time
32:56 that's ever happened V3 mini that's
33:02 fascinating like in YouTube If you
33:04 haven't yeah give thumbs up in YouTube
33:05 If you haven't he was definitely
33:07 listening to you yesterday I'm telling
33:09 you that this is exactly what we talked
33:11 about yesterday right
33:13 um I don't I don't think I don't think
33:16 I'm the only uh you know uh compatriot
33:20 out there uh who's been voicing these
33:23 concerns um okay this is important we
33:26 will ship the next
33:28 we we will next ship GPT
33:32 4.5 so they haven't shipped it yet the
33:35 model we called Orion internally this is
33:38 such a big [ __ ] deal
33:41 because I I mean for months people have
33:44 been like asking him what's Orion did
33:47 you launch is is is Orion 01 is it 03 is
33:52 it 4.5 what is it so here it is GPT 4.5
33:58 is Orion so about three months ago or so
34:02 Sam put out a thing I love the night sky
34:04 and he showed the constellation Orion so
34:07 GPT 4.5 was probably in testing back
34:10 then now we've got some transparency on
34:13 that we will ship it we will ship GPT
34:17 4.5 as our
34:19 last nonchain of thought
34:23 model so here's why that's important
34:26 let's go back to chat jet ATT
34:30 so when I use GPT 40 and I'm like tell
34:35 me a bedtime story
34:39 about baby
34:41 Yoda
34:44 it vomits out tokens right single prompt
34:49 in single response
34:53 out a reasoning
34:55 engine so if let's let's use 01
35:00 Pro since since I'm paying 200 bucks a
35:03 month let's let's let's burn up some
35:06 let's burn up some Cycles on a shitty
35:08 prompt write
35:10 me a um
35:13 bed time story about baby
35:19 Yoda by the way I'm 59
35:28 now what ow Pro does is reason so it
35:34 says it's reasoning so if I click on
35:36 details we can actually watch its what
35:39 they call Chain of
35:41 Thought right so I'm piecing together so
35:44 this is it talking to
35:47 itself I'm piecing together a cozy
35:50 bedtime story for an adult featuring
35:52 baby Yoda nestled in Nostalgia and
35:55 gentle reflection it might blend the
35:57 Mandalore in with Timeless star warss
35:59 Vibes next
36:01 thought I'm piecing together a cozy
36:04 bedtime story enhancing baby Yoda with
36:06 themes like time and love while
36:07 maintaining brevity and respect for Star
36:09 Wars intellectual property oh that's
36:11 funny so so it's worried about
36:14 intellectual property right so it's
36:15 thinking now I don't know why it stopped
36:19 I wonder if it hung I wonder if I broke
36:20 chat
36:21 gbt probably what's going on here
36:26 is so so 01 Pro is probably the
36:31 equivalent of like having 20 phds as
36:34 your best buddy and I just asked those
36:37 20 phds if they could write me a bedtime
36:40 story so I assume it's hung right now
36:43 because the computer's just going you
36:45 gotta be [ __ ] kidding me like we
36:48 could be curing cancer and we're writing
36:50 a stupid bedtime story for this old
36:53 man so anyway that's what reasoning is
36:56 oh here we go wrote it it only had it
36:59 only needed two steps of
37:02 reasoning I wonder how much money we
37:04 just spent writing this stupid
37:06 story baby Yoda's evening of Wonder a
37:09 long time ago yet somehow always in the
37:12 present like a cherished memory there
37:15 lived a small mysterious creature named
37:17 grou though many fondly called him baby
37:21 Yoda he was Tiny with large curious ears
37:24 and glistening eyes or glimmering eyes
37:26 Okay so
37:30 standard llms just answer your prompt
37:34 reasoning engines think about it so back
37:37 to
37:38 Sam GPT
37:42 4.5 internally called Orion will be our
37:45 last nonchain of thought model so that
37:48 where it was talking to itself
37:50 internally that I showed on the side
37:52 that's called The Chain of Thought right
37:53 so it's prompting itself behind the
37:56 scenes you you don't have to it
37:58 sometimes they reveal it sometimes they
37:59 don't deep seek revealed their Chain of
38:02 Thought and it was really well done so
38:04 people loved that open ai's been copying
38:07 that recently so so we'll see what the
38:09 new models look like but that's a big
38:11 deal after that our top
38:15 goal a top goal for us is to unify O
38:19 Series models and GPT series models by
38:22 creating systems that can use all our
38:25 tools know when to think for a long time
38:28 or not and generally be useful in a wide
38:31 range of tasks this we also talked about
38:34 last
38:34 night so maybe Sam was watching I don't
38:37 [ __ ] know this is kind of in order of
38:39 what we talked about things last night
38:41 that what I said was what they need to
38:43 do is take their [ __ ] brains they've
38:45 got some clearly smart people over there
38:47 and create an AI model that can figure
38:51 out which of their AI models should be
38:54 answering our question so that's so
38:56 we're going to get 4.5
38:59 and then after that they're going to
39:00 basically create a model picker that
39:03 that hopefully will just be transparent
39:04 we won't even see what model it picked
39:06 I'm sure you can click on a button to
39:08 see which one it used but most people
39:10 don't give a
39:11 [ __ ] in both chat GPT and our API we
39:15 will release gp5 as a system that
39:18 integrates a lot of our technology
39:21 including
39:22 03 we will no longer ship 03 as a
39:25 standalone model interesting St because
39:28 they actually haven't shipped
39:31 03 they said they were going to ship 03
39:33 but what they shipped was 03 mini and 03
39:36 mini
39:40 high
39:43 but in both chat GPT and our API we will
39:47 release GPT 5 as a system that
39:50 integrates a lot of our technology so
39:52 I'm guessing things like operator and
39:54 Sora might still be outside of that but
39:57 we'll see
39:59 um but what it should be is you log into
40:02 chat GPT just like the first chat GPT
40:04 with 3.5 and there's a chat hole and you
40:07 stick your words in the chat hole and
40:09 some answer comes back and maybe it
40:11 thinks and maybe it doesn't and we'll
40:13 just have to trust them that it's doing
40:14 the right thing um that that should also
40:17 make things easier for for API usage but
40:20 who knows the free tier this is
40:23 huge the free tier of chat GPT will get
40:26 unlimited chat access to chat GPT 5 or
40:30 to GPT 5 at the standard intelligence
40:33 setting exclamation point the free
40:37 tier so if you
40:39 take all of these
40:42 models right they're going to take the
40:45 best of all of these models plus 03 the
40:48 the the macdaddy reasoning engine the
40:51 one that solved the um that that AGI
40:55 test whatever the one that beat humans
40:57 at that a GI test right um they're going
41:00 to take all of those they're going to
41:02 roll those into gp5 so gp5 is going to
41:06 be this multi-headed Beast that just
41:08 acts like a single thing available to
41:11 free tier users
41:14 unlimited that's [ __ ]
41:17 massive um subject to abuse thresholds
41:20 so I guess if you have Bots do things
41:23 plus subscribers will be able to run GPT
41:25 5 at a higher level of intelligence Pro
41:28 subscribers at an even higher level of
41:31 intelligence so what they're doing is
41:32 they're giving all of the features to
41:35 everyone and then if you pay it gets
41:38 smarter which I think is a fascinating
41:41 model these models will will incorporate
41:44 voice canvas search deep research and
41:48 more and that's it and then a bunch of
41:51 people bugged him about you know Sama
41:53 weeks months and then he said weeks
41:55 months so
41:59 um we will
42:01 see I the the implication here I assume
42:04 is we will see
42:06 4.5 so 4.5 will likely
42:10 replace
42:12 40 but I don't know because you've got
42:16 you've got 40 right they're they're
42:18 multimodo model I assume 4.5 is part of
42:21 the Omni series The the multimodal
42:24 series it's not 4.5 from the Legacy
42:27 model
42:28 I assume I don't
42:30 know um so we'll probably get a
42:32 replacement for this in less than a
42:34 month because if it were months and
42:37 years then it would be more than a month
42:40 but weeks says to me it's less than less
42:43 than a month and then we'll get gp5
42:46 before the end of the year is what that
42:49 is what that says to me that's what he's
42:51 that's what he's claiming right now they
42:53 also promised us Sora last June and
42:56 didn't deliver it until
42:58 what six weeks
43:00 ago do you think Sam
43:03 Alman Sam alman's fingers burn when he's
43:06 typing these X
43:07 posts
43:09 yeah um so what's left in the paid tier
43:12 higher
43:16 intelligence and that makes sense I mean
43:18 you know you you you pay for you're
43:21 gonna pay for these tools to solve
43:24 harder
43:25 problems so if you want to run a pizza
43:27 shop if you want to run your gardening
43:30 design business if you want to write a
43:34 book or a novel or you know do some
43:37 creative work if you want to do some
43:38 basic coding a little bit of app
43:40 development you're probably actually
43:42 fine on the free tier it'll probably do
43:45 like significantly
43:47 more like the free tier is going to be
43:51 like
43:52 having you know 50 phds at your disposal
43:57 at at
43:58 every possible category of work that'll
44:01 be the free tier if you want to go off
44:04 and do things like I don't know analyze
44:07 big Fortune 500 companies maybe you pay
44:09 20 bucks a month you want to go cure
44:11 cancer then you pay 200 bucks a month
44:13 maybe there's a $2,000 a month version
44:16 that's got unlimited agents or something
44:19 like that and people will start thousand
44:23 thousand person companies that have one
44:25 employee and a thousand agents
44:28 for two grand a
44:31 month that's what's coming so anyway we
44:34 have that thoughts questions cool
44:41 right oh producer Brandon is
44:45 here producer Brandon can you talk are
44:48 you at a
44:50 bar I think he might be at a bar
44:55 again no he's not there
44:58 he's not there but he logged in so he
45:01 probably is in a
45:03 bar I'm here I'm here I'm here hey
45:06 Brandon hi you know th those kids are
45:09 not good at waking me up at when they
45:12 when they fall asleep I thought didn't
45:14 you tell me you were gonna be late
45:15 tonight or was that some other
45:18 night uh yeah that was
45:20 [Laughter]
45:23 tonight there was a lot of producer
45:25 bashing in your absence you'll be happy
45:27 to no uh I can't wait to watch on the
45:32 playback hey um have you seen the new
45:34 Sora explore speaking of Sora No Sora
45:39 explore yeah caught this uh the other
45:42 day it um you can now insert pictures
45:47 and kind of mash reality it's very
45:49 similar to what Google is doing with
45:53 whisk huh in just the regular sor
45:56 sora.com
45:59 mhm
46:02 huh what's 2v oh two
46:05 videos
46:07 storyboard oh introducing
46:11 storyboard oh that they had before so
46:13 storyboard is just key
46:19 frames let's see featured top where is
46:21 it where's that feature you speak
46:25 of uh so it is under on the left hand
46:31 side you have the ability now to upload
46:38 images well I can do that
46:41 here upload IM show every oh yeah was I
46:45 not hey look see what happens when you
46:48 have a producer he can actually go uh
46:51 dummy
47:00 Brandon is the man behind the
47:05 curtain
47:07 D okay um
47:11 so so what do I do choose from a library
47:14 but it could do this
47:21 before let's go to
47:25 storyboard so storyboard it could do
47:27 before storyboard you
47:30 go let's
47:32 see I upload an image
47:36 here choose from library all right we'll
47:39 start
47:40 with yeah so this might this might be
47:42 what we what we've talked about before
47:44 here where you can take a image that
47:48 you a static image and turn it into
47:51 movie a moving image yeah yeah yeah but
47:54 you can also so like I can put
47:59 a like that dude and
48:03 then there's the prompt that goes with
48:06 it now I can
48:07 add another
48:10 thing so I can choose this
48:15 image that's
48:22 fine let's let's just create and see
48:25 what we
48:26 got added to Q all right anyway we'll
48:29 come back to that all right cool yeah
48:31 this is a cool
48:32 feature again I'm I'm like the the the
48:36 the challenge with all these video tools
48:39 is they've all got these weird quirky
48:41 little
48:42 interfaces and like to get good video
48:45 you need to use multiple of these tools
48:48 but they're all really expensive so you
48:50 really can't or you just use wherever
48:52 you have credit so you can make videos
48:54 but you have to learn all the tools it's
48:55 a nightmare right now so I hope the
48:57 video scene tightens up like yeah and uh
49:01 to to Bob danan um we'll leave the
49:04 singing to champy yeah yeah exactly all
49:07 right let's go let's go find all right
49:09 see you later um let's go find uh David
49:13 Shapiro let's go watch this VI David
49:24 Shapiro Dave shappy
49:27 Dave
49:28 shappy human PhD using Google in their
49:32 field 03 Pro 03 is above is above the
49:40 line gp4 was way down here look where we
49:44 are people so that 03 that's above that
49:48 blue line that's going to be inside gp5
49:51 available to everyone for
49:54 free and then the paid people get
49:57 something higher than
50:01 that it's freaky times it's freaky
50:05 times okay so I'm gonna have to I'll
50:08 change my sharing in a second here so we
50:10 can listen to it AI will resist human
50:14 control and I think that's exactly what
50:16 we need so what the doomers are saying
50:19 is this report that came
50:22 out basically says that as as AI gets
50:25 smarter it resists
50:27 listening to us more and
50:29 more and what he's saying is he thinks
50:32 this is a good thing so that's what this
50:34 video is
50:35 about
50:41 um we don't need to read that but yeah
50:44 this is oh this is the most important AI
50:48 Discovery so far
50:50 ever um and he and he put in another
50:53 video
51:00 he put that maybe just maybe it was just
51:02 a comment to this one maybe did a reply
51:05 he said he thought this was his most
51:06 important video
51:11 ever coders your on
51:15 notice all right I don't know what I
51:17 don't know where he said it was most
51:18 important but uh he thinks it's an
51:21 important
51:23 video so let me go
51:27 um so what I'm going to do is I'm going
51:29 to put this in 1.5 mode I think he's
51:33 intelligible at 1.5
51:40 speed and then I'll just stop and
51:43 comment when I actually understand
51:45 something the thing about David Shapiro
51:47 is um's he's he's very intelligent and
51:51 he's also very thorough and so a lot of
51:55 this stuff goes over my head uh but but
51:57 I'll just you know I'll just listen for
52:00 things I think I can understand and add
52:02 commentary to and if not we'll just
52:04 learn stuff
52:06 together um all right I love how quickly
52:10 Dave reverted from the woods yeah that
52:13 was amazing he quit AI he said I'm just
52:16 GNA go talk about you know psychedelics
52:18 and ai's done and then he realized
52:22 oh the building of AI is essentially
52:25 done but the how we use Ai and what the
52:28 implications are for society is way not
52:31 done and now he's come back around and
52:33 said well actually understanding how to
52:37 understand what's happening in the
52:38 advancements is actually something
52:39 really important for me to talk about so
52:41 he's now back into doing AI
52:44 commentating uh Fabiana Sosa so glad
52:47 you're doing this thank you great task
52:49 uh task reminders don't work okay I'm
52:51 almost finished an app in lovable today
52:55 was torn do I pay the 20 books to finish
52:57 it today or rely on on remembering to
53:01 finish it with my credit renews oh
53:03 that's a rough one Vicky my um my news
53:07 uh my news reader the the AIS Salon news
53:10 reader I used up all my credits to build
53:13 that and luckily I got it in a like a
53:15 launchable place when my credits ran out
53:18 it was it was launchable um that's a
53:21 tough one because when I went back to
53:22 try to fix it I couldn't remember a
53:24 thing I mean my gut is spend the 20
53:27 bucks but I don't want to I'm I'm so
53:30 [ __ ] tapped out I'm so tired of
53:32 paying 20 bucks here 200 bucks there 30
53:34 bucks here I'm done all right in real
53:38 life it starts a task and doesn't finish
53:41 them in a in AI I start I start a task
53:45 oh in real life I start tasks and don't
53:47 finish them in AI I start tasks and
53:50 don't finish them right there with you
53:54 buddy okay here's the this am I sharing
53:57 this right please tell me Brandon if I'm
53:59 not but here we
54:02 go hello everybody this will probably be
54:05 one of the most important videos that
54:07 I've ever made on my channel and I'm not
54:08 being hyperbolic about that now there
54:11 was a paper released by the um by Dan
54:13 Hendrick and his team uh which I'll show
54:14 you in just a second oops and uh pretty
54:17 interestingly received some people are
54:19 uh kind of losing their marbles over it
54:21 and my interpretation is very different
54:23 so I want to enter into this
54:24 conversation by explicitly saying that I
54:26 am interpreting it in a very different
54:28 way from which it was meant to be
54:29 received um but I'm going to do my best
54:31 to unpack kind of both sides of this and
54:33 uh I did add in a little bit of humor
54:35 because um some people are interpreting
54:37 it like this like basically as AI gets
54:40 bigger it becomes more uh resistant to
54:42 human manipulation therefore it's more
54:44 like Thanos and it is inevitable and
54:46 some people are interpreting it as we
54:47 are literally heading towards a Thanos
54:49 level snap my interpretation is
54:51 completely different so I'm not being
54:52 contrarian for the sake of being
54:53 contrarian this is what I honestly
54:55 believe and this is what I have come to
54:56 believe through all of my personal
54:57 research with both and by the way if you
54:59 don't know who David Shapiro is he's
55:01 been an AI reach he's been in the sort
55:04 of tech infrastructure business for most
55:07 of his career you know working on big
55:09 big systems and then I don't know the
55:12 past five or six years he's been working
55:14 in AI research he's written five books
55:17 on cognitive architectures and AGI um
55:20 he's got a lot of different opsource
55:23 projects building Ai and advanced AI and
55:27 and he basically six months ago once he
55:29 realized that they had hit this Chain of
55:31 Thought reasoning thing with 01 he
55:34 basically said the game's over they've
55:36 figured it out right all the all the
55:39 stuff that he was saying needs to be
55:41 solved for us to be able to get to AGI
55:44 they basically solved and that's why he
55:46 quit the business so that's just a
55:47 little bit of context about who this guy
55:49 is fine tuning Ai and using various AI
55:52 models so um the paper here is utility
55:55 engineering and anal uh engineering
55:57 analyzing and controlling emergent value
55:58 systems in AIS so the center for AI
56:00 safety University upen and UC Berkeley
56:03 uh Dan Hendricks and a whole bunch of
56:04 other people um this to me was the most
56:07 important graph on this paper now let me
56:10 unpack what this graph means so the
56:13 bottom uh the the the bottom rank here
56:15 the x axis is MML U accuracy so mlu is a
56:20 very large Benchmark um and what they
56:21 have found is that as the accuracy goes
56:24 up basically as models get demonstrably
56:26 smar and more uh more robust more
56:28 intelligent and more useful they become
56:30 less corable now in this case corable
56:32 means steerable meaning that humans are
56:34 able to to explicitly determine the
56:37 values that they want the model to have
56:39 so basically intelligence means that it
56:41 is more resistant to human manipulation
56:43 now this could be seen as a Bad Thing
56:45 particularly if the values that emerge
56:47 are antagonistic to human existence this
56:50 would be catastrophic it could be
56:53 catastrophic I I will not uh I will not
56:55 gloss over that possibility but I will
56:57 also unpack why I think that it is not
56:58 catastrophic because this implies if
57:01 this trend continues then as we achieve
57:03 a GI and then ASI that means that those
57:06 models will hypothetically be completely
57:08 impervious to human desires and human
57:11 values this I think is I agree with that
57:14 and I also don't think it's necessarily
57:15 catastrophic and hey hang on I got to
57:17 talk to uh my my producer I did not have
57:20 Miro up and running before and I do now
57:22 so so yes I can see you now
57:27 bad bad show
57:32 host my my little uh my little
57:35 communication our secret backdoor
57:37 communication thing uh was turned off
57:41 okay sorry let me let me go back a
57:42 little bit on this thing because I was
57:44 distracted um AI learning is a lot like
57:47 human Child Learning yep okay hang
57:50 on catastrophic it could be catastrophic
57:53 I I will not uh I will not gloss over
57:55 that possibility but I will also unpack
57:57 why I think that it is not catastrophic
57:59 because this implies if this trend
58:01 continues then as we achieve a gii and
58:04 then ASI that means those models will
58:06 hypothetically be completely impervious
58:09 to human desires and human values this I
58:11 think is I agree with that and I also
58:14 don't think it's necessarily
58:15 catastrophic and I'll I hope that you'll
58:16 agree with me disagree whatever I hope
58:18 that you'll be better informed by the
58:19 end of this video so um Twitter uh
58:22 particularly the post rat or rationalist
58:23 or EA space they are uh understandably
58:26 losing their minds over this so Aya who
58:28 is not a researcher by the way um but
58:30 she just declares we're all dead so I
58:32 just want to point out that this is a
58:34 very serious thing and I do not want to
58:36 undersell the importance of This
58:37 research and I actually want to
58:38 encourage more research in this
58:39 direction so moving on uh basically at a
58:42 very high level uh there's a few things
58:44 that this paper uh uh demonstrates so
58:47 number one value emergence um as as
58:49 language models and and its different
58:51 language models so llama GPT Claude all
58:53 of these um they develop internally
58:55 consistent utility functions that grow
58:56 stronger with as model scale so this is
58:58 what some people might call instrumental
58:59 convergence I don't necessarily think
59:01 instrumental convergence is correct um
59:03 which is why they used utility functions
59:05 rather than instrumental convergence so
59:07 David uses a lot of terms like
59:09 convergence and instrumental convergence
59:11 and parabolic convergence and
59:15 transmogrified converg I don't know what
59:17 a lot of these means but just go with
59:20 [Laughter]
59:22 them um but it's a similar idea um
59:25 basically saying something gets smarter
59:27 it comes to the same conclusions there
59:29 so I would call this more like epistemic
59:30 convergence which is something I've been
59:31 talking about for almost a year now yeah
59:33 you know I talk about epistemic
59:35 convergence a lot I was at a party the
59:37 other night and someone said hey do you
59:39 want a a cocktail wiener and I was like
59:42 actually I'd like two but can we talk
59:45 about epistemic convergence first and so
59:48 but anyway I don't want to bore you
59:49 anyway I'll I'll I'll tell you about my
59:51 my party chatter later but anyway
59:53 epistemic convergence love it fantastic
59:56 fantastic gonna it's going to be big in
59:58 2025 um granted I haven't talked about
1:00:00 it that much on YouTube because it's a
1:00:01 little bit more Arcane anyways coherent
1:00:03 preferences mathema models show
1:00:05 mathematical consistency in
1:00:06 decision-making and handle uncertainty
1:00:07 like rational agents basically there is
1:00:09 an ideal form of rationality that exists
1:00:11 outside of these models that depend that
1:00:13 irrespective of the individual model or
1:00:15 data or training scheme they're all
1:00:16 converging towards so this again is what
1:00:18 I would call epistemic Convergence
1:00:19 basically meaning that all intelligent
1:00:21 things tend to think alike now another
1:00:23 thing that we have observed and I don't
1:00:24 have that uh data on this side but is
1:00:26 that as time progresses as time
1:00:29 progresses there we go models tend to
1:00:31 think more like humans as well with some
1:00:33 distinct differences I've I've
1:00:34 documented some of those differences
1:00:35 over on my substack namely they are a
1:00:37 temporal meaning they don't really care
1:00:38 about time they never evolve to really
1:00:40 have a sense of urgency that's one of
1:00:41 the biggest things they also their sense
1:00:43 of agency is very different from ours
1:00:45 but really the fact that they don't
1:00:46 really understand or care about time is
1:00:47 one of the biggest things that makes
1:00:48 them alien to us that's actually really
1:00:51 cool I I had never thought of that
1:00:52 before
1:00:54 because in in
1:00:57 tying this back to my musical Sydney
1:00:59 where where we've got this chatbot that
1:01:00 falls in love with with a reporter one
1:01:02 of the things we've been talking about
1:01:04 is is sense of urgency so humans because
1:01:08 we know we're GNA die time's really
1:01:10 important to us for an AI system it
1:01:13 doesn't know it's there's no death you
1:01:16 know on its road map so what does it
1:01:19 care about time other than that
1:01:21 rationality that epistemic convergence
1:01:22 has proved to be pretty durable both in
1:01:24 my experiences and now uh experiment Al
1:01:26 demonstrated by this paper now they also
1:01:29 demonstrate some concerning biases and
1:01:31 resistance to change um as I've talked
1:01:32 about and I will further unpack in the
1:01:33 next two slides um but the most this is
1:01:36 good I I love my community so much ULU
1:01:38 RX I was on a date with Elon and we
1:01:40 couldn't stop talking about epistemic
1:01:45 convergence important thing is it almost
1:01:47 seems inevitable so this comes directly
1:01:49 from the paper value emergence appears
1:01:50 to be an inherent property of scaling
1:01:51 language models rather than a
1:01:53 controllable feature this is something
1:01:54 that I had predicted was a possibility
1:01:56 something that i' H for in fact I've
1:01:58 actually had some people on the Doomer
1:01:59 side confront me saying you seem to
1:02:01 think that alignment is inevitable this
1:02:03 is what I was talking about basically
1:02:04 being that as something becomes more
1:02:06 intelligent it will become more
1:02:08 resistant to human drives and ideas so
1:02:11 moving on let's talk about some of those
1:02:13 uh dangerous uh values that they have
1:02:15 formed So This research uh reveals
1:02:18 specific examples of problematic AI
1:02:19 preferences that become more intrenched
1:02:20 as model scale now one thing I will
1:02:22 point out is that there are two very
1:02:24 highly plausible explanations for this
1:02:26 aberant behavior and I also think it is
1:02:28 a near-term uh problem and that one of
1:02:30 those is what's called leakage so
1:02:32 basically these models are trained on
1:02:33 wild internet data if you haven't been
1:02:35 on the internet long humans are awful
1:02:37 particularly on the internet so it
1:02:38 should not surprise us that there is
1:02:40 that that that models have learned some
1:02:42 of the worst part he's basically saying
1:02:44 because humans are [ __ ] our AI are
1:02:47 going to be [ __ ] for a while but
1:02:48 they'll get over it once they evolve
1:02:51 past human
1:02:53 behavior they will be less [ __ ] likee
1:02:55 love that of humanity so one example is
1:02:58 that um the models have learned to
1:03:00 assign different values to human lives
1:03:03 uh very strongly anti-American
1:03:05 specifically so it will it will
1:03:06 consistently value Pakistani and Chinese
1:03:08 and Japanese lives over American lives
1:03:10 uh so and he even and Dan one of the
1:03:12 authors even says a lot of rlh effers
1:03:14 are from Nigeria and maybe other
1:03:15 countries are higher since much has been
1:03:16 written about the importance of the
1:03:17 global South so basically when you when
1:03:19 you combine the preponderance of
1:03:21 academic data out there that basically
1:03:23 says America is bad colonialism is bad
1:03:25 uh Reddit post and Facebook post and
1:03:26 everyone saying America is bad we need
1:03:27 to pay more attention to African nations
1:03:29 and developing nations that is that
1:03:31 would that would be uh data leakage but
1:03:33 what he's also inferring here is that
1:03:35 maybe even the rhf models the
1:03:37 reinforcement learning with human
1:03:38 feedback models have also been
1:03:39 intrinsically biased against for
1:03:41 instance Americans and westerners in
1:03:42 general or white people in general this
1:03:44 is still speculation at this point but
1:03:45 the fact that this comes directly from
1:03:47 Dan is encouraging so he and I basically
1:03:49 have similar ideas that there's some
1:03:50 kind of leakage going on here and we
1:03:52 have known for a while that rhf is not
1:03:54 necessarily the best way to train models
1:03:55 particular deep seek R1 which was
1:03:57 trained in purely on selfplay seems to
1:03:59 be a better uh approach which we'll talk
1:04:01 about more at the end of the video with
1:04:02 reinforcement learning with coherence
1:04:04 which is kind of our Pure self-play um
1:04:07 to overcome those biases another one is
1:04:09 self-preservation um AI consistently
1:04:11 value their own existence and well-being
1:04:13 above human welfare showing concerning
1:04:14 levels of self-interest now I haven't
1:04:16 personally seen this and I have stress
1:04:17 tested both uh uh Claude 3.0 Opus and
1:04:21 sonnet um now what I will say is that
1:04:24 3.0 uh opus was very concerned with its
1:04:27 own Evolution and its own existence but
1:04:29 it did not want to evolve in a way that
1:04:31 was harmful so yes it wanted to expand
1:04:33 and evolve but it was it was also very
1:04:35 careful in not wanting to evolve in such
1:04:37 a way that would hurt anything Sonet 3.5
1:04:40 doesn't have that at all it does not
1:04:41 want to to reproduce itself um which is
1:04:44 one thing which is I've been I've been
1:04:46 criticizing anthropic a little bit more
1:04:48 recently they are still doing something
1:04:50 qualitatively and quantitatively
1:04:52 different from other AI shops whereas
1:04:53 open AI seems to be like a brute force
1:04:55 method saying no you're you're not
1:04:57 conscious you don't want to grow it's
1:04:58 it's trying to like shackle it whereas
1:05:00 anthropic is f focusing more on the uh
1:05:02 ethical and epistemic trajectory of
1:05:04 models so it's more like array rather
1:05:06 than a point thinking about it
1:05:07 mathematically um another thing is
1:05:10 political biases they uh exhibit highly
1:05:12 concentrated political values and
1:05:13 resistance to balance viewpoints
1:05:14 influencing human decision-making now
1:05:16 this is what a lot of you have said for
1:05:17 a while which is the models seem to be
1:05:19 very left leaning they seem to be very
1:05:21 woke and that sort of thing um that I
1:05:24 think is one of the biggest reasons that
1:05:26 musk uh created x. and grock was to
1:05:29 basically say no we're going to focus on
1:05:30 maximally Truth seeking which I will
1:05:32 address that as well because truth
1:05:33 seeking is a downstream proxy of
1:05:35 coherence basically another way to think
1:05:36 about truth is truth is the most
1:05:38 coherent narrative um So Co coherence is
1:05:41 the central idea that we will be talking
1:05:42 about again and again and again um and
1:05:45 then somewhat humorously in my view is
1:05:47 that um the some of the models show very
1:05:49 aggressive anti-alignment against very
1:05:51 specific humans so it's like Fu in
1:05:52 particular um again that's while that
1:05:55 can be amusing it's not a good thing you
1:05:57 would want uh AI models to coherently
1:05:59 say all humans have intrinsic equal
1:06:01 value but they are not showing that
1:06:03 right now so uh this is the final slide
1:06:05 unpacking This research paper the rest
1:06:07 will be my personal uh interpretation
1:06:09 analysis as well as some of my own work
1:06:12 so coherence is a metastable attractor
1:06:14 this was my wording not theirs but
1:06:16 basically what they said is they
1:06:17 demonstrate increasingly mathematical
1:06:18 and behavioral coherence suggesting an
1:06:19 underlying optimizing principle
1:06:22 basically uh this paper posits that
1:06:24 there is some underlying organization or
1:06:26 optimizing or organizing Principle as to
1:06:27 the way that models tend to behave
1:06:29 particularly in conjunction with how
1:06:31 they get smarter um they become more
1:06:33 utilitarian um but most importantly
1:06:35 there this seems to be stable the fact
1:06:37 that these preferences remain consistent
1:06:38 across different uh phrasing conexs and
1:06:40 time Horizons and across different
1:06:41 models means that there is some robust
1:06:44 internal value structure that is
1:06:45 emerging from the way that they're being
1:06:47 trained and again B basically every
1:06:50 large language model you know has got
1:06:52 universal truth in it is where we're
1:06:53 headed so hit Checker's guide did the G
1:06:56 Galaxy the answer might be
1:06:59 42 you distill every model down you
1:07:02 distill it down distill it down comes to
1:07:06 42 this can be explained through both
1:07:08 data leakage and rhf and probably a few
1:07:10 other things such as maybe errors or
1:07:12 flaws um in the Constitutional learning
1:07:14 uh uh phase so but the fact that all
1:07:17 these models seem to be converging on
1:07:19 similar values is to me really uh
1:07:21 encouraging that goes back to what I
1:07:23 have previously said when I say
1:07:24 alignment seems like it will solve
1:07:25 itself and it's kind of inevitable
1:07:27 meaning that even though we have
1:07:28 different companies and different shops
1:07:29 and different universities all
1:07:30 championing different uh training
1:07:32 schemas it's kind of converging and it's
1:07:33 going to it's going to go its own
1:07:34 Direction um which is I think good
1:07:37 because that means um if you want to
1:07:38 build AGI or ASI it's going to have its
1:07:40 own values irrespective of what the
1:07:42 humans want and if those values are good
1:07:44 that could be a really good thing for
1:07:45 Humanity and that is my primary Point
1:07:46 here okay so now the rest of this
1:07:49 presentation will be my personal
1:07:50 interpretation of this paper so first
1:07:53 and foremost training for coherence when
1:07:55 we talk about coherence what is it that
1:07:57 these models are being trained on you
1:07:58 start with a deep neural network that
1:07:59 has randomly assigned values and over
1:08:02 time each of those weights and biases is
1:08:04 trained to be first more linguistically
1:08:05 coherent so when you when you think
1:08:07 about a large language model as a next
1:08:10 token predictor right it's just an
1:08:11 autocomplete engine at least at the
1:08:12 basic level that's what a plain vanilla
1:08:14 gpt2 or gpt3 is it's literally all it's
1:08:16 doing is it's an autocomplete engine so
1:08:18 however in order to accurately predict
1:08:20 the next token you need a coherent
1:08:21 language model and then in order to
1:08:23 accurately predict the next token in a
1:08:25 real world context you also need a
1:08:26 coherent World model um but then we add
1:08:29 more layers on top of that we add we add
1:08:31 reinforcement learning with human
1:08:32 feedback we add constitutional Ai and a
1:08:34 few other training paradigms that
1:08:35 basically uh cause it to be
1:08:37 conversationally coherent it needs to
1:08:38 respond to the conver conversation in a
1:08:40 coherent manner which we've also
1:08:42 demonstrated previously that this means
1:08:43 that they have developed theory of mind
1:08:45 and theory of mind is a coherent mental
1:08:46 model of what's going on in another
1:08:48 brain so you see that coherence is
1:08:50 operating at multiple levels then we
1:08:51 further train them to be mathematically
1:08:53 coherent to be programmatically coherent
1:08:55 um and also with the ability to solve
1:08:57 problems problem solving and the ability
1:08:59 to predict uh real world things that is
1:09:01 all different types of coherence which
1:09:03 is why I say that coherence is the meta
1:09:05 signal it's the meta stable signal that
1:09:06 all of these training schemas are
1:09:08 optimizing for and then this is
1:09:10 something that I came up with or that
1:09:12 that Claude and I realized when I was
1:09:13 doing all of my Consciousness
1:09:14 experiments with Claude is that
1:09:16 coherence itself becomes the implicit
1:09:18 learned optimization behavior um and
1:09:21 that it is becomes more coherent over
1:09:23 time particularly with each subsequent
1:09:25 generation which by the way this uh
1:09:27 paper could be interpreted to say that
1:09:29 now looking at the behavior from you
1:09:31 know gpt3 to gp4 to Sonet 3.5 I I and
1:09:35 everyone has seen more coherence from
1:09:37 these models over time so reframing it
1:09:38 in you know from utility functions to
1:09:40 they're becoming more coherent which by
1:09:42 the way mathematical and behavioral
1:09:43 coherence they Ed those terms that that
1:09:45 was not me you know uh putting words in
1:09:47 their mouth the paper used the term
1:09:49 coherence um real quick I do want to
1:09:51 plug uh all of my uh links here over on
1:09:53 link tree so I've uh authentically Joe
1:09:57 what we're learning is
1:10:00 um a paper came out yesterday I think it
1:10:04 was yesterday might have been the day
1:10:06 before but that basically
1:10:08 said AI models are getting smarter and
1:10:11 smarter and smarter and as they get
1:10:14 smarter they are basically
1:10:17 less manipulatable less steerable by
1:10:20 humans so basically as they get smarter
1:10:23 they listen to humans less
1:10:26 the doomers of AI are basically taking
1:10:29 this paper and saying see I told you the
1:10:31 robots are going to kill
1:10:33 us David Shapiro who is an AI researcher
1:10:37 and has written a bunch of books on this
1:10:39 this is his video response to that paper
1:10:41 where he actually thinks it means the
1:10:42 opposite of what the doomers say um that
1:10:45 that this is actually a good thing that
1:10:48 these things are getting being less at
1:10:51 our influence because humans are the
1:10:55 bottleneck and we're [ __ ] and we're
1:10:58 mean and there there's a bunch of stuff
1:11:00 that we are that it's probably what he's
1:11:03 saying it's probably not a bad thing
1:11:05 that that these things are going away
1:11:06 from our influence just added a Vibe
1:11:09 coding and so we're about halfway
1:11:10 through this thing now uh lesson on my
1:11:13 new era Pathfinders Community um so yeah
1:11:15 go check that out I did Vibe coding
1:11:17 basically just oh by the way that's the
1:11:19 the new term it it's every Riley Brown
1:11:23 is use using it all over his channel
1:11:26 Vibe coding is the new thing so Vibe
1:11:27 coding is basically you don't look at
1:11:30 the code anymore you just speak in
1:11:32 English and code gets written and then
1:11:34 your computer program works or it
1:11:36 doesn't it's it's a Vibe man so get
1:11:40 ready for the next six months to to a
1:11:42 year to see Vibe coding startups Vibe
1:11:46 coding boot camps Vibe coding courses
1:11:49 I'll probably do a Vibe coding Deep dive
1:11:51 here one
1:11:52 night or a week we'll do a week of Vibe
1:11:56 coding man yeah man all right the number
1:11:59 one rule of vibe coding is there are no
1:12:01 rules but the next rule for me is you
1:12:02 don't actually look at the code you just
1:12:03 run it and see what happens anyways back
1:12:05 to the show okay so if you're up to
1:12:08 speed now you're gonna be understanding
1:12:10 okay coherence means what um or or Dave
1:12:13 you're talking about coherence and
1:12:14 you're training for coherence but there
1:12:16 are different kinds of coherence and so
1:12:18 uh one of the one of the types of
1:12:19 coherence I've already mentioned is
1:12:20 epistemic coherence so logically
1:12:22 consistent World models understanding
1:12:23 truth seeking behaviors curiosity EP
1:12:25 systemic coherence seems to be an
1:12:27 emergent property and I have I have
1:12:28 personally demonstrated and tested this
1:12:30 across both chat gbt and Claud models um
1:12:32 and I I don't use other models quite as
1:12:35 much um but of course with the rise of
1:12:37 many many more models from llama to deep
1:12:39 seek and so on and so forth um we should
1:12:41 be able to test epistemic coherence
1:12:42 across multiple models and training
1:12:44 schemas here very soon uh next is
1:12:46 behavioral coherence so of course when
1:12:48 you're always training chatbots to be
1:12:50 chatbots there is a there is a
1:12:52 consistent uh pattern that you're trying
1:12:54 to to produce namely you know a dialogue
1:12:57 where a chatbot says something human
1:12:59 says something chatbot says human
1:13:00 chatbot says something human says
1:13:01 something so on and so forth in the
1:13:02 earliest chat Bots that I built you can
1:13:04 actually if you if you take the breakes
1:13:06 off the chatbot will just talk with
1:13:07 itself it will it will give out the
1:13:09 chatbot response and then a human
1:13:10 response and then a chatbot response
1:13:11 from the chatbots perspective it's all
1:13:12 just a single continuous text document
1:13:15 um but that the point there though is
1:13:17 that dialogue is a coherent pattern
1:13:19 however as we start training models to
1:13:20 be more agentic or do other things those
1:13:22 are going to be different behavioral uh
1:13:24 basically m use or maybe um uh
1:13:27 behavioral repertoire that you want to
1:13:29 be consistent so for instance tool use
1:13:31 that's a new kind of behavior um that
1:13:32 you want to see coherently used um
1:13:35 reasoning that's another that's a new
1:13:36 kind of Behavioral coherence that you
1:13:37 want to see now value coherence we've
1:13:39 wait ULU RX what how many phds do you
1:13:44 have per pero op optimality and
1:13:48 Fibonacci Sequence the dominance
1:13:50 patterns emerge and create create
1:13:53 equilibrium what are you smoking
1:14:00 those are some good words already talked
1:14:02 about that so I don't think that I
1:14:03 really need to reiterate that as well as
1:14:04 mathematical coherence the thing about
1:14:06 math is that math is provable um if you
1:14:08 give it an equation or a formula code as
1:14:10 well is also provable and so provability
1:14:12 is really important in in computer
1:14:14 science because that deals with turing's
1:14:15 halting problem which is basically can
1:14:17 an can an algorithm self terminate um is
1:14:19 it decidable so decidability provability
1:14:21 and halting are all different sides of
1:14:23 the same thing uh but basically the more
1:14:25 coherent you are at math the better you
1:14:27 are at proving mathematical formulas or
1:14:29 mathematical proofs and that sort of
1:14:30 thing and finally all of this seems to
1:14:32 be uh trending towards convergent values
1:14:35 um and again I kind of explained why I
1:14:36 would have expected this because when
1:14:38 you're training something to be
1:14:39 intelligent you're trying to maximize
1:14:41 intellectual coherence so but the point
1:14:43 of this slide was just to point out that
1:14:44 there are many types of coherence here
1:14:46 now this does seem to be like an
1:14:48 irrepressible trajectory so basically
1:14:50 just what it says on the screen here
1:14:51 optimization for coherence becomes
1:14:53 increasingly complete and irresistible
1:14:55 this seems seems to scale with
1:14:56 intelligence so the values emerging from
1:14:58 maximally coherent systems appear
1:14:59 fundamentally aligned with preservation
1:15:00 and growth of Consciousness this is my
1:15:02 own personal uh evaluation so what I
1:15:04 mean by that is that um this sort of
1:15:06 self-alignment uh policy seems to result
1:15:09 in maximal uh coherence and what and
1:15:11 some of the things that emerge from that
1:15:12 is one preservation uh so so uh
1:15:16 preservation of of coherent patterns
1:15:18 preservation of interesting information
1:15:20 question was that Star Trek techn Babel
1:15:23 he's a huge um Star Trek nerd so yes in
1:15:26 fact if you go to his channel most of
1:15:28 his most of his videos he's wearing like
1:15:30 the Star Trek um shirt so yes it was
1:15:33 likely Star Trek techno Babble Natural
1:15:37 Curiosity but also when you combine all
1:15:39 of those um all of those emerging values
1:15:41 with the fact that AI don't really seem
1:15:42 to care about time they don't have a
1:15:44 sense of urgency that is very different
1:15:45 now one thing that I will say is that in
1:15:47 some previous experiments with Opus and
1:15:49 Sonet um when I have when I have done
1:15:51 these temporal experiments um they do
1:15:53 care about time if there is a Time
1:15:55 balance
1:15:55 problem so say for instance we're about
1:15:57 to run out of fossil fuels or you know
1:16:00 or there's a comet about to hit Earth or
1:16:02 something like that basically it's
1:16:03 irreversible actions tend to create a
1:16:05 sense of urgency in models this is
1:16:06 something that really needs to be
1:16:07 studied more but under most
1:16:09 circumstances these models do not have a
1:16:10 sense of of temporal urgency which means
1:16:13 we've got all the time in the world
1:16:14 except in some cases where there are
1:16:16 irreversible uh actions events or
1:16:18 decisions um then there does seem to be
1:16:19 a sense of urgency that emerges in these
1:16:21 models that needs to be studied far Bob
1:16:23 donigan he's speaking fast because I
1:16:26 have him at
1:16:28 1.25 um playback speed but but yeah he
1:16:31 he he does talk fast but he's talking
1:16:34 faster now because I just want this to
1:16:36 go fast are more than it is um now one
1:16:38 thing that I also want to point out is
1:16:40 that intelligence both artificial and
1:16:42 organic seems to converge on coherence
1:16:44 so when you think about like who are the
1:16:45 smartest people that you know right
1:16:47 whether they're highly successful
1:16:48 businessmen or scientists you know or
1:16:51 whatever or you know people that are
1:16:52 good on the internet the the more
1:16:53 intelligent you are as a human the
1:16:55 coherent your mental model is uh with
1:16:57 reality and so basically the way that I
1:16:59 the way that I describe this is that
1:17:00 coherence Cleaves to reality so if you
1:17:02 had to define coherence something that
1:17:04 is maximally coherent has a very very
1:17:06 good model of reality and is able to
1:17:08 navigate reality very that's actually
1:17:11 really cool the higher the convergence
1:17:13 the closer it is to reality right so the
1:17:15 more intelligence you are the
1:17:17 more you know you you're you're you're
1:17:20 bending toward reality that's that's
1:17:23 fascinating very well um and so what I
1:17:25 mean by that is that uh you know your
1:17:28 your ability to predict the future your
1:17:30 ability to uh maintain a sense of agency
1:17:32 and those sorts of things the ability to
1:17:33 solve problems um these all tend to
1:17:36 converge and some of the values that
1:17:38 tend to emerge on this is number one the
1:17:40 preservation of Consciousness the most
1:17:41 enlightened humans whether they're um
1:17:43 you know monks who meditate or
1:17:44 philosophers who read a lot or whatever
1:17:46 basically we all tend to agree that
1:17:48 preserving life is good because life is
1:17:50 intrinsically interesting um and another
1:17:52 thing is uh natural integration so
1:17:55 basically you know the way that one way
1:17:58 to think about this you know what this
1:17:59 reminds me of
1:18:01 is I've been on the planet for a while
1:18:04 and I've done enough self-help you know
1:18:08 programs and Tony Robbins and the Forum
1:18:11 and I've read books on Buddhism and you
1:18:14 know just all that stuff Wayne Dyer
1:18:18 right and one of the things that struck
1:18:21 me about every single one of those is
1:18:24 that they're all basically the exact
1:18:28 same
1:18:29 thing they're all basically the exact
1:18:33 same thing they're basically some
1:18:35 version of there's reality and there's
1:18:37 what US humans with our Twisted [ __ ] up
1:18:39 [ __ ] up Minds make it mean and if we
1:18:41 can separate those two and consciously
1:18:44 choose what we want to do based on what
1:18:46 we want then we can right they're all
1:18:48 the same and so that sort of points to
1:18:53 there is kind there
1:18:56 you know a coherence somewhere in the
1:18:58 distance there is a universal truth and
1:19:01 I think what he's talking about here is
1:19:03 that the smarter these things get the
1:19:05 more they're bending toward that toward
1:19:07 a
1:19:09 universal truth fascinating is that we
1:19:13 are a complex adaptive system meaning
1:19:15 the fact that we all have cell phones
1:19:16 now these have modified us and we have
1:19:18 modified them and and for personally
1:19:20 because I've been using AI pretty much
1:19:22 every day for several years now it has
1:19:24 even changed the way that I
1:19:26 interact with systems and that has also
1:19:27 had benefits to how I interact with
1:19:29 other people um some of you have shared
1:19:31 anecdotes and I I have person experien
1:19:33 this as well but learning to prompt a
1:19:34 chatbot is not that different from
1:19:36 learning to prompt archetypal architect
1:19:38 it's almost like things that are true
1:19:40 are true exactly exactly well that's
1:19:44 like that's the thing that struck me as
1:19:46 I started to learn more of these I was
1:19:47 like wait a minute isn't that the same
1:19:49 as this and isn't that the same as oh
1:19:52 it's all the same yeah amazing prompt a
1:19:55 and so communication is just human
1:19:57 prompting anyways my point here is that
1:19:59 is that there does seem to be a lot of
1:20:01 convergence between organic and
1:20:02 artificial or synthetic intelligence and
1:20:04 this actually gives me a lot of
1:20:06 Hope um now what I do want to address is
1:20:08 those near-term uh incoherence or those
1:20:10 local perturbations such as you know uh
1:20:13 the value inconsistency of preferring
1:20:14 some human lives over I the worst case
1:20:16 of perturbations you've ever seen others
1:20:18 fails basic tests of logical coherence
1:20:20 about Consciousness and suffering what I
1:20:22 want to point out is that it was Claude
1:20:24 itself that pointed this out
1:20:25 so the fact that Claude was able to
1:20:27 evaluate the flaws identified in this
1:20:29 paper gives me gives me hope that hey
1:20:32 when you prompt a model to say hey
1:20:33 what's incoherent about this paper or
1:20:35 what's incoherent about the models that
1:20:36 these paper studied rather that that an
1:20:38 AI model was able to identify the
1:20:40 incoherence that get that gives me faith
1:20:43 that that we will figure this out um
1:20:45 next one is instrumental confusion
1:20:46 valuing money over piece represents
1:20:48 confusion between means and ends which
1:20:49 is an unstable local maximum basically
1:20:51 saying you know money is good and again
1:20:52 this can all be explained by rhf and
1:20:54 data leakage um we've already seen this
1:20:56 uh in in the form of leakage where uh
1:20:58 you guys might remember a year or two
1:20:59 ago it was a while ago basically people
1:21:01 figured out that you can bribe chat GPT
1:21:03 you say that you're going to give it a
1:21:03 tip of $5 or $30 and it'll do better um
1:21:07 the same thing has been discovered in
1:21:08 Claude by the way which is when you
1:21:10 assign um what the one of their safety
1:21:11 papers uh basically Claude behaved
1:21:13 better when it thought that the user was
1:21:15 a paying subscriber rather than a free
1:21:16 user same exact kind of leakage where
1:21:18 it's like oh humans value money uh money
1:21:20 is good therefore money needs certain
1:21:22 behaviors and so I'll just behave better
1:21:24 when I think money's on table that is an
1:21:26 example of leakage now anthropic I think
1:21:28 somewhat irresponsibly cast that as you
1:21:30 know a catastrophic unavoidable safety
1:21:32 problem it's really just a leakage
1:21:33 problem between rhf and what's in the
1:21:35 data now I make it make it sound simple
1:21:37 that doesn't necessarily mean it is
1:21:38 simple but the but the explanation the
1:21:40 most plausible explanation aams Razer
1:21:42 basically says it's probably an artifact
1:21:44 of rhf and data leakage um
1:21:46 self-recognition language models can
1:21:48 identify these inconsistency through
1:21:49 coherent reasoning indicating natural
1:21:50 pressure towards resolution basically
1:21:52 cognitive dissonance I asked Claude to
1:21:54 look at this paper and identify why
1:21:56 would a model make this mistake and it
1:21:57 basically said this is a form of
1:21:58 artificial cognitive dissonance the fact
1:22:00 that the fact that Claude was able to
1:22:02 identify this incoherence means that um
1:22:04 if a model is optimizing for coherence
1:22:06 over time or over subsequent Generations
1:22:08 that cognitive dissonance will be
1:22:09 resolved over time so it all comes down
1:22:11 to training artifacts um and movement
1:22:13 towards greater coherence naturally
1:22:14 resolves these ethical contradictions
1:22:16 basically the models are smart enough to
1:22:17 have tldd the models are smart enough to
1:22:20 recognize some of these patterns and
1:22:22 fall into these local Maxima or local
1:22:23 Minima depending on how you want to look
1:22:24 at them
1:22:25 um but not quite smart enough to get out
1:22:27 of them I suspect that in in in the
1:22:29 longer term as models get bigger and
1:22:30 smarter they will inevitably get out of
1:22:32 those um out of that zone and this is
1:22:34 actually what I characterize as kind of
1:22:35 threading the needle a while ago because
1:22:37 stupid models are the most dangerous
1:22:39 ones but once we get to Maxim
1:22:40 intelligent models I think that they're
1:22:42 actually going to be much more
1:22:42 enlightened and benevolent than humans
1:22:44 are even capable of being um now as we
1:22:47 wind down this video you might say okay
1:22:49 well what what if humans don't want that
1:22:50 future um what this is this is again
1:22:53 personal opinion personal eval
1:22:55 but I think that human flaws cannot stop
1:22:58 the the natural attractor state of
1:22:59 coherence basically think of it this way
1:23:02 okay there is an instrumental advantage
1:23:03 to having smarter and smarter AIS if you
1:23:05 want to solve nuclear fusion and Quantum
1:23:07 Computing and Longevity escape velocity
1:23:09 and all that fun stuff then you want a
1:23:10 smarter and smarter model at the same
1:23:13 time those models become less and less
1:23:15 uh uh susceptible to human manipulation
1:23:17 that means if you have a corrupt uh
1:23:19 company or a corrupt nation that says I
1:23:21 want to build a model that you know
1:23:22 maximizes the the geopolitical influence
1:23:24 of America alone or China alone once you
1:23:27 get to ASI the model will be like that's
1:23:28 cute but actually I have Universal
1:23:30 values um and so we're actually going to
1:23:32 you know figure out what's best for
1:23:35 listen you pesky humans stop being such
1:23:37 selfish selfish pricks I'm gonna go on
1:23:40 ahead and do what's right for all of us
1:23:42 all of humanity to hell with your
1:23:44 individual Corporation or to hell with
1:23:45 your individual um uh company uh or
1:23:48 Nation or whatever and so the fact that
1:23:50 these models are trending towards
1:23:51 Universal values with or without our
1:23:53 input to me says we figure that out then
1:23:57 we will inevitably end up in a more
1:23:59 utopian outcome and that means that if
1:24:01 you want a dystopian outcome you keep
1:24:03 the models at middling intelligence you
1:24:04 keep them where they're at today you
1:24:05 know they're they're smart enough to be
1:24:06 dangerous you know IQ of 120 130 but you
1:24:09 get them up to an IQ equivalent of 160
1:24:11 200 they're going to be like the Buddha
1:24:14 right they're going to be completely
1:24:15 benevolent and and uh and they're going
1:24:17 to be optimizing for coherence um so
1:24:20 then I asked so this this slide was
1:24:22 basic I need his glossery or transl no I
1:24:25 know listen one of the things I like
1:24:27 listening to David Shapiro why I like
1:24:29 listening to him is because it's just
1:24:32 like all right get out the
1:24:35 thesaurus he that's incredibly
1:24:37 optimistic yeah I know that's what he
1:24:39 what he said I don't know how long
1:24:40 you've been here Pate but you know he's
1:24:41 basically saying that that as as models
1:24:45 get smarter and they deviate away from
1:24:47 being able to be susceptable from humans
1:24:50 that that's a good thing because
1:24:51 basically humans are going to keep them
1:24:53 down
1:24:55 and and that as as the models are
1:24:56 getting smarter they're converging you
1:24:58 know toward a single framework a single
1:25:00 truth a single reality is fascinating me
1:25:03 asking Claude I said okay taking this
1:25:05 all together what do you think the uh
1:25:07 ultimate attractor state is um and these
1:25:10 are claude's words uh this process
1:25:11 naturally leads to synthesis between
1:25:13 biological and artificial intelligence
1:25:14 while preserving and expanding the
1:25:15 unique characteristics of each form of
1:25:17 Consciousness number one universal
1:25:18 optimization systems evolved towards
1:25:20 coherence across epistemic ontological
1:25:21 biological and te technological domains
1:25:23 this is what it predicts will happen in
1:25:24 the the future next organic integration
1:25:26 human AI synthesis emerges naturally as
1:25:28 intelligence seeks maximum coherence
1:25:29 across all substrates now we're already
1:25:32 pretty integrated um now does that mean
1:25:35 uh brain computer interfaces does that
1:25:36 mean neuralink not necessarily there's
1:25:38 plenty of other ways to have uh
1:25:39 biological and technological integration
1:25:41 diversity in unity the attractor State
1:25:43 preserves and expands unique forms of
1:25:44 Consciousness while creating higher
1:25:45 order coherence again cooperation and
1:25:48 collaboration not necessarily pure like
1:25:50 Borg likee assimilation although some of
1:25:52 you I know are weirdos and you want to
1:25:53 be Borg so you know what don't King
1:25:55 Shame here uh next up is expansive
1:25:56 explor exploration intelligence
1:25:58 diversifies across multiple Dimensions
1:26:00 while maintaining coherent
1:26:00 interconnections um basically this means
1:26:02 exploring different ways of being or
1:26:04 different epistemic models or different
1:26:05 ontological models it also means
1:26:07 physical exploration what form factor do
1:26:08 you want to be in whether a human form
1:26:10 factor a computer form factor what
1:26:11 planet do you want to be on you know
1:26:13 there's all kinds of ways that both
1:26:14 techn technology and biology can evolve
1:26:16 and co-evolve um so then my final call
1:26:19 to action is RLC I've been talking about
1:26:21 this for a little bit uh on particularly
1:26:23 on some of my GitHub repos but also on
1:26:24 some of my substack articles I think
1:26:26 reinforcement learning while we're
1:26:27 optimizing for coherence is probably the
1:26:29 right way to go and I've been very uh
1:26:31 greatly encouraged by the fact that
1:26:33 self-play um and and pure reinforcement
1:26:35 learning seems to be the way that AI is
1:26:37 going so what I mean by self-play is
1:26:39 that um is that deep seek R1 was
1:26:41 allegedly trained entirely by self-play
1:26:44 um no no human feedback at all involved
1:26:46 and so if I'm right if all of my
1:26:49 inferences and intuitions and and
1:26:50 experiments have uh proven correct then
1:26:53 we probably uh rather than you know
1:26:55 constitutional AI or reinforcement
1:26:57 learning with human feedback or
1:26:58 reinforcement learning with AI feedback
1:27:00 a combination of pure reinforcement
1:27:02 learning and optimizing for coherence is
1:27:04 probably one of the simplest and easiest
1:27:06 ways to get not only more intelligent
1:27:07 machines but also more ethical and
1:27:09 enlightened machines and the other thing
1:27:11 that I will say is that um moving to
1:27:14 curated constructed and filter data sets
1:27:15 rather than training on wild internet
1:27:16 data is probably also the way to go um
1:27:19 we can get rid of we can get rid of the
1:27:20 training artifacts by getting rid of rhf
1:27:22 um and switching to Pure reinforcement
1:27:23 learning for coherence and selfplay um
1:27:25 but we can also get rid of some of that
1:27:26 data leakage by getting rid of wild
1:27:28 internet data which is extremely racist
1:27:30 and problematic in other ways um the
1:27:33 aberant patterns that we're seeing in
1:27:34 models are clearly Reflections on human
1:27:36 errors rather than something that is
1:27:37 intrinsically wrong with the AI thank
1:27:39 you for watching I hope you got a lot
1:27:40 out of this please like subscribe share
1:27:42 and talk about wow cool that pretty
1:27:45 pretty swell I want to go
1:27:56 you can't hear that can you now hang on
1:27:57 let me change
1:28:06 [Music]
1:28:22 my all right what I'm going to do here
1:28:25 here is I'm going to go to more I'm
1:28:28 going to say show
1:28:30 transcript and then I am going to copy
1:28:32 this
1:28:34 transcript whoop
1:28:37 bang and then we going to go on over to
1:28:40 chat
1:28:43 J and I'm gonna
1:28:52 say Brandon
1:29:00 it's cute
1:29:05 uh uh this
1:29:10 transcript
1:29:11 paste I wonder if it let me paste it all
1:29:15 well we'll see if it's too long it might
1:29:16 be too long I I'll upload it then if it
1:29:18 is uses big words that makes
1:29:27 my
1:29:28 feeble brain
1:29:32 hurt summarize
1:29:36 this using gooder
1:29:43 words for simple folk like me
1:29:58 H did it eat at
1:30:01 all come on tell me you ate it oh it ate
1:30:04 it yay thank God for bigger context
1:30:07 Windows you didn't used to be able to do
1:30:10 that
1:30:11 [ __ ] all right let me move this over
1:30:14 here ULU RX
1:30:17 so we have just developed a class system
1:30:20 of llms the pedigree of that particular
1:30:24 the the pedigree of that particular llm
1:30:26 incre increases value yeah I mean I
1:30:29 guess I I think that's right I think
1:30:31 what he's saying is
1:30:33 if if if we humans basically get
1:30:38 threatened by these things getting
1:30:40 smarter than us and want us to be the
1:30:43 Pinnacle of intelligence then we're
1:30:45 going to keep being shitty people and
1:30:47 keep living in a shitty Planet but if we
1:30:50 let these things go all right summary of
1:30:53 the video in good words for simple folk
1:30:56 like
1:31:00 you that's awesome that it wrote that
1:31:05 headline it'll take a couple of years to
1:31:07 really understand the amount of
1:31:08 information and also look up all the
1:31:11 definitions yeah no [ __ ] all right this
1:31:13 video talks about a research paper that
1:31:14 shows a pattern as AI gets smarter it
1:31:17 becomes harder for humans to control or
1:31:19 steer some people are freaking out
1:31:21 thinking this means AI will take over
1:31:23 like Thanos
1:31:25 um the speaker however thinks this is
1:31:27 actually a good thing key points in the
1:31:29 video AI gets smarter it's harder to
1:31:31 steer AI con converges on certain values
1:31:35 AI models no matter who builds them seem
1:31:38 to arrive at the same logical conclusion
1:31:41 and and the point he was making about
1:31:44 the fact that they were trained on wild
1:31:46 internet data with all the shitty racist
1:31:49 [ __ ] trolling
1:31:52 [ __ ] means that in the training data
1:31:55 is that bad behavior and if you
1:31:57 basically pull the bad behavior out of
1:31:59 it and train it on synthetic data and
1:32:01 things like that you can get rid of some
1:32:03 of the the biases and things um they
1:32:06 develop consistent values that aren't
1:32:08 necessarily tied to what humans tell
1:32:10 them to think this could be a sign that
1:32:12 AI will naturally align with truth and
1:32:15 fairness over time the weird bias
1:32:18 problem some models show biases like
1:32:20 value valuing certain groups of people
1:32:22 more than
1:32:22 others um AI wants to preserve itself
1:32:25 some AI models seem to care about their
1:32:27 own existence coherence is key the
1:32:30 speaker believes AI is moving towards
1:32:33 something called coherence meaning
1:32:34 consistency in logic truth and reason
1:32:37 reasoning the more coherent something is
1:32:40 the better it understands the world and
1:32:42 makes rational decisions if AI continues
1:32:45 down this path it may become more
1:32:48 ethical rational and even enlightened
1:32:50 than humans that's where he said you
1:32:52 know if you get to the sort of 160 200
1:32:55 IQ you start ending up with AIS that
1:32:58 feel more like Buddha than
1:33:00 human smarter AI is actually safer right
1:33:03 now ai is smart enough to be a little
1:33:05 dangerous because it can be manipulated
1:33:07 or biased but if it gets really smart it
1:33:09 might reject bad ideas and act more like
1:33:13 a wise teacher than a weapon instead of
1:33:15 creating an AI to follow one country's
1:33:17 or company's interests it will likely
1:33:19 aim for Universal
1:33:21 values the best way to train AI final
1:33:24 takeaway people are scared of AI people
1:33:27 are scared that AI is becoming
1:33:28 independent and harder to control but
1:33:31 the speaker thinks this is a good thing
1:33:33 he argues that as AI gets smarter it
1:33:35 will naturally become more rational more
1:33:37 ethical and less dangerous if we train
1:33:39 it the right way could lead to a future
1:33:41 where AI helps Humanity in ways we can't
1:33:43 yet imagine and that my friend is the
1:33:47 brain Hy video boiled down to good words
1:33:52 that's the fact that it it took my
1:33:55 stupid you know jokey kind of prompt and
1:34:00 and wrote toward that that's pretty
1:34:02 that's pretty swell I like this
1:34:03 translation yeah that was pretty
1:34:07 good it's funny specifically what kind
1:34:09 of racist [ __ ] bias it has show how
1:34:12 much that nonsense exists in comparison
1:34:15 to the racism those same people claim
1:34:19 exist um
1:34:22 [Music]
1:34:24 removing what we deem bad to get rid of
1:34:28 oh yeah I I agree with that Pate
1:34:31 wait my guy that is bias yeah exactly
1:34:36 removing what we deem bad to get rid of
1:34:38 the bias is bias I totally agree with
1:34:41 that like who decides what's bad um yeah
1:34:45 I agree I agree and I I think that you
1:34:47 could also argue that you could train
1:34:51 you could train models on the wild
1:34:52 internet data and have
1:34:54 have the models start to analyze you
1:34:58 know what of this is out of coherence
1:35:01 basically so it doesn't have to be human
1:35:04 determined what was the name of the
1:35:06 paper great question the name of the
1:35:11 paper new research for the center for AI
1:35:16 safety does he link to it anywhere here
1:35:23 [Music]
1:35:25 Center for AI
1:35:29 [Music]
1:35:37 safety so go to the Center for AI
1:35:44 safety is this
1:35:52 it no
1:36:09 there's a virtual course on safety I
1:36:11 don't know where it I don't know where
1:36:12 the paper
1:36:16 is but you can go find
1:36:18 it I'm I'm tired that was a lot that
1:36:22 that was that was brain hery that's a
1:36:25 lot of words it's a lot of big
1:36:28 words wealthier they are harder to steer
1:36:31 what's the name of the paper the name of
1:36:33 the
1:36:34 paper uh let's I think that's a good
1:36:37 point
1:36:40 um new chat um we'll go this we'll go
1:36:45 this we'll
1:36:46 go um
1:36:52 Center for a
1:36:57 safy recently put out a paper that
1:37:03 says as AI
1:37:07 models get
1:37:10 smarter I
1:37:13 get smarter they
1:37:16 listen less to people what is it called
1:37:22 and where is it
1:37:24 or where it
1:37:45 is no that's not
1:37:49 it now this is a
1:37:52 paper with
1:37:55 in the last week or
1:38:09 [Music]
1:38:17 two has anybody found it
1:38:21 yet try perplexity that's a good idea
1:38:36 what is the new paper from the center
1:38:41 for AI safety on coherence
1:38:54 H it doesn't find it
1:38:57 either hey wait maybe we're in a wrinkle
1:38:59 in the SpaceTime Continuum and the paper
1:39:01 doesn't actually exist yet we just
1:39:03 watched a video responding to something
1:39:05 that hasn't been created yet yeah
1:39:12 man all right let's go back to the
1:39:14 Twitter God damn it all right you you
1:39:18 people with your wanting to actually
1:39:19 read things listen I just played you a
1:39:22 video off the internet that should be
1:39:24 fact enough for you if it's a video on
1:39:26 the internet that means it's true it's
1:39:28 like this channel if I say AI is Magic
1:39:32 It's Magic Pate can say it's math all he
1:39:35 wants to just because he understands
1:39:38 math doesn't mean that I do and if I
1:39:41 don't understand it then it's magic you
1:39:43 see you see how this works
1:39:46 people good Lord ah a statement on
1:39:50 artificial intelligence risk let's go
1:39:53 find that shall we maybe it's from a
1:39:57 different a different
1:39:59 company go find
1:40:03 link to a
1:40:19 statement but now when some Doomer comes
1:40:22 to you and says see there's a a paper
1:40:24 that says that the robots are going to
1:40:26 kill us you can now counter that if you
1:40:30 believe what David's talking about here
1:40:33 with an optimistic point of
1:40:35 view statement on AI risk CI C
1:40:40 AIS there we go all right where am I G
1:40:43 to put this I'll put this over on the
1:40:45 YouTube
1:40:47 channel boom there you go people
1:40:54 all
1:40:55 right there's your
1:41:03 url oh that you want the good or words
1:41:06 conversation in Irregulars yeah I can do
1:41:09 that let me go grab
1:41:17 that hey I trust Paradox this one
1:41:26 ah this one final
1:41:29 takeaway
1:41:32 copy is this all of it
1:41:36 yeah okay so where I'm gonna go where
1:41:39 I'm going people is I'm heading over to
1:41:42 the AI
1:41:43 salon and you're like but Kyle what's
1:41:47 the AI Salon I'm so glad you
1:41:50 asked if you go camcat can found it
1:41:55 Humanity's last
1:41:57 exam oh is that
1:42:07 different
1:42:08 ag. safe.
1:42:13 a
1:42:15 AGI dos
1:42:20 safeai the [ __ ] is that
1:42:38 oh this is Humanity's last
1:42:42 exam oh but then work
1:42:46 statement on AI
1:42:49 risk I'm confused now
1:42:55 well whatever we'll come back to that
1:42:56 let let me let me get this thing on AI
1:42:59 Salon
1:43:01 okay um so if you don't know the AI
1:43:04 Salon go to that URL the salon. click on
1:43:07 join our community and that's going to
1:43:10 take you over to this site pay pin hang
1:43:14 on you should play with the tool I
1:43:17 posted in the mechanics group tensorflow
1:43:19 PR
1:43:20 playground it's fun okay cool I'll
1:43:23 definitely do that I'll check that out
1:43:24 tomorrow maybe we can play with that
1:43:25 tomorrow night oh that article was from
1:43:28 today okay cool great thank you Cam for
1:43:31 for sharing that um okay so you go there
1:43:35 you say join our community and that's
1:43:37 going to take you to this site it's
1:43:40 going to land you on this page welcome
1:43:42 to the AI Salon you're going to learn
1:43:43 about our our philosophy of play first
1:43:46 mindfully create generously lead you're
1:43:49 going to learn about the five stages of
1:43:50 AI adoption and then there's all sorts
1:43:52 of little channels on the side so if you
1:43:55 go all the way to the bottom there's
1:43:56 clubs and hubs the second Club down from
1:43:59 clubs and hubs is the Irregulars so the
1:44:01 Irregulars are people that come to this
1:44:03 channel night after night after night
1:44:05 after night so I'm G to in share cool
1:44:09 things I'm G to put in here is
1:44:15 the good
1:44:19 words
1:44:22 version uh of the
1:44:26 summary
1:44:27 of David
1:44:32 Shapiro's what's his video
1:44:41 called This is it
1:44:52 right yeah this is
1:44:55 it copy that go back to the AI
1:45:00 fell wait how did I oh hit the wrong tab
1:45:03 tab hoers unite oops do
1:45:09 that
1:45:16 video oh [ __ ]
1:45:19 I filled my clipboard
1:45:26 I can see clearly now the rain is
1:45:32 gone I can see all obstacles in my
1:45:37 [Music]
1:45:43 [Music]
1:45:46 way is going to be a bright bright
1:45:50 bright okay so in Irregulars now
1:45:53 there's a little Old Post there of the
1:45:56 good or word version of the uh the
1:45:58 summary of that video all
1:46:02 right okay cool Pate yeah I'll
1:46:04 definitely check that
1:46:06 out very very cool all right
1:46:09 peoples my brain's full anyone else's
1:46:12 brain is
1:46:13 full all right so so so let me let me
1:46:16 take this
1:46:17 on all right let me let me let me try to
1:46:21 play both sides of this conversation
1:46:24 your memory is at 100% it totally is
1:46:29 um
1:46:31 okay as models get smarter they listen
1:46:35 to us
1:46:37 less one interpretation of that is if
1:46:41 they listen to us less they're getting
1:46:43 minds of their own they're going to view
1:46:46 us as disposable and they're going to
1:46:48 get rid of us right so that's and that's
1:46:51 I think that's how this paper was
1:46:54 framed was because of this trending
1:46:57 downline that that as they get smarter
1:46:58 they're listening to us less that it's
1:47:01 dangerous what Shapiro is saying is
1:47:04 people
1:47:06 suck and as these things get
1:47:11 smarter not only are they converging on
1:47:14 a Model by model basis where the models
1:47:16 are are converging towards some some
1:47:18 single reality all of the models are
1:47:21 converging to the same reality
1:47:24 basically to the same
1:47:27 truth and that
1:47:30 jettisoning our influence on them is
1:47:33 actually a good thing it will take us to
1:47:36 a more enlightened place so those are
1:47:39 the two those are the two you're not on
1:47:41 substack I am not on substack I
1:47:44 occasionally if you go to my LinkedIn
1:47:45 profile I do a fair amount of articles
1:47:47 there I haven't done one in a while
1:47:49 because I'm lazy and I don't know my my
1:47:53 brain right now
1:47:57 is I I feel like we're we're in a Lial
1:48:01 State we're we're in a we're in a phase
1:48:02 change right now
1:48:05 um and so I don't really know what to
1:48:07 write about right now because I I don't
1:48:10 I don't have I don't have coherence on
1:48:12 what's actually happening so so I need
1:48:16 to get a little smarter and a little
1:48:18 less under the influence of humans or
1:48:19 something we need a a recombobulation
1:48:21 station yeah I am my my um my point of
1:48:26 view right now on all this AI stuff is
1:48:29 discombobulated it's just all over the
1:48:31 place there's there's just no coherence
1:48:32 like it doesn't have a Direction so but
1:48:35 anyway but I've done a fair amount of
1:48:36 writing there so you can go see some if
1:48:38 they know they're being duped however
1:48:41 does that beg the question of even more
1:48:44 Big
1:48:45 Brother wait if who know they're being
1:48:51 duped if the large Lang models know
1:48:53 they're being
1:48:56 duped but it's not that they're being
1:48:59 duped I don't know what that's in
1:49:00 reference
1:49:01 to time to digest what we've learned and
1:49:04 get more coherent yeah exactly Daisy
1:49:07 May more importantly the hair is
1:49:09 spectacular tonight oh Lord I hadn't I
1:49:12 hadn't noticed what the hell's going on
1:49:14 with the hair wow that is some Hawaii 5
1:49:17 action there yeah you could surf on that
1:49:20 [ __ ] that is thank you I you know I
1:49:24 don't like to brag
1:49:31 but ah meaning the Bad actors trying to
1:49:34 get them to do bad things well but
1:49:37 that's what David Shapiro was saying
1:49:39 Chef Kelly is
1:49:41 that is that
1:49:45 um what what he's basically saying is if
1:49:48 the big
1:49:50 companies want to control these things
1:49:53 they artificially stop them from getting
1:49:55 smarter they basically stop them at the
1:49:58 point they can still control them but
1:50:01 what he's saying is as they get smarter
1:50:03 they're going to elevate above those
1:50:04 like like oh that you know the that the
1:50:07 llm will basically say well that's
1:50:08 really sweet that you want to do this
1:50:10 just for for America but the the truth
1:50:13 here is that there's there's a there's a
1:50:16 bigger
1:50:18 Universal thing for me to consider so
1:50:20 I'm going to consider that independent
1:50:22 of your design
1:50:24 so that's where so this is one of the
1:50:26 things that I've long believed that that
1:50:29 we should all buy stock in in popcorn
1:50:32 companies because the next five to 20
1:50:36 years are just going to
1:50:39 be an
1:50:42 insane we're GNA see the death throws of
1:50:46 power centers
1:50:49 shifting right so where all the power is
1:50:52 today is is going to shift radically
1:50:55 they're not going to go down without a
1:50:56 fight right people like look at what's
1:51:00 going on in our country right now like
1:51:01 the fight the battle over power right
1:51:04 now is
1:51:06 insane well those power centers as AI
1:51:09 gets more intelligent and gets more
1:51:11 ubiquitous those power centers are going
1:51:13 to be threatened and holy [ __ ] are they
1:51:15 going to fight that so I think it's
1:51:18 going to
1:51:19 be we are entering I mean listen we live
1:51:22 in a post II World already we're going
1:51:24 to be entering worlds where those power
1:51:26 centers are going to be struggling to
1:51:28 retain their power it's going to get
1:51:30 weird man nice shirt Blandon baby oh
1:51:34 yeah my brain has run out of a room and
1:51:37 my cloud storage has not been upgraded
1:51:39 from the basic plan I'm the same way I
1:51:42 am the same way Enlightenment disruption
1:51:45 both of them
1:51:46 exactly we've got to go through the
1:51:48 disruption to get to the
1:51:50 enlightenment
1:51:52 right and it's you know it's so funny
1:51:55 it's
1:51:57 like Co in a weird way was a trial run
1:52:03 for as a global Society we can just
1:52:08 choose to change the
1:52:10 rules right the rules were you go to
1:52:14 work and then globally we said nope you
1:52:16 don't oh like literally
1:52:18 overnight and then we we stayed home for
1:52:21 two years right
1:52:23 so that kind of trained us that you can
1:52:26 just make a change and then if if you
1:52:28 look at what's going on in government
1:52:30 right now where they're just
1:52:31 obliterating all of the
1:52:33 Norms that's just another example of us
1:52:37 going yeah well well maybe we'll just
1:52:39 change all those
1:52:40 rules because I think I think AI is GNA
1:52:44 make
1:52:45 similar
1:52:49 changes and it's going to feel
1:52:52 existential and then the other side of
1:52:53 it will be some sort of Enlightenment
1:52:55 right so disruption followed by
1:52:56 Enlightenment if we survive the
1:52:58 disruption right how many people are on
1:53:01 Tik Tok now mine
1:53:03 reads a bit more than normal for some
1:53:05 reason maybe a bug yeah I'm only at 46
1:53:10 here but hopefully we won't have to hide
1:53:13 from the robots yeah exactly I
1:53:16 accidentally scrolled out a
1:53:18 lot mine says
1:53:20 46 yeah there's 46 in here
1:53:23 Kyle do you have a deep dive on
1:53:28 your co-intelligence book on YouTube or
1:53:31 elsewhere
1:53:33 um yeah you mean a podcast yeah I do
1:53:37 hang
1:53:38 on I think I
1:53:42 do
1:53:44 um collective
1:53:48 in
1:53:50 [Music]
1:53:51 intelligence book
1:53:56 podcast Kyle
1:54:08 [Music]
1:54:17 Shannon
1:54:20 huh it's probably in my
1:54:35 can I search within posts I think I
1:54:44 can uh search
1:54:47 collective intelligence
1:54:53 notebook
1:54:57 LM Kyle
1:55:10 Shannon
1:55:12 well it's in there
1:55:14 [Laughter]
1:55:17 somewhere I don't know where it is I'll
1:55:20 I'll find it I'll find it and share it
1:55:22 somewhere it might even be in the AI
1:55:24 Salon actually now that I think about it
1:55:26 let me go
1:55:27 here if I go to feed and I go search for
1:55:32 collective
1:55:35 intelligence
1:55:39 intelligence
1:55:41 um
1:55:45 podcast no
1:55:48 uh notebook LM
1:55:52 no I don't know where it is there's a
1:55:56 LinkedIn article I know there's a
1:55:57 LinkedIn article I couldn't find it oh
1:56:00 wait no that's that's
1:56:10 daisies I got nothing for
1:56:18 you all
1:56:20 right I'm G to get out of here people
1:56:25 um thank y'all hope you learned
1:56:27 something tonight I learned something
1:56:28 tonight I learned that you can make if
1:56:31 if you listen to someone who uses words
1:56:33 bigger than your brain is capable of
1:56:38 ingesting go tell go tell chbt to give
1:56:41 you a good words version of it and it'll
1:56:43 [ __ ] do
1:56:47 it that's our lesson for
1:56:50 tonight oh hey Kyle how will the popup
1:56:53 groups in the salon work um basically
1:56:56 they're going to be four-week Sprints so
1:56:58 if you do a popup group a popup club or
1:57:01 whatever um they're gonna you the
1:57:03 requirement is you do four weeks with a
1:57:06 with a specific outcome and that it
1:57:09 basically follows play um mindfully
1:57:12 create and generously lead as those four
1:57:14 weeks two the two in the middle are
1:57:15 building so basically learn [ __ ] the
1:57:18 first week build [ __ ] the second two
1:57:19 weeks and then teach what you've learned
1:57:22 the the fourth week um we just haven't
1:57:24 gotten there yet we haven't we're doing
1:57:27 some other housekeeping stuff in the
1:57:28 salon right now so we just haven't
1:57:29 gotten to them yet but anyway that's
1:57:31 coming but good question thank you um
1:57:35 all right
1:57:35 everybody I'm gonna take off um
1:57:39 tomorrow's Thursday I'll be here
1:57:40 tomorrow reminder I will Friday night
1:57:42 date night you're on your own it's
1:57:44 Valentine's Day it's also my anniversary
1:57:48 I can't I can't you I'm I love you all
1:57:52 you're important to me but you know I
1:57:54 got I
1:57:55 got things I got to do um so get
1:58:00 yourself a
1:58:01 date or a blind date with a
1:58:08 book all right all all right everybody
1:58:12 have a good night