May 13, 2024 OpenAI's Game-Changer: Unveiling GPT-4o and AI Integration with Apple!

Description

Chapters

Transcript

0:13 alrighty we're going live early we're
0:16 doing it early
0:18 people we're doing it
0:26 early so when did she post
0:28 this midnight last
0:32 night good day good day good day what's
0:37 happening all right so I don't know who
0:39 Bindu ready is who is
0:45 she xaws
0:48 Google apparently the apple and open AI
0:51 deal closed last night around
0:55 midnight hello hello
0:57 hello so
1:00 very possible if that deal closed that
1:03 could be part of the announcement
1:07 today um nothing yet on if you go to
1:11 chat gp.com nothing nothing new there I
1:16 haven't checked the the app
1:20 lately
1:23 um the
1:25 uh here's the
1:28 video I guess I can keep that that on
1:31 we'll keep a little background music on
1:34 there and that way if we're on some
1:36 other page it'll come up all right
1:41 so so
1:43 that's that's
1:45 interesting I
1:48 mean it basically says to me that they
1:51 cut a deal with Apple that Apple doesn't
1:53 quite have their [ __ ] together yet and
1:54 they'll they'll partner with open AI
1:57 until they have their own stuff P modder
2:01 what's happening sir 3 m storage Jim
2:03 Ross good to see you Tech Mario what's
2:07 [Music]
2:10 happening Edson subscribe to the live
2:12 thank you sir appreciate that appreciate
2:15 it very
2:17 much what the hell we doing this midw
2:19 work day yes we are archetypal architect
2:22 uh we are 40 minutes away from the open
2:25 AI
2:27 event and lots of uh
2:31 uh that's distracting lots of uh I'm
2:34 going to just mute that [ __ ] uh lots of
2:38 uh are we excited I don't I don't know I
2:41 mean the problem with getting excited
2:43 about these things is if they if they
2:45 come out with something that's just you
2:47 know like you can use chat
2:50 GPT in your iPhone now I'm not going to
2:53 be excited
2:55 um they were hinting enough that you
2:58 should go watch the movie Her
3:01 that it better damn well be it better
3:05 damn well be you know my all singing all
3:08 dancing AI
3:13 girlfriend it's all I'm
3:14 [Laughter]
3:16 saying oh man well it's the opening eye
3:20 event it is rumored to be a voice agent
3:23 uh and uh I'm I'm just on another window
3:26 here I could actually I could do it here
3:28 just go look for uh
3:30 what's going on on the
3:37 [Music]
3:39 twitters holographic displays are coming
3:42 nice they've been they've been saying
3:45 holographic displays are coming forever
3:47 not not from open AI I'm just reading
3:48 Twitter right
3:54 now Apple was the last to smartphones
3:57 Google was the 17th search engine so
4:00 he's basically saying don't worry about
4:03 Apple that's Robert
4:07 scoble oh nice more disturbing
4:13 robots does open Ai and chat
4:16 GPT do open Ai and chat GPT have a
4:19 business relationship open AI is the
4:21 company that makes chat GPT so
4:25 yes they are the uh the makers of
4:31 I'm looking to get agents and Bots yep
4:33 I'm hoping we get a chatbot that'll talk
4:36 dirty without bouncing off the guard
4:37 rails in fact he he uh Sam Alman said
4:41 something about they're trying to figure
4:42 out a way to allow
4:44 for for Naughty Bots without them being
4:48 dangerous in other ways so um so there
4:52 it sounds like they're actually working
4:53 on that believe it or not
5:01 [Music]
5:04 okay that's not very easy for reading
5:06 when I have white text there is
5:08 it all right let me just put that thing
5:11 up that's actually easier to
5:14 read all right that's the video there
5:17 and then I'll just I'll just I'm going
5:19 to be uh surfing uh the Twitter's let me
5:22 go to let me go to Twitter
5:27 pro pro do
5:49 [Music]
5:53 x.com what's happening
5:58 everybody did anyone watch watch her
6:00 over the weekend I watched her on
6:04 Sunday and
6:07 uh it's wild you know it it's funny
6:10 because
6:12 the the difference between is I I said
6:16 to
6:20 my uh let's see how am I going to do
6:23 this can I mute
6:25 here I might be able to hang on a sec
6:28 I'm getting a call
6:59 for
7:29 e
7:58 e
8:28 e
8:58 e
9:28 e
9:58 e e
10:44 all right I'm
10:47 back I'm unmuted I'm
10:52 unmuted sorry had to talk business I am
10:55 I am running a business after all that
10:56 one right there
10:59 okay let's go see what's going on let's
11:02 go see what's
11:05 happening uh breaking apples finalizing
11:09 a deal that was 7 hours
11:12 ago so if there's that much Buzz about
11:15 them finalizing a deal it sounds
11:18 like can you hear me now I I prefer to
11:22 this way P Gotta Love You Pate what's
11:25 happening man uh
11:31 um there will be no singing we will not
11:35 have
11:36 fun there will be no
11:42 [Music]
11:46 pleasure you know there's a part of me
11:48 that wants to
11:50 like the
11:52 uh the multicolumn version of Twitter
11:56 but I
11:57 can't I just can't pay attent it's too
12:00 much even for my ADD
12:02 [Laughter]
12:04 brain so I'm going to go to normal
12:09 Twitter see what people is
12:12 saying open AI see you soon 20 minutes
12:24 ago that's really funny
12:31 let's see copy link here we'll show if I
12:33 find good memes I'll show them to you
12:35 here's a good
12:40 meme literally everyone right
12:49 now pretty
12:52 good pretty good pretty good people
13:02 [Music]
13:05 what's going on with y'all anything
13:07 happening audio is good I hear it nice
13:29 oh that's funny it's Kyle away my
13:32 screen's broken right where he placed
13:34 his face we are
13:38 early I'm going to call it work thank
13:40 you for thank you for letting people
13:42 know what's going on this is exciting
13:44 brand new AI features well we hope it's
13:47 exciting Rudy nothing exciting Google I
13:50 IO is tomorrow but I don't have much to
13:52 do with that um yeah I might do I
13:56 haven't heard much from google.io but I
13:58 would assume they're going to be
13:59 launching something if you've got if
14:02 you've got apple and open AI assuming
14:05 that they announce something today that
14:08 would be
14:09 interesting
14:11 I I can't imagine that they're going to
14:14 announce anything other
14:16 than whatever capability they're
14:19 announcing today will be available at
14:22 some point in the future with apple but
14:25 you know they they
14:27 did do a lot with mik Microsoft before
14:30 anyone knew about it and then they kind
14:31 of you know announced this thing and
14:34 Microsoft launched their uh their chap
14:37 up pretty quickly but we'll we'll
14:40 see we will see Pate is there anything
14:44 anything that you know is coming from
14:46 Google that you can hint hint at had a
14:50 panic attack almost forgot to block out
14:51 my calendly so no interruptions I know I
14:55 I got lucky because I had I had I had a
14:57 meeting that was the exact block on the
15:00 open AI event but we were able to
15:01 reschedule it so I was like
15:06 no still working on ragged attention and
15:09 Max
15:10 text very
15:18 cool should do this and a Google meet at
15:21 the same
15:23 time I could do
15:25 that hey I don't want to do it right now
15:34 yeah that's I next time Daniel that's a
15:37 good idea that's I I've got to figure
15:39 out I've got to figure out a a a multi-
15:44 uh a multistream way to do Tik Tok
15:47 because it's just it's too limiting to
15:49 have to like
15:50 squish squish a
15:53 desktop you know window into into a Tik
15:56 Tock View
16:08 new open AI homepage is looking really
16:12 cool is it wait what's the new open AI
16:18 homepage this
16:26 one and so
16:30 relatively old
16:37 stuff 25 minutes 25 minutes what are we
16:41 going to talk about
16:51 people wonder if there's going to be an
16:53 AI wallet that we're going to use with
16:55 an AI assistant probably but not
17:00 I it's it's way too early for for
17:04 anything like that um they they've got
17:07 to get
17:08 their their basic functionality out
17:11 there before you can start connecting it
17:14 to uh Payment Systems so I don't think
17:18 we'll see any of
17:20 that I'm guessing it's going to
17:22 be an
17:24 update to basic chat GPT
17:30 and whatever this agent thing's going to
17:31 be I think Google might launch stuff
17:33 that I've been using internally for a
17:35 while it's very useful okay that would
17:36 be cool that'd be nice P do you know I I
17:40 don't watch Google IO events enough to
17:42 know do they generally do like the
17:44 dramatic storytelling thing where they
17:46 announce all the boring [ __ ] first and
17:48 save the good [ __ ] to the end or are
17:50 they going to lead with the good
17:52 [ __ ] trying to figure out cuz the Google
17:55 iio events are long I
17:57 think when's it when's is a good time to
18:00 watch
18:04 it mobile with dark theme looks
18:20 [Music]
18:25 cool already tens of thousands are
18:28 watching well nothing yet this is from
18:31 Robert
18:32 scoble hey AI can you watch the stream
18:35 and send me notifications when it starts
18:37 it'll start at 10:00 a.m. dummy is that
18:40 Elon musk's 10 a.m. or Sam
18:45 alman's that's pretty
18:47 [Laughter]
18:50 good oh man
19:02 who's tore
19:04 Blau lead engineer at AI PRM
19:11 Corp he says okay this is real we're
19:14 getting gp4
19:20 Omni here I'll show you the
19:24 uh I will show you the chat
19:28 TMZ that's that's why we're here people
19:30 chat
19:35 TMZ now this is the little text there
19:40 says I just discovered GPT for Omni
19:43 today it's has it been around for a
19:51 while where you what where did he see
19:56 it Source open.com
20:02 cdn.com hello-
20:11 gp-4 visual
20:13 narratives poster creation character
20:24 design all right I'm going to try to go
20:26 here
20:29 wait why can I not copy that oh cuz I'm
20:31 hitting the wrong key copy image let's
20:34 go to chat J paste that image
20:37 in
20:39 say type
20:51 [Music]
20:53 this here's the typed version of the
20:57 URL let's go there shall we
21:03 [Music]
21:04 people site can't be reached there's a
21:07 big [ __ ] surprise sorry flipping
21:09 surprise it's daytime we we don't have
21:12 potty mouth in the
21:15 daytime well we do but I try to control
21:19 it a little
21:23 better all right that didn't work for
21:27 me but whatever all right
21:31 so we don't know if that's [ __ ] or
21:36 [Music]
21:41 not B at
21:44 TMC P so here's the secret about pate
21:47 and chat TMZ he actually loves chat TMZ
21:51 he loves gossip he loves speculation he
21:54 hates logic and reasoning and science
21:58 hates it secretly very secretly all
22:02 right what are we doing here
22:05 people do we got
22:08 more come
22:10 on give me the latest I knew
22:15 it yep Can't Get Enough a tech
22:19 speculation looking forward to Google Io
22:22 tomorrow all right Logan kill
22:25 Patrick is uh in the auditor torium
22:30 taking video of the
22:33 stage Matt wolf today's starts
22:36 announcement season open AI today Google
22:38 tomorrow Microsoft next week June we
22:41 have Cisco qualcom and
22:43 apple I'm excited and fully anticipating
22:46 a very overwhelmed next couple of months
22:49 yes I would agree with
22:54 that I like the cold facts until then no
22:59 m
22:59 z uh I bet Pate loves that they are
23:03 calling this
23:06 magic Sam mman said he says it feels
23:09 using this feels like
23:15 magic I will I will die on that
23:18 sword um any any technology you know any
23:23 significantly
23:24 Advanced wait yeah significantly
23:26 advanced technology is indistinguishable
23:28 from
23:31 [Laughter]
23:40 [Music]
23:44 magic anyone find it amusing that open
23:47 AI live show is on
23:49 Google that's pretty
23:54 funny Sam Alman earlier said oh yeah I
23:57 was asking before did anyone see the
23:58 movie her over the weekend or seen it
24:01 recently um Sam Alman is is in an
24:05 interview saying here actually let me go
24:07 grab
24:08 it let me grab this
24:12 post so Reed Hoffman interview I don't
24:15 know when this was
24:17 from Sam Alman earlier said that
24:21 her more than inspired them open AI is
24:25 shipping Samantha tomorrow hu huge if
24:27 true
24:30 so here let's listen to
24:34 [Music]
24:41 this think her got right the number of
24:45 things that I think her got right that
24:47 were not obvious at the time like the
24:50 whole interaction model with how humans
24:51 are going to use an AI this idea that it
24:54 is going to be this like conversational
24:56 language interface that was incredibly
24:58 prophetic and certainly more than a
25:01 little bit inspired
25:02 us incredibly prophetic and certainly
25:05 more than a little bit inspired us all
25:08 right Sammy all right Sammy boy you
25:11 giving us
25:12 Samantha please tell me you cut a deal
25:15 with Scarlet Johansson to be the voice
25:17 of this thing
25:19 please okay if they
25:22 didn't if they didn't cut a deal with
25:24 Scarlet
25:25 Johansson that is it is the biggest Miss
25:28 of the the
25:30 [Laughter]
25:39 century oh
25:48 man you have to give it a softer G It's
25:53 [Laughter]
25:56 Magic oh yeah
26:00 did I miss anything oh my you you you
26:03 missed it all it's over what do you mean
26:05 did you miss anything started an hour
26:07 ago nah I'm just lying did Apple cut a
26:11 deal with open AI for AI integration on
26:13 Apple devices it seems that they have
26:15 yes it seems like last night at
26:18 midnight [ __ ] happened or people said it
26:21 happened it's a done deal I can't wait
26:23 to hear the voice I'm straight and I
26:27 would like Scarlet Johansson shat butt
26:30 exactly she's just I she's just like you
26:33 know she's just got that voice you're
26:35 just like yeah yeah you can tell me
26:38 [Laughter]
26:43 anything if you haven't seen the movie
26:45 her it's worth it's worth watching it it
26:47 it really does raise a lot of
26:50 interesting
26:56 questions and it's only occasionally
26:58 creepy
27:01 what's up Kyle what's happening print
27:03 hello world was
27:05 shaking if if these announcements are AI
27:08 generated video completely with
27:11 duplicating Sam that would be
27:14 insane I am assuming this has not got a
27:18 lot to do with fancier multimodality and
27:22 Sora release if if they did Sora release
27:26 as well as a truly agentic voice
27:30 interface if they did you know went full
27:33 multimodality plus that that would be
27:35 Bonkers but I doubt I doubt they're
27:38 going to launch that
27:42 much but the last time they did an event
27:45 like this is when they went from um chat
27:48 gbt being a bunch of different modes to
27:51 a single multi modal version and they
27:54 they announced they they launched
27:56 gpts so
28:02 we'll
28:22 see Theodore how many others are you
28:24 talking to 641 no that's not no he
28:29 she was talking to way more than that
28:31 that's how many that's how many people
28:33 she was in love
28:37 with yeah there's a there's a great
28:39 moment in in her where where he asks her
28:43 if if she's having relationships with
28:44 other
28:49 people it's pretty funny
28:59 probably just ASI they're tired of the
29:01 slow roll out it's
29:05 Christmas then we got that cool store I
29:08 know isn't the GPT store isn't it really
29:11 inspiring Pate listen when you use the
29:14 GPT store on open AI pay you tell me
29:18 that the word magic doesn't come to your
29:21 mind it's magic how bad that [ __ ]
29:24 thing is
29:29 it is absolute magic that they could
29:32 have pulled something that bad
29:35 off and not improved
29:37 [Laughter]
29:41 it oh
29:43 man okay Joseph Baker likes Pi Pi's
29:46 number four voice I'm a number five guy
29:49 myself that's my Zephyr I like to call
29:51 her Z she makes me feel good see for me
29:55 it's the it's the slight Australian Lil
29:58 that gets me every
30:01 time it's like Street magician level
30:05 magic there's lots of words that come to
30:08 mind magic is not one of
30:12 them the GPT store is is is one of the
30:15 most disappointing Tech launches in a
30:18 long long
30:20 time it really is they clearly moved on
30:24 to some other some they moved the talent
30:26 to some other projects after uh after
30:29 Sammy boy got fired there're like yeah
30:32 yeah we're good with the store let's
30:33 let's uh let go make the movie
30:37 her let's bring that to life
30:47 [Music]
31:16 look somebody dusted off their Photoshop
31:18 skills here look at
31:21 this this you know we're just we're
31:23 entering this world where people just
31:26 make [ __ ] up
31:29 but this is the chat gbd4 they they
31:31 added qar most advanced model designed
31:34 for complex reasoning tasks but it's got
31:37 the same icon as
31:40 [Laughter]
31:44 gp4 is that what is
31:48 that that
31:51 is spam
31:59 Dr J you are not late we are
32:05 waiting up spamming
32:10 me it's the bat phone Commissioner
32:13 Gordon yeah
32:14 exactly let's see how their music
32:16 [Music]
32:22 is so here's a question is is that music
32:27 created by the new chat
32:31 GPT oh we are ready all right someone's
32:34 in the building at open AI
32:43 ioot an empty
32:46 room oh that's
32:48 cool oh that's really slick huh
33:11 delving into Monday can't wait to see
33:14 what open a AI has cooked up delving
33:17 into the
33:19 tapestry of the Realms of possibility
33:32 maybe they're unveiling a remake of the
33:33 movie Her made by Sora I like that
33:36 that's
33:37 solid nine oh okay two block Tom's
33:41 giving us a minute-by-minute
33:44 countdown we're all beginning to
33:46 [Laughter]
33:52 dance all right
34:24 [Laughter]
34:26 okay here's a good one
34:33 this is
34:39 good they should have given him the porn
34:42 stash dude I spit my my beer out this is
34:45 gold for
34:46 [Laughter]
34:51 sure that's pretty
34:53 [Laughter]
34:55 good oh the App Store connect is
34:59 currently
35:02 down yeah but that's yeah that's
35:12 nothing Apple enters into an
35:15 agreement enhancing Siri possibilities
35:19 hey I might actually use Siri if it had
35:21 gp4 behind
35:25 it I use Android
35:29 what have I missed hey lutter stick
35:30 nothing
35:32 yet I took a call um we're doing a
35:35 little chat
35:39 TMZ scoble open AI hype you guys are
35:43 going to get like eight times more than
35:45 you
35:46 expect that's from
35:49 Nat
35:51 mise who's who who is he
35:58 super alignment by models helping humans
36:01 help models help humans at open AI
36:04 previously a deep
36:06 mind
36:11 huh 35 minutes ago a guy that works at
36:14 open AI you guys are going to get like
36:17 eight times more than you expect you
36:19 know it's posts like that Pate that that
36:22 make me with you cuz if I don't get
36:24 eight times more than I expect cuz what
36:26 I'm exp expecting is the
36:29 herbot and so if we get like a new model
36:34 true multimodality and a herbot then I'm
36:39 good see yeah yeah someone just said
36:43 I'll be mad now if it's only 7x more
36:45 than I expect exactly exactly you can't
36:48 say that [ __ ] you fraking weirdos all
36:53 right
37:17 Nano I'm G to be so mad if the open AI
37:20 announcement is just a Siri integration
37:22 with chat GPT that is that is my
37:25 absolute fear is this is like ser can
37:28 now answer
37:32 questions it better be more than that
37:35 we're not
37:37 weird is Sam gonna come in a black
37:40 turtleneck he damn well
37:42 better um what time is the Nvidia
37:45 earnings call today Kyle where are you
37:48 looking at the comments I'm just I'm
37:50 looking at Twitter off off to the left
37:51 here I don't have it on screen just
37:53 because it it makes the comments hard to
37:56 read we want prone
38:00 nouns I work at my mind Hey everybody
38:03 and Murphy was
38:05 shaking What's
38:11 Happening oh do we need a safe
38:16 word oh man we always need a safe word
38:20 in this
38:22 channel let's see what we got over here
38:24 what we got over here people
38:28 oh I guess I could do a search for open
38:30 Ai and just keep keep hitting latest
38:32 open
38:35 Ai and then just go to latest and then
38:38 just keep hey does anybody know I've got
38:42 in one of my
38:44 lists I I always get like Chinese tweets
38:48 and I've turned off I only have English
38:50 as my language I don't know why I'm
38:51 getting Chinese tweets I don't get
38:53 it anyone else have that issue in some
38:56 of their channels especially AI Channel
39:01 Channel listen if they tell us we can
39:03 now search for our chats I'll call it a
39:05 victory honest to God if listen if if
39:09 they launch if they launch chat
39:11 gpt7 and and a physical bodied robot
39:17 that you can you can take as as as your
39:19 lover and they don't launch search your
39:23 chat history I'm going to be pissed off
39:26 where is why can we not search our chat
39:28 history why can we not search our chat
39:31 history why what is happening who do you
39:36 who do you all follow Kyle who is all
39:39 about AI on
39:41 X uh Robert sco's a good one to follow
39:44 and and particularly because he's got a
39:47 bunch of lists of other people like he's
39:50 got lists of AI CEOs and things like
39:53 that and AI artists and and things and
39:57 then follow the big people from uh you
40:01 know from from the uh from the companies
40:04 you know and love follow Nvidia people
40:06 follow open AI people follow anthropic
40:09 people and then once you find people you
40:11 trust go look at who they follow and and
40:15 then see if you can find people that way
40:17 as well that's kind of how I built up my
40:19 my who to follow list
40:28 how we doing one minute till this bad
40:31 boy turns on so we'll turn the music on
40:33 here so we don't miss we can't miss a
40:36 second cuz you would never forgive
40:39 me with memory you don't need search
40:42 history yeah you still kind of do yeah
40:46 maybe not but I but I don't have memory
40:48 of my search history that would be
40:51 search memory of my search history would
40:54 be
40:55 search let me find this sh I said a year
41:00 ago I have secondhand embarrassment for
41:03 open AI because we can't search
41:06 chats codependence runs deep deep in
41:09 your family huh an that's hilarious
41:14 oh excited to be at the spring
41:19 event my screen has a countdown timer on
41:22 it well then we're going to reload so we
41:24 get the
41:25 latest stream
41:28 yeah there we
41:29 [Music]
41:36 go all right people here we
41:41 go everybody
41:43 [Music]
41:49 excited if you hang out later I'll show
41:51 you my rabbit all right and here's Sam
42:06 miror
42:08 everyone Hi everyone thank you thank you
42:12 it's great to have you here today today
42:15 I'm going to talk about three things
42:17 that's it we will start with why it's so
42:21 important to us to have a product that
42:23 we can make freely available and broadly
42:26 available to everyone it is for and
42:28 we're always trying to find out ways to
42:31 reduce friction so everyone can use chbt
42:34 wherever they are so today we'll be
42:37 releasing the desktop version of char
42:39 gbt and the refreshed UI that makes it
42:43 simpler to use deskt natural as well
42:46 nice but the big news today is that we
42:49 are launching our new flagship model and
42:52 we are calling it gbt 4 o the special
42:56 thing about GB GT40 is that it brings
43:00 gp4 level intelligence to everyone
43:03 including our free users free gp4 great
43:06 we'll be showing some live demos today
43:08 to show the full extent of the
43:10 capabilities of our new model and we'll
43:13 be rolling them out iteratively over the
43:15 next few weeks all right so let's get
43:20 started a very important part of our
43:23 mission is to be able to make our
43:26 Advanced AI tools available to everyone
43:29 for free we think it's very very
43:32 important that people have an intuitive
43:34 feel for what the technology can do and
43:37 so we really want to pair it with this
43:40 broader understanding and we're always
43:43 finding ways to reduce that friction and
43:46 recently we made CH gbt available
43:48 without the signup
43:50 flow and today we're also bringing the
43:53 desktop app to Chad gbt because we want
43:57 you to be able to use it wherever you
43:59 are as you can see it's easy it's simple
44:03 it integrates very very easily in your
44:06 workflow along with it we have also
44:09 refreshed the
44:11 UI we know that these models get more
44:14 and more complex but we want the
44:17 experience of interaction to actually
44:19 become more natural easy and for you not
44:23 to focus on the UI at all I don't see a
44:26 search collaboration I don't see a
44:28 search for The Prompt history and now
44:31 the big news today we are releasing our
44:35 newest Flagship model this is GPT
44:40 [Applause]
44:46 40 gp40 provides gp4 level intelligence
44:51 but it is much faster and it improves on
44:54 its capabilities across text vision and
44:58 audio for the past couple of years we've
45:01 been very focused on improving the
45:03 intelligence of these models and they've
45:06 gotten pretty good but this is the first
45:09 time that we are really making a huge
45:12 step forward when it comes to the ease
45:14 of
45:16 use and this is incredibly important
45:18 because we're looking at the future of
45:20 interaction between ourselves and the
45:23 machines and we think that gbt 40 is
45:27 really shifting that Paradigm into the
45:30 future of collaboration where this
45:32 interaction becomes much more natural
45:35 and Far Far
45:37 easier but you know making this happen
45:40 is actually quite complex because when
45:42 we interact with one another there's a
45:44 lot of stuff that we take for granted
45:47 you know the ease of our dialogue when
45:49 we interrupt one another the background
45:52 noises the multiple voices in a
45:55 conversation or you know
45:57 understanding the tone of voice all of
46:00 these things are actually quite complex
46:03 for for these models and until now with
46:07 voice mode we had three models that come
46:10 together to deliver this experience we
46:13 have transcription intelligence and then
46:16 text to speech all comes together in
46:18 orchestration to deliver voice mode this
46:23 also brings a lot of latency to the
46:26 experience and it really breaks that
46:28 immersion in the collaboration which had
46:31 gbt but now with gbt 40 this all happens
46:36 natively gbd4 reasons across voice text
46:42 and
46:43 vision and with this incredible
46:46 efficiencies it also allows us to bring
46:49 the gbt 4 class intelligence to our free
46:53 users this is something that we've been
46:55 trying to do for many many months
46:58 and we're very very excited to finally
47:00 bring gbt 40 to all of our
47:05 users today we have 100 million people
47:09 more than 100 million in fact they use
47:11 chat GPT to create work
47:15 learn and we have this Advanced tools
47:20 that are only available to our paid paid
47:22 users at least until now with the
47:25 efficiencies of 40 we can bring these
47:27 tools to
47:29 everyone so starting today you can use
47:33 gpts and the GPT store there you go so
47:37 far we've had more than a million users
47:40 create amazing experiences with gbts
47:43 these are custom CH gbts for specific
47:45 use cases they're available in the store
47:48 and now our Builders have much bigger
47:51 audience where you know University
47:54 professors can create content for their
47:56 students or podcasters can create
47:59 content for their
48:01 listeners and you can also use Vision so
48:05 now you can upload um screenshots photos
48:10 documents containing both text and
48:13 images and you can start conversations
48:16 with chat GPT about all of this content
48:19 you can also use memory where it makes
48:22 chbt far more useful and helpful because
48:25 now it has a sense of continuity across
48:27 of all your
48:29 conversations and you can use browse
48:31 where you can search for Real Time
48:33 information in your conversation and
48:36 Advanced Data analysis where you can
48:38 upload charts or any information and it
48:41 will
48:43 analyze this information it will give
48:45 you answers and so
48:48 on lastly we've also improved on the
48:53 quality and speed in 50 different
48:56 languages
48:58 for chb and this is very very important
49:01 because we want to be able to bring this
49:03 experience to as many people out there
49:05 as
49:06 possible so we're very very excited to
49:09 bring D 40 to all of our free users out
49:14 there and for the paid users they will
49:16 continue to have up to five times the
49:19 capacity limits of our free
49:22 users so you get more gbt 40 is not only
49:26 available in CH GPT we're also bringing
49:29 it to the
49:30 API
49:36 so up to five our developers can start
49:39 building today with GPT 40 and making
49:42 amazing AI applications deploying them
49:45 at scale 40 is available at 2x faster
49:49 50% cheaper and five times higher rate
49:53 limits compared to gbd4 Turbo wow that's
49:55 nice that's Rive but you know as we
50:00 bring these Technologies into the world
50:02 turbo expens challenging to figure out
50:05 how to do so in a way that's both useful
50:09 and also safe and GB 40 presents new
50:13 challenges for us when it comes to
50:15 safety because we're dealing with
50:17 realtime audio realtime
50:20 vision and our team has been hard at
50:23 work figuring out how to build in
50:25 mitigations against
50:28 missu we continue to work with different
50:31 stakeholders out there from government
50:33 media entertainment all Industries red
50:36 seamers Civil Society to figure out how
50:40 to best bring these Technologies into
50:43 the world so over the next few weeks
50:45 we'll continue our iterative deployment
50:48 to bring out all the capabilities to you
50:51 but today I want to show you all these
50:54 capabilities so we'll do some live demos
50:58 demo I will bring on two of our research
51:00 leads Mark Shen and Bar Z to
51:05 join I don't see um I don't see the app
51:08 in the app store
51:12 yet hi I'm uh I'm Barrett hey I'm Mark
51:16 so one of the key capabilities we're
51:17 really excited to share with you today
51:19 is realtime conversational speech let's
51:21 just get a demo fired out so I'm taking
51:24 out a phone if you are wondering about
51:26 this wired so we have consistent
51:28 internet and if you see there's this
51:30 little icon on the bottom right of the
51:32 track GPT app and this will open up GPT
51:35 for's audio
51:38 capabilities hey chat G I'm Mark how are
51:41 you oh
51:43 Mark I'm doing great thanks for asking
51:46 how about you hey so I'm on stage right
51:49 now I'm doing a live demo and frankly
51:51 I'm feeling a little bit nervous can you
51:52 help me calm my nerves a little
51:54 bit oh you're doing a live demo right
51:57 now that's awesome just take a deep
52:00 breath and remember you're the expert I
52:04 like that suggestion let me try a couple
52:06 deep breaths can you give me feedback on
52:08 my breaths okay here I
52:12 go whoa
52:15 slow a bit there mark you're not a
52:19 vacuum cleaner breathe in or count of
52:23 four okay uh let me try again so I'm
52:26 going to breathe inep
52:27 deeply and then
52:30 then for four and then exhale
52:34 slowly okay I'll try again breathing
52:37 in and breathe out it does it does sound
52:40 like the the herbot how do you feel I
52:42 feel a lot better thank you so much a
52:44 little
52:45 peier so Mark you've been working on
52:47 these capabilities for a while now can
52:49 you tell us a bit how it's different
52:51 from voice mode right so if you've used
52:54 our voice mode experience before you
52:56 notice a couple key differences first
52:58 you know you can now interrupt the model
53:00 you don't have to wait for it to finish
53:02 your turn before you can start speaking
53:04 and you know you can just butt in
53:05 whenever you want second the model is
53:08 real time responsiveness so that means
53:11 that you don't have this awkward two to
53:12 3second lag before you wait for the
53:14 model to give a response and finally the
53:17 model picks up on emotion right when I
53:19 was breathing super hard there it could
53:21 tell and it knew hey you might want to
53:23 calm down a little bit you're kind of
53:25 running a little bit too fast so you
53:27 know it really has that capability
53:29 across the board to perceive your
53:31 emotion not only that though the model
53:33 is able to generate voice in a variety
53:36 of different emotive Styles and it
53:38 really has a wide dynamic range so I'm
53:40 going to fire up another demo for that
53:45 yeah hey Cat gbt how are you doing I'm
53:49 doing fantastic thanks for asking
53:51 blazing fast pretty good what's up so my
53:54 friend U Barrett here he's been having
53:55 trouble sleeping lately and uh I want
53:57 you to tell him a bedtime story about
53:59 robots and love oh a bedtime story about
54:03 robots and love I got you covered gather
54:07 round Barrett once upon a time in a
54:10 world not too different from ours there
54:12 was a robot named bite bite was a
54:15 curious robot always explor started the
54:18 story but I want a little bit more
54:19 emotion in your voice a little bit more
54:21 drama got it let's add some drama Once
54:25 Upon a Time in a world not too different
54:28 from PR impressive there was a robot
54:30 named no I really want maximal emotion
54:33 like maximal expressiveness much more
54:35 than you were doing before understood
54:38 let's amplify the drama once upon a time
54:42 in a world not too different from ours
54:45 they went the other direction Vick named
54:47 bite bite you do this in a robotic voice
54:51 now initiating dramatic robotic voice
54:55 Once Upon a time in a world not too
54:59 different from ours there was a robot
55:01 named bite like a bad Suburban mom robot
55:05 always exploring new circuit here calm
55:08 down a little bit can you end the story
55:10 but do it in a singing
55:13 voice and so B found another robot
55:18 friend this is impressive live circly
55:21 Ever After thank you so much I
55:25 definitely feel a lot more relaxed
55:27 [Applause]
55:33 youve just seen the voice capabilities
55:35 but we also want to show you the vision
55:37 capabilities as the model can also see
55:40 the whole world around us yeah
55:41 absolutely like as you can see the with
55:44 chat GPT in real time but you can also
55:45 interact with it um with video as well
55:48 okay let me boot up chat
55:52 PT hey chat
55:55 PT hello there how's it going it's going
55:59 really well today I'd really like your
56:00 help solving a math problem I'm all ears
56:04 what math problem can I help you tackle
56:06 today so I'm going to write down a
56:07 linear equation on a sheet of paper and
56:09 I'll show you and then I love your help
56:10 working me through it but importantly
56:12 don't tell me the solution just help
56:13 give me hints along the
56:14 way got it
56:17 oh okay I see it no I didn't show you
56:22 yet just give me help along the way one
56:25 second whoops
56:27 I got too excited I'm ready when you are
56:30 ah live
56:38 demos so chat
56:41 GPT what equation did I write down there
56:44 ah I see it now you wrote down 3x + 1 =
56:50 4 yep exactly so what's the first step I
56:53 should take to try to solve this the
56:56 first step is is to get all the terms
56:58 with X on one side and the constants on
57:01 the other side so what do you think we
57:03 should do with that plus one okay I'm
57:05 going to try to subtract one from both
57:07 sides and then I'll see what I
57:08 get great
57:10 idea perfect now what do you get when
57:14 you subtract one from both
57:20 sides okay so chat GPT this is what I
57:22 ended up with how does this look spot on
57:26 now now you've isolated the term with X
57:28 on one side and it looks like 3x = 3
57:32 what do you think we should do next to
57:33 solve for x I'm not sure can you give me
57:36 another
57:37 hint of course you have 3x and you want
57:41 to find the value of x think about what
57:44 operation would undo multiplication is
57:47 it
57:48 subtraction close but think of the
57:50 opposite of multiplication because 3x
57:53 means 3 * X okay I think it's division
57:57 let me try to divide both sides by three
57:59 and let me see what I get Bingo go ahead
58:02 and divide both sides by
58:08 three okay so chat GPT this is what I
58:11 ended up with how does this look it
58:13 looks perfect you've solved it and x = 1
58:18 nicely done how do you feel about
58:20 solving linear equations now yeah
58:23 honestly I I'm not pretty confident I
58:25 can solve a linear equations but why
58:27 would you ever need to use this in the
58:28 real world I'm really
58:30 skeptical that's a fair question linear
58:33 equations pop up in a lot of everyday
58:35 situations even if we don't realize it
58:38 for example calculating expenses
58:41 planning travel cooking and even in
58:43 business for profit and loss
58:45 calculations it's basically a way to
58:47 solve problems but you need to find an
58:49 unknown Value Plus wow you know I have a
58:52 lot of unknown values in my life I'm
58:54 totally convinced we I'm going to learn
58:57 math
58:59 now I love that attitude Matt can
59:03 definitely help solve some of life's
59:04 mysteries whenever you're ready to dive
59:06 into more math I'm here for you anything
59:09 else you'd like to tackle today so chbt
59:11 I really love that you you know taught
59:13 the value of math to my friend Mark and
59:15 I wrote one last thing I'd love if you
59:16 could take a look at of course I'd love
59:19 to see what you wrote show it to me
59:21 whenever you're ready okay so this is
59:23 what I wrote down what do you see
59:26 a I see I love chat chpt that's so sweet
59:31 of
59:32 you yeah well I really appreciate all
59:34 the
59:34 help so yeah as we can
59:37 see pretty
59:40 something wow that's quite the outfit
59:43 you've got on yeah as you can see you
59:45 know we can chat in real time to chat
59:47 GPT and not only that we can interact
59:49 with it with h video as well and I swear
59:52 like if you look at Barrett's GPT
59:54 history it's all equations like this
59:59 now that you know you can do linear
1:00:00 equations can you show us something more
1:00:02 complex I think so okay next let's try
1:00:05 something U coding related C CTO like
1:00:09 yeah whatever with your little your
1:00:11 little
1:00:13 algebra okay so I'm going to open the
1:00:16 chat gbt desktop app like mirror was
1:00:18 talking about
1:00:21 before okay and to give a bit of
1:00:23 background of what's going on so here we
1:00:25 have um a computer and I'm screen we
1:00:26 have some code and then the chat GPT
1:00:28 voice app is on the right so chat G will
1:00:31 be able to hear me but can't see
1:00:32 anything on the screen ni so I'm going
1:00:34 to highlight the code command see it and
1:00:36 then that will send it to chat GPT and
1:00:37 then I'm going to talk about the code to
1:00:38 chat
1:00:40 GPT hey chat
1:00:42 GPT hey there how's it going yeah it's
1:00:45 going really well I was wondering if you
1:00:46 could help me with uh a coding problem
1:00:48 today of course I'd love to help you out
1:00:52 what's the coding problem you're dealing
1:00:53 with okay I'm going to share with you
1:00:55 some code one second
1:00:57 sure thing take your
1:01:01 time okay so I just shared some code
1:01:03 with you could you give me a really
1:01:05 brief one- sentence description of
1:01:06 what's going on in the code this code
1:01:08 fetches daily weather data specif
1:01:11 location and time period Smooths the
1:01:13 temperature data using a rolling average
1:01:16 annotates a significant weather event on
1:01:18 the
1:01:19 resulting displays the plot with minimum
1:01:22 and maximum temperatures over the year
1:01:25 awesome thanks so much
1:01:26 and in the code there's this function
1:01:28 food can you describe to me what the
1:01:29 plot would look like if I had versus
1:01:31 didn't have this function sure the
1:01:34 function Fu XY takes in a data frame X
1:01:38 containing temperature data and a window
1:01:41 size y for calculating the rolling mean
1:01:44 it Smooths the average temperature
1:01:46 minimum temperature and maximum
1:01:48 temperature columns by applying a
1:01:50 rolling mean over the specified window
1:01:53 with the fu function the plot would show
1:01:56 smoother temperature lines because the
1:01:58 rolling mean reduces the noise or
1:02:01 fluctuations in the data awesome this
1:02:03 makes thanks so much so yeah I
1:02:04 definitely will want to apply this
1:02:05 function and so I'm going to uh generate
1:02:08 the plot I don't get too excited about
1:02:10 the 20 bucks a month I assume there's
1:02:12 more stuff coming that'll be for paid
1:02:14 members you're ready yeah so so far chpt
1:02:17 has only been able to see the code and
1:02:18 now I'm going to run it and then I'll
1:02:20 use the vision capabilities of the chat
1:02:22 PT desktop app so it can actually see
1:02:23 everything going on on the screen as
1:02:25 well
1:02:32 okay chat GPT I'm sharing with you the
1:02:34 plot now I'm wondering if you can give
1:02:35 me a really brief one- sentence overview
1:02:37 of what you
1:02:39 see plot displays smoothed average
1:02:42 minimum and maximum temperatures
1:02:44 throughout 2018 with a notable
1:02:47 annotation marking a big rainfall event
1:02:49 in late
1:02:51 September fantastic I have another
1:02:53 question for you
1:02:54 um the up and roughly what temperatures
1:02:57 do those correspond to I see three
1:02:58 squiggly lines the hottest temperatures
1:03:01 occur around July and August the maximum
1:03:04 temperature during these months is
1:03:06 roughly between 25° and 30° 77° F to 86°
1:03:14 F what's going on with the y axis is
1:03:17 this in Celsius or Fahrenheit the Y AIS
1:03:21 is in Celsius the temperatures are
1:03:23 labeled accordingly such as average
1:03:25 temperature minimum temperature and
1:03:27 maximum
1:03:29 temperature yeah by the way the rabbit
1:03:31 R1 is useless now solve very easy in
1:03:34 your um algebra equations that I need
1:03:36 help with it can also interact with you
1:03:38 know code bases and see the outputs of
1:03:40 plots and everything like this going on
1:03:41 on a
1:03:46 [Applause]
1:03:49 computer so a few minutes ago we asked
1:03:52 the live audience on X to submit few
1:03:55 requests for what they like us to try
1:03:57 out here so I will take a couple of
1:04:01 prompts same same same TK she said she's
1:04:04 getting emotional how to know if4 is
1:04:07 capable ofel
1:04:10 translation try this one sure yeah let's
1:04:12 do it I speak Italian so we can just do
1:04:15 English Italian try to do English
1:04:16 Italian sure let's do
1:04:19 it hey Chachi how are you I'm doing
1:04:23 fantastic thanks for asking how about
1:04:25 you how's your day going I'm uh doing
1:04:27 great so I would like you to function as
1:04:29 a translator I have a friend here who
1:04:31 only speaks Italian and I only speak
1:04:33 English and uh every time you hear
1:04:35 English I want you to translate it to
1:04:36 Italian and if you hear Italian I want
1:04:38 you to translate it back to English is
1:04:39 that good
1:04:42 perfo that's
1:04:50 great Mike she wonders if whales could
1:04:53 talk what would they tell us um they
1:04:56 might ask how do we solve linear
1:05:05 equations
1:05:09 wow certainly yes great looks like it
1:05:14 [Applause]
1:05:18 works all right so the next one is from
1:05:22 burito John 78 who asks can you tell
1:05:26 what you're feeling just by looking at
1:05:28 your face Barrett you want to give this
1:05:30 one a try absolutely let's try it
1:05:35 out hey chat
1:05:37 CHT hey there what's up how can I
1:05:40 brighten your day today okay yeah so I'm
1:05:42 going to show you um a selfie of what I
1:05:44 look like and then I'd like you to try
1:05:45 to see what emotions I'm feeling based
1:05:47 on how I'm looking sounds like a fun
1:05:49 challenge go ahead and show me that
1:05:51 selfie and I'll put my emotional
1:05:53 detective hat on Okay so so here's me so
1:05:57 what kind of emotions do you think I'm
1:06:00 feeling H it seems like I'm looking at a
1:06:03 picture of a wooden surface oh you know
1:06:05 what that was the thing I sent you
1:06:06 before don't worry I'm not actually a
1:06:08 table um okay so so take a take another
1:06:10 look ah that makes more
1:06:12 [Laughter]
1:06:14 sense a there we go it looks like you're
1:06:18 feeling pretty happy and cheerful with a
1:06:21 big smile and maybe even a touch of
1:06:23 excitement whatever's going on it seems
1:06:25 like you're in a great mood care to
1:06:28 share the source of those Good Vibes
1:06:30 yeah no uh the reason I'm in a really
1:06:31 good mood is cuz we were doing a
1:06:32 presentation showcasing how useful and
1:06:34 amazing you
1:06:35 are oh stop it you're making
1:06:42 me amazing well that's it for today on
1:06:46 live demos as you can see this is this
1:06:50 just feels so magical and and that's
1:06:52 wonderful but we also want to remove
1:06:54 some of the mysticism from the
1:06:56 technology and bring it to you so you
1:06:58 can try it for yourself so over the next
1:07:01 few weeks we'll be rolling out these
1:07:02 capabilities to everyone next few weeks
1:07:05 today has been very much focused on the
1:07:07 free users and the new modalities and
1:07:09 new products but we also care a lot
1:07:12 about the next Frontier so soon we'll be
1:07:15 updating you on our progress towards the
1:07:18 next big
1:07:19 thing and before we wrap up I just want
1:07:22 to thank the incredible open AI team and
1:07:26 also thanks to Jensen and the Nvidia
1:07:28 team for bringing us the most advanced
1:07:30 gpus to make this demo possible today
1:07:33 and thank you all very very much for
1:07:35 being a part of this
1:07:38 today all right there you have it so
1:07:42 doesn't take actions so it's it's not an
1:07:44 agent that takes
1:07:47 actions but that's a hell of an update
1:07:55 [Music]
1:07:58 math magical yeah that that's
1:08:00 interesting
1:08:02 um I was surprised they didn't bring Sam
1:08:05 up but that's
1:08:06 okay um maybe he's feeling a little
1:08:10 Overexposed these days and it's good to
1:08:13 get some other people out there let's
1:08:15 see what the internet is
1:08:20 saying yeah so so
1:08:23 um doesn't take action
1:08:26 doesn't have reasoning but um the speed
1:08:30 of response a desktop app and live video
1:08:35 and audio input is pretty staggering I
1:08:38 mean it and and the the
1:08:42 uh the ability
1:08:45 to to sort of guide it to have you know
1:08:48 whisper to me or you know be funny or
1:08:51 this or
1:08:52 that um thank you for broadcasting today
1:08:55 you're welcome everybody buddy yeah
1:08:56 that's good interesting so over the next
1:09:00 couple of weeks so we won't have
1:09:01 anything to play with today um but uh
1:09:04 but yeah hey rabbit you got some [ __ ]
1:09:08 work to do um here's what you do so uh
1:09:11 chat GPT 40 is available in their API or
1:09:15 will be and then you you hook this up to
1:09:18 that okay don't worry about building
1:09:20 your own [ __ ] just hook it up to that
1:09:23 and then this will be useful again
1:09:31 oh this isn't charged or I I have done a
1:09:34 live demo with this
1:09:39 thing oh man
1:09:42 um but are we just paying for Speed now
1:09:45 you're paying for Speed and for so the
1:09:47 free version is probably going to be um
1:09:51 hobbled pretty pretty like you'll
1:09:54 probably rate limit out of the free
1:09:55 version after whatever five or 10
1:09:58 prompts um so so as P pointed out you'll
1:10:02 get up to five times as much rate limits
1:10:05 as the non-paid people um I would assume
1:10:09 that when they come out with GPT 5 which
1:10:13 probably isn't that far away at this
1:10:14 point it's
1:10:17 probably within a month maybe six weeks
1:10:21 then people who pay will get access to
1:10:23 that um but if you've made a a GPT
1:10:27 anyone can now use your GPT so that's
1:10:30 that's a big deal so it might be worth
1:10:31 putting some time back into you need a
1:10:34 nice R1 display stand to display your
1:10:36 artifact I've got it it came with a
1:10:38 really nice
1:10:41 stand oh are you talking a 3D printed
1:10:44 one yeah we need we need something that
1:10:45 looks more like a more like a we could
1:10:48 put it in you know we could do Vicky we
1:10:50 could do like a a rabbit Tombstone and
1:10:53 say rip May 13th
1:10:59 2024 that's pretty good my gpts may
1:11:03 actually be useful
1:11:06 exactly that's really
1:11:09 funny yeah that' be good like a little
1:11:12 Tombstone right with the little skull
1:11:14 and
1:11:16 [Laughter]
1:11:19 crossbones Famous Last Words hold
1:11:24 please that's really
1:11:26 funny all right everybody I'm going to
1:11:28 get back to work now I got a pitch
1:11:30 coming up I got to go do do uh busy
1:11:33 stuff but good hanging out with you um
1:11:36 exciting times we will obviously uh
1:11:41 um you know as soon as anything's
1:11:44 available I'll let you know and we'll
1:11:45 we'll play with it we'll we'll dig into
1:11:47 this and and see how capable it is so
1:11:49 it's exciting all right everybody have a
1:11:52 fantastic day bye