May 13, 2024 OpenAI's Game-Changer: Unveiling GPT-4o and AI Integration with Apple!

Transcript

1. 0:12alrighty we're going live early we're doing it early people we're doing it early so when did she post
2. 0:28this midnight last night good day good day good day what's happening all right so I don't know who Bindu ready is who is
3. 0:45she xaws Google apparently the apple and open AI deal closed last night around midnight hello hello hello so
4. 1:00very possible if that deal closed that could be part of the announcement today um nothing yet on if you go to
5. 1:10chat gp.com nothing nothing new there I haven't checked the the app lately um the
6. 1:25uh here's the video I guess I can keep that that on we'll keep a little background music on there and that way if we're on some
7. 1:36other page it'll come up all right so so that's that's interesting I mean it basically says to me that they
8. 1:51cut a deal with Apple that Apple doesn't quite have their [ __ ] together yet and they'll they'll partner with open AI
9. 1:56until they have their own stuff P modder what's happening sir 3 m storage Jim Ross good to see you Tech Mario what's [Music]
10. 2:09happening Edson subscribe to the live thank you sir appreciate that appreciate it very much what the hell we doing this midw
11. 2:18work day yes we are archetypal architect uh we are 40 minutes away from the open AI event and lots of uh
12. 2:30uh that's distracting lots of uh I'm going to just mute that [ __ ] uh lots of uh are we excited I don't I don't know I
13. 2:41mean the problem with getting excited about these things is if they if they come out with something that's just you
14. 2:46know like you can use chat GPT in your iPhone now I'm not going to be excited um they were hinting enough that you
15. 2:57should go watch the movie Her that it better damn well be it better damn well be you know my all singing all dancing AI
16. 3:12girlfriend it's all I'm [Laughter] saying oh man well it's the opening eye event it is rumored to be a voice agent
17. 3:22uh and uh I'm I'm just on another window here I could actually I could do it here just go look for uh what's going on on the
18. 3:36[Music] twitters holographic displays are coming nice they've been they've been saying holographic displays are coming forever
19. 3:46not not from open AI I'm just reading Twitter right now Apple was the last to smartphones Google was the 17th search engine so
20. 3:59he's basically saying don't worry about Apple that's Robert scoble oh nice more disturbing robots does open Ai and chat
21. 4:15GPT do open Ai and chat GPT have a business relationship open AI is the company that makes chat GPT so yes they are the uh the makers of
22. 4:31I'm looking to get agents and Bots yep I'm hoping we get a chatbot that'll talk dirty without bouncing off the guard
23. 4:37rails in fact he he uh Sam Alman said something about they're trying to figure out a way to allow for for Naughty Bots without them being
24. 4:48dangerous in other ways so um so there it sounds like they're actually working on that believe it or not [Music]
25. 5:03okay that's not very easy for reading when I have white text there is it all right let me just put that thing up that's actually easier to
26. 5:13read all right that's the video there and then I'll just I'll just I'm going to be uh surfing uh the Twitter's let me
27. 5:22go to let me go to Twitter pro pro do
28. 5:48[Music] x.com what's happening everybody did anyone watch watch her over the weekend I watched her on
29. 6:04Sunday and uh it's wild you know it it's funny because the the difference between is I I said to
30. 6:19my uh let's see how am I going to do this can I mute here I might be able to hang on a sec I'm getting a call
31. 6:58for
32. 7:28e
33. 7:58e
34. 8:28e
35. 8:58e
36. 9:28e
37. 9:58e e
38. 10:44all right I'm back I'm unmuted I'm unmuted sorry had to talk business I am I am running a business after all that one right there
39. 10:59okay let's go see what's going on let's go see what's happening uh breaking apples finalizing a deal that was 7 hours
40. 11:12ago so if there's that much Buzz about them finalizing a deal it sounds like can you hear me now I I prefer to
41. 11:21this way P Gotta Love You Pate what's happening man uh um there will be no singing we will not have
42. 11:36fun there will be no [Music] pleasure you know there's a part of me that wants to like the
43. 11:52uh the multicolumn version of Twitter but I can't I just can't pay attent it's too much even for my ADD [Laughter]
44. 12:04brain so I'm going to go to normal Twitter see what people is saying open AI see you soon 20 minutes
45. 12:24ago that's really funny let's see copy link here we'll show if I find good memes I'll show them to you here's a good
46. 12:39meme literally everyone right now pretty good pretty good pretty good people
47. 13:02[Music] what's going on with y'all anything happening audio is good I hear it nice
48. 13:29oh that's funny it's Kyle away my screen's broken right where he placed his face we are early I'm going to call it work thank
49. 13:40you for thank you for letting people know what's going on this is exciting brand new AI features well we hope it's
50. 13:47exciting Rudy nothing exciting Google I IO is tomorrow but I don't have much to do with that um yeah I might do I
51. 13:55haven't heard much from google.io but I would assume they're going to be launching something if you've got if
52. 14:02you've got apple and open AI assuming that they announce something today that would be interesting I I can't imagine that they're going to
53. 14:13announce anything other than whatever capability they're announcing today will be available at some point in the future with apple but
54. 14:24you know they they did do a lot with mik Microsoft before anyone knew about it and then they kind of you know announced this thing and
55. 14:34Microsoft launched their uh their chap up pretty quickly but we'll we'll see we will see Pate is there anything
56. 14:44anything that you know is coming from Google that you can hint hint at had a panic attack almost forgot to block out
57. 14:51my calendly so no interruptions I know I I got lucky because I had I had I had a meeting that was the exact block on the
58. 14:59open AI event but we were able to reschedule it so I was like no still working on ragged attention and Max text very
59. 15:18cool should do this and a Google meet at the same time I could do that hey I don't want to do it right now
60. 15:34yeah that's I next time Daniel that's a good idea that's I I've got to figure out I've got to figure out a a a multi-
61. 15:43uh a multistream way to do Tik Tok because it's just it's too limiting to have to like squish squish a
62. 15:52desktop you know window into into a Tik Tock View
63. 16:08new open AI homepage is looking really cool is it wait what's the new open AI homepage this
64. 16:26one and so relatively old stuff 25 minutes 25 minutes what are we
65. 16:41going to talk about people wonder if there's going to be an AI wallet that we're going to use with
66. 16:55an AI assistant probably but not I it's it's way too early for for anything like that um they they've got to get
67. 17:08their their basic functionality out there before you can start connecting it to uh Payment Systems so I don't think we'll see any of
68. 17:19that I'm guessing it's going to be an update to basic chat GPT and whatever this agent thing's going to be I think Google might launch stuff
69. 17:32that I've been using internally for a while it's very useful okay that would be cool that'd be nice P do you know I I
70. 17:39don't watch Google IO events enough to know do they generally do like the dramatic storytelling thing where they
71. 17:46announce all the boring [ __ ] first and save the good [ __ ] to the end or are they going to lead with the good
72. 17:52[ __ ] trying to figure out cuz the Google iio events are long I think when's it when's is a good time to watch
73. 18:03it mobile with dark theme looks
74. 18:20[Music] cool already tens of thousands are watching well nothing yet this is from Robert scoble hey AI can you watch the stream
75. 18:34and send me notifications when it starts it'll start at 10:00 a.m. dummy is that Elon musk's 10 a.m. or Sam alman's that's pretty [Laughter]
76. 18:49good oh man who's tore
77. 19:03Blau lead engineer at AI PRM Corp he says okay this is real we're getting gp4
78. 19:20Omni here I'll show you the uh I will show you the chat TMZ that's that's why we're here people chat
79. 19:34TMZ now this is the little text there says I just discovered GPT for Omni today it's has it been around for a
80. 19:50while where you what where did he see it Source open.com cdn.com hello-
81. 20:11gp-4 visual narratives poster creation character design all right I'm going to try to go
82. 20:26here wait why can I not copy that oh cuz I'm hitting the wrong key copy image let's go to chat J paste that image in say type
83. 20:51[Music] this here's the typed version of the URL let's go there shall we [Music] people site can't be reached there's a
84. 21:06big [ __ ] surprise sorry flipping surprise it's daytime we we don't have potty mouth in the daytime well we do but I try to control
85. 21:18it a little better all right that didn't work for me but whatever all right so we don't know if that's [ __ ] or
86. 21:35[Music] not B at TMC P so here's the secret about pate and chat TMZ he actually loves chat TMZ
87. 21:50he loves gossip he loves speculation he hates logic and reasoning and science hates it secretly very secretly all
88. 22:02right what are we doing here people do we got more come on give me the latest I knew it yep Can't Get Enough a tech
89. 22:18speculation looking forward to Google Io tomorrow all right Logan kill Patrick is uh in the auditor torium taking video of the
90. 22:32stage Matt wolf today's starts announcement season open AI today Google tomorrow Microsoft next week June we have Cisco qualcom and
91. 22:43apple I'm excited and fully anticipating a very overwhelmed next couple of months yes I would agree with
92. 22:54that I like the cold facts until then no m z uh I bet Pate loves that they are calling this magic Sam mman said he says it feels
93. 23:09using this feels like magic I will I will die on that sword um any any technology you know any significantly
94. 23:23Advanced wait yeah significantly advanced technology is indistinguishable from [Laughter]
95. 23:40[Music] magic anyone find it amusing that open AI live show is on Google that's pretty funny Sam Alman earlier said oh yeah I
96. 23:56was asking before did anyone see the movie her over the weekend or seen it recently um Sam Alman is is in an
97. 24:05interview saying here actually let me go grab it let me grab this post so Reed Hoffman interview I don't know when this was
98. 24:17from Sam Alman earlier said that her more than inspired them open AI is shipping Samantha tomorrow hu huge if true so here let's listen to
99. 24:34[Music] this think her got right the number of things that I think her got right that were not obvious at the time like the
100. 24:49whole interaction model with how humans are going to use an AI this idea that it is going to be this like conversational
101. 24:55language interface that was incredibly prophetic and certainly more than a little bit inspired us incredibly prophetic and certainly
102. 25:05more than a little bit inspired us all right Sammy all right Sammy boy you giving us Samantha please tell me you cut a deal
103. 25:15with Scarlet Johansson to be the voice of this thing please okay if they didn't if they didn't cut a deal with Scarlet
104. 25:25Johansson that is it is the biggest Miss of the the [Laughter] century oh
105. 25:48man you have to give it a softer G It's [Laughter] Magic oh yeah did I miss anything oh my you you you
106. 26:02missed it all it's over what do you mean did you miss anything started an hour ago nah I'm just lying did Apple cut a
107. 26:10deal with open AI for AI integration on Apple devices it seems that they have yes it seems like last night at
108. 26:17midnight [ __ ] happened or people said it happened it's a done deal I can't wait to hear the voice I'm straight and I
109. 26:26would like Scarlet Johansson shat butt exactly she's just I she's just like you know she's just got that voice you're
110. 26:35just like yeah yeah you can tell me [Laughter] anything if you haven't seen the movie her it's worth it's worth watching it it
111. 26:47it really does raise a lot of interesting questions and it's only occasionally creepy what's up Kyle what's happening print
112. 27:02hello world was shaking if if these announcements are AI generated video completely with duplicating Sam that would be
113. 27:13insane I am assuming this has not got a lot to do with fancier multimodality and Sora release if if they did Sora release
114. 27:25as well as a truly agentic voice interface if they did you know went full multimodality plus that that would be
115. 27:35Bonkers but I doubt I doubt they're going to launch that much but the last time they did an event like this is when they went from um chat
116. 27:48gbt being a bunch of different modes to a single multi modal version and they they announced they they launched gpts so we'll
117. 28:21see Theodore how many others are you talking to 641 no that's not no he she was talking to way more than that
118. 28:30that's how many that's how many people she was in love with yeah there's a there's a great moment in in her where where he asks her
119. 28:42if if she's having relationships with other people it's pretty funny
120. 28:58probably just ASI they're tired of the slow roll out it's Christmas then we got that cool store I know isn't the GPT store isn't it really
121. 29:10inspiring Pate listen when you use the GPT store on open AI pay you tell me that the word magic doesn't come to your
122. 29:20mind it's magic how bad that [ __ ] thing is it is absolute magic that they could have pulled something that bad
123. 29:34off and not improved [Laughter] it oh man okay Joseph Baker likes Pi Pi's number four voice I'm a number five guy
124. 29:48myself that's my Zephyr I like to call her Z she makes me feel good see for me it's the it's the slight Australian Lil that gets me every
125. 30:01time it's like Street magician level magic there's lots of words that come to mind magic is not one of
126. 30:11them the GPT store is is is one of the most disappointing Tech launches in a long long time it really is they clearly moved on
127. 30:23to some other some they moved the talent to some other projects after uh after Sammy boy got fired there're like yeah
128. 30:31yeah we're good with the store let's let's uh let go make the movie her let's bring that to life
129. 30:46[Music]
130. 31:15look somebody dusted off their Photoshop skills here look at this this you know we're just we're entering this world where people just
131. 31:26make [ __ ] up but this is the chat gbd4 they they added qar most advanced model designed for complex reasoning tasks but it's got
132. 31:37the same icon as [Laughter] gp4 is that what is that that is spam
133. 31:58Dr J you are not late we are waiting up spamming me it's the bat phone Commissioner
134. 32:13Gordon yeah exactly let's see how their music [Music] is so here's a question is is that music created by the new chat
135. 32:31GPT oh we are ready all right someone's in the building at open AI ioot an empty
136. 32:46room oh that's cool oh that's really slick huh
137. 33:10delving into Monday can't wait to see what open a AI has cooked up delving into the tapestry of the Realms of possibility
138. 33:31maybe they're unveiling a remake of the movie Her made by Sora I like that that's solid nine oh okay two block Tom's
139. 33:40giving us a minute-by-minute countdown we're all beginning to [Laughter] dance all right
140. 34:24[Laughter] okay here's a good one this is
141. 34:38good they should have given him the porn stash dude I spit my my beer out this is gold for [Laughter] sure that's pretty
142. 34:52[Laughter] good oh the App Store connect is currently down yeah but that's yeah that's
143. 35:11nothing Apple enters into an agreement enhancing Siri possibilities hey I might actually use Siri if it had gp4 behind it I use Android
144. 35:28what have I missed hey lutter stick nothing yet I took a call um we're doing a little chat TMZ scoble open AI hype you guys are
145. 35:42going to get like eight times more than you expect that's from Nat mise who's who who is he
146. 35:58super alignment by models helping humans help models help humans at open AI previously a deep mind huh 35 minutes ago a guy that works at
147. 36:14open AI you guys are going to get like eight times more than you expect you know it's posts like that Pate that that
148. 36:22make me with you cuz if I don't get eight times more than I expect cuz what I'm exp expecting is the
149. 36:28herbot and so if we get like a new model true multimodality and a herbot then I'm good see yeah yeah someone just said
150. 36:42I'll be mad now if it's only 7x more than I expect exactly exactly you can't say that [ __ ] you fraking weirdos all right
151. 37:17Nano I'm G to be so mad if the open AI announcement is just a Siri integration with chat GPT that is that is my
152. 37:24absolute fear is this is like ser can now answer questions it better be more than that we're not weird is Sam gonna come in a black
153. 37:39turtleneck he damn well better um what time is the Nvidia earnings call today Kyle where are you looking at the comments I'm just I'm
154. 37:49looking at Twitter off off to the left here I don't have it on screen just because it it makes the comments hard to read we want prone
155. 38:00nouns I work at my mind Hey everybody and Murphy was shaking What's Happening oh do we need a safe
156. 38:16word oh man we always need a safe word in this channel let's see what we got over here what we got over here people
157. 38:27oh I guess I could do a search for open Ai and just keep keep hitting latest open Ai and then just go to latest and then
158. 38:38just keep hey does anybody know I've got in one of my lists I I always get like Chinese tweets and I've turned off I only have English
159. 38:49as my language I don't know why I'm getting Chinese tweets I don't get it anyone else have that issue in some
160. 38:55of their channels especially AI Channel Channel listen if they tell us we can now search for our chats I'll call it a
161. 39:05victory honest to God if listen if if they launch if they launch chat gpt7 and and a physical bodied robot
162. 39:17that you can you can take as as as your lover and they don't launch search your chat history I'm going to be pissed off
163. 39:25where is why can we not search our chat history why can we not search our chat history why what is happening who do you
164. 39:36who do you all follow Kyle who is all about AI on X uh Robert sco's a good one to follow and and particularly because he's got a
165. 39:47bunch of lists of other people like he's got lists of AI CEOs and things like that and AI artists and and things and
166. 39:57then follow the big people from uh you know from from the uh from the companies you know and love follow Nvidia people
167. 40:06follow open AI people follow anthropic people and then once you find people you trust go look at who they follow and and
168. 40:14then see if you can find people that way as well that's kind of how I built up my my who to follow list
169. 40:28how we doing one minute till this bad boy turns on so we'll turn the music on here so we don't miss we can't miss a
170. 40:35second cuz you would never forgive me with memory you don't need search history yeah you still kind of do yeah
171. 40:46maybe not but I but I don't have memory of my search history that would be search memory of my search history would be
172. 40:55search let me find this sh I said a year ago I have secondhand embarrassment for open AI because we can't search
173. 41:06chats codependence runs deep deep in your family huh an that's hilarious oh excited to be at the spring
174. 41:19event my screen has a countdown timer on it well then we're going to reload so we get the latest stream yeah there we [Music]
175. 41:36go all right people here we go everybody [Music] excited if you hang out later I'll show
176. 41:51you my rabbit all right and here's Sam
177. 42:05miror everyone Hi everyone thank you thank you it's great to have you here today today I'm going to talk about three things
178. 42:17that's it we will start with why it's so important to us to have a product that we can make freely available and broadly
179. 42:25available to everyone it is for and we're always trying to find out ways to reduce friction so everyone can use chbt
180. 42:34wherever they are so today we'll be releasing the desktop version of char gbt and the refreshed UI that makes it
181. 42:42simpler to use deskt natural as well nice but the big news today is that we are launching our new flagship model and
182. 42:52we are calling it gbt 4 o the special thing about GB GT40 is that it brings gp4 level intelligence to everyone
183. 43:03including our free users free gp4 great we'll be showing some live demos today to show the full extent of the
184. 43:09capabilities of our new model and we'll be rolling them out iteratively over the next few weeks all right so let's get
185. 43:19started a very important part of our mission is to be able to make our Advanced AI tools available to everyone
186. 43:28for free we think it's very very important that people have an intuitive feel for what the technology can do and
187. 43:37so we really want to pair it with this broader understanding and we're always finding ways to reduce that friction and
188. 43:45recently we made CH gbt available without the signup flow and today we're also bringing the desktop app to Chad gbt because we want
189. 43:57you to be able to use it wherever you are as you can see it's easy it's simple it integrates very very easily in your
190. 44:05workflow along with it we have also refreshed the UI we know that these models get more and more complex but we want the
191. 44:16experience of interaction to actually become more natural easy and for you not to focus on the UI at all I don't see a
192. 44:26search collaboration I don't see a search for The Prompt history and now the big news today we are releasing our
193. 44:35newest Flagship model this is GPT [Applause] 40 gp40 provides gp4 level intelligence
194. 44:50but it is much faster and it improves on its capabilities across text vision and audio for the past couple of years we've
195. 45:01been very focused on improving the intelligence of these models and they've gotten pretty good but this is the first
196. 45:09time that we are really making a huge step forward when it comes to the ease of use and this is incredibly important
197. 45:18because we're looking at the future of interaction between ourselves and the machines and we think that gbt 40 is
198. 45:27really shifting that Paradigm into the future of collaboration where this interaction becomes much more natural and Far Far
199. 45:37easier but you know making this happen is actually quite complex because when we interact with one another there's a
200. 45:44lot of stuff that we take for granted you know the ease of our dialogue when we interrupt one another the background
201. 45:52noises the multiple voices in a conversation or you know understanding the tone of voice all of these things are actually quite complex
202. 46:02for for these models and until now with voice mode we had three models that come together to deliver this experience we
203. 46:13have transcription intelligence and then text to speech all comes together in orchestration to deliver voice mode this
204. 46:22also brings a lot of latency to the experience and it really breaks that immersion in the collaboration which had
205. 46:30gbt but now with gbt 40 this all happens natively gbd4 reasons across voice text and vision and with this incredible
206. 46:45efficiencies it also allows us to bring the gbt 4 class intelligence to our free users this is something that we've been
207. 46:55trying to do for many many months and we're very very excited to finally bring gbt 40 to all of our users today we have 100 million people
208. 47:08more than 100 million in fact they use chat GPT to create work learn and we have this Advanced tools
209. 47:19that are only available to our paid paid users at least until now with the efficiencies of 40 we can bring these tools to
210. 47:28everyone so starting today you can use gpts and the GPT store there you go so far we've had more than a million users
211. 47:39create amazing experiences with gbts these are custom CH gbts for specific use cases they're available in the store
212. 47:48and now our Builders have much bigger audience where you know University professors can create content for their
213. 47:55students or podcasters can create content for their listeners and you can also use Vision so now you can upload um screenshots photos
214. 48:10documents containing both text and images and you can start conversations with chat GPT about all of this content
215. 48:18you can also use memory where it makes chbt far more useful and helpful because now it has a sense of continuity across of all your
216. 48:28conversations and you can use browse where you can search for Real Time information in your conversation and
217. 48:36Advanced Data analysis where you can upload charts or any information and it will analyze this information it will give you answers and so
218. 48:48on lastly we've also improved on the quality and speed in 50 different languages for chb and this is very very important
219. 49:00because we want to be able to bring this experience to as many people out there as possible so we're very very excited to
220. 49:09bring D 40 to all of our free users out there and for the paid users they will continue to have up to five times the
221. 49:18capacity limits of our free users so you get more gbt 40 is not only available in CH GPT we're also bringing it to the API
222. 49:36so up to five our developers can start building today with GPT 40 and making amazing AI applications deploying them
223. 49:44at scale 40 is available at 2x faster 50% cheaper and five times higher rate limits compared to gbd4 Turbo wow that's
224. 49:55nice that's Rive but you know as we bring these Technologies into the world turbo expens challenging to figure out
225. 50:04how to do so in a way that's both useful and also safe and GB 40 presents new challenges for us when it comes to
226. 50:15safety because we're dealing with realtime audio realtime vision and our team has been hard at work figuring out how to build in
227. 50:24mitigations against missu we continue to work with different stakeholders out there from government media entertainment all Industries red
228. 50:36seamers Civil Society to figure out how to best bring these Technologies into the world so over the next few weeks
229. 50:45we'll continue our iterative deployment to bring out all the capabilities to you but today I want to show you all these
230. 50:54capabilities so we'll do some live demos demo I will bring on two of our research leads Mark Shen and Bar Z to
231. 51:04join I don't see um I don't see the app in the app store yet hi I'm uh I'm Barrett hey I'm Mark so one of the key capabilities we're
232. 51:17really excited to share with you today is realtime conversational speech let's just get a demo fired out so I'm taking
233. 51:24out a phone if you are wondering about this wired so we have consistent internet and if you see there's this
234. 51:30little icon on the bottom right of the track GPT app and this will open up GPT for's audio capabilities hey chat G I'm Mark how are you oh
235. 51:42Mark I'm doing great thanks for asking how about you hey so I'm on stage right now I'm doing a live demo and frankly
236. 51:50I'm feeling a little bit nervous can you help me calm my nerves a little bit oh you're doing a live demo right
237. 51:56now that's awesome just take a deep breath and remember you're the expert I like that suggestion let me try a couple
238. 52:06deep breaths can you give me feedback on my breaths okay here I go whoa slow a bit there mark you're not a
239. 52:19vacuum cleaner breathe in or count of four okay uh let me try again so I'm going to breathe inep deeply and then
240. 52:29then for four and then exhale slowly okay I'll try again breathing in and breathe out it does it does sound
241. 52:39like the the herbot how do you feel I feel a lot better thank you so much a little peier so Mark you've been working on
242. 52:47these capabilities for a while now can you tell us a bit how it's different from voice mode right so if you've used
243. 52:53our voice mode experience before you notice a couple key differences first you know you can now interrupt the model
244. 52:59you don't have to wait for it to finish your turn before you can start speaking and you know you can just butt in
245. 53:05whenever you want second the model is real time responsiveness so that means that you don't have this awkward two to
246. 53:123second lag before you wait for the model to give a response and finally the model picks up on emotion right when I
247. 53:18was breathing super hard there it could tell and it knew hey you might want to calm down a little bit you're kind of
248. 53:24running a little bit too fast so you know it really has that capability across the board to perceive your
249. 53:30emotion not only that though the model is able to generate voice in a variety of different emotive Styles and it
250. 53:37really has a wide dynamic range so I'm going to fire up another demo for that yeah hey Cat gbt how are you doing I'm
251. 53:48doing fantastic thanks for asking blazing fast pretty good what's up so my friend U Barrett here he's been having
252. 53:55trouble sleeping lately and uh I want you to tell him a bedtime story about robots and love oh a bedtime story about
253. 54:03robots and love I got you covered gather round Barrett once upon a time in a world not too different from ours there
254. 54:12was a robot named bite bite was a curious robot always explor started the story but I want a little bit more
255. 54:19emotion in your voice a little bit more drama got it let's add some drama Once Upon a Time in a world not too different
256. 54:27from PR impressive there was a robot named no I really want maximal emotion like maximal expressiveness much more
257. 54:34than you were doing before understood let's amplify the drama once upon a time in a world not too different from ours
258. 54:44they went the other direction Vick named bite bite you do this in a robotic voice now initiating dramatic robotic voice
259. 54:55Once Upon a time in a world not too different from ours there was a robot named bite like a bad Suburban mom robot
260. 55:05always exploring new circuit here calm down a little bit can you end the story but do it in a singing voice and so B found another robot
261. 55:17friend this is impressive live circly Ever After thank you so much I definitely feel a lot more relaxed [Applause]
262. 55:32youve just seen the voice capabilities but we also want to show you the vision capabilities as the model can also see
263. 55:39the whole world around us yeah absolutely like as you can see the with chat GPT in real time but you can also
264. 55:45interact with it um with video as well okay let me boot up chat PT hey chat PT hello there how's it going it's going
265. 55:58really well today I'd really like your help solving a math problem I'm all ears what math problem can I help you tackle
266. 56:05today so I'm going to write down a linear equation on a sheet of paper and I'll show you and then I love your help
267. 56:09working me through it but importantly don't tell me the solution just help give me hints along the way got it
268. 56:17oh okay I see it no I didn't show you yet just give me help along the way one second whoops I got too excited I'm ready when you are ah live
269. 56:37demos so chat GPT what equation did I write down there ah I see it now you wrote down 3x + 1 = 4 yep exactly so what's the first step I
270. 56:52should take to try to solve this the first step is is to get all the terms with X on one side and the constants on
271. 57:00the other side so what do you think we should do with that plus one okay I'm going to try to subtract one from both
272. 57:06sides and then I'll see what I get great idea perfect now what do you get when you subtract one from both
273. 57:19sides okay so chat GPT this is what I ended up with how does this look spot on now now you've isolated the term with X
274. 57:27on one side and it looks like 3x = 3 what do you think we should do next to solve for x I'm not sure can you give me another
275. 57:36hint of course you have 3x and you want to find the value of x think about what operation would undo multiplication is it
276. 57:47subtraction close but think of the opposite of multiplication because 3x means 3 * X okay I think it's division
277. 57:56let me try to divide both sides by three and let me see what I get Bingo go ahead and divide both sides by
278. 58:08three okay so chat GPT this is what I ended up with how does this look it looks perfect you've solved it and x = 1
279. 58:17nicely done how do you feel about solving linear equations now yeah honestly I I'm not pretty confident I
280. 58:25can solve a linear equations but why would you ever need to use this in the real world I'm really skeptical that's a fair question linear
281. 58:32equations pop up in a lot of everyday situations even if we don't realize it for example calculating expenses
282. 58:40planning travel cooking and even in business for profit and loss calculations it's basically a way to solve problems but you need to find an
283. 58:49unknown Value Plus wow you know I have a lot of unknown values in my life I'm totally convinced we I'm going to learn math
284. 58:58now I love that attitude Matt can definitely help solve some of life's mysteries whenever you're ready to dive
285. 59:06into more math I'm here for you anything else you'd like to tackle today so chbt I really love that you you know taught
286. 59:12the value of math to my friend Mark and I wrote one last thing I'd love if you could take a look at of course I'd love
287. 59:19to see what you wrote show it to me whenever you're ready okay so this is what I wrote down what do you see
288. 59:26a I see I love chat chpt that's so sweet of you yeah well I really appreciate all the help so yeah as we can see pretty
289. 59:40something wow that's quite the outfit you've got on yeah as you can see you know we can chat in real time to chat
290. 59:46GPT and not only that we can interact with it with h video as well and I swear like if you look at Barrett's GPT
291. 59:54history it's all equations like this now that you know you can do linear equations can you show us something more
292. 1:00:02complex I think so okay next let's try something U coding related C CTO like yeah whatever with your little your little
293. 1:00:13algebra okay so I'm going to open the chat gbt desktop app like mirror was talking about before okay and to give a bit of
294. 1:00:22background of what's going on so here we have um a computer and I'm screen we have some code and then the chat GPT
295. 1:00:28voice app is on the right so chat G will be able to hear me but can't see anything on the screen ni so I'm going
296. 1:00:33to highlight the code command see it and then that will send it to chat GPT and then I'm going to talk about the code to chat GPT hey chat
297. 1:00:41GPT hey there how's it going yeah it's going really well I was wondering if you could help me with uh a coding problem
298. 1:00:48today of course I'd love to help you out what's the coding problem you're dealing with okay I'm going to share with you some code one second
299. 1:00:56sure thing take your time okay so I just shared some code with you could you give me a really brief one- sentence description of
300. 1:01:05what's going on in the code this code fetches daily weather data specif location and time period Smooths the
301. 1:01:13temperature data using a rolling average annotates a significant weather event on the resulting displays the plot with minimum
302. 1:01:22and maximum temperatures over the year awesome thanks so much and in the code there's this function food can you describe to me what the
303. 1:01:29plot would look like if I had versus didn't have this function sure the function Fu XY takes in a data frame X
304. 1:01:37containing temperature data and a window size y for calculating the rolling mean it Smooths the average temperature
305. 1:01:46minimum temperature and maximum temperature columns by applying a rolling mean over the specified window
306. 1:01:53with the fu function the plot would show smoother temperature lines because the rolling mean reduces the noise or
307. 1:02:00fluctuations in the data awesome this makes thanks so much so yeah I definitely will want to apply this
308. 1:02:05function and so I'm going to uh generate the plot I don't get too excited about the 20 bucks a month I assume there's
309. 1:02:11more stuff coming that'll be for paid members you're ready yeah so so far chpt has only been able to see the code and
310. 1:02:18now I'm going to run it and then I'll use the vision capabilities of the chat PT desktop app so it can actually see
311. 1:02:23everything going on on the screen as well okay chat GPT I'm sharing with you the plot now I'm wondering if you can give
312. 1:02:35me a really brief one- sentence overview of what you see plot displays smoothed average minimum and maximum temperatures
313. 1:02:44throughout 2018 with a notable annotation marking a big rainfall event in late September fantastic I have another question for you
314. 1:02:54um the up and roughly what temperatures do those correspond to I see three squiggly lines the hottest temperatures
315. 1:03:00occur around July and August the maximum temperature during these months is roughly between 25° and 30° 77° F to 86°
316. 1:03:13F what's going on with the y axis is this in Celsius or Fahrenheit the Y AIS is in Celsius the temperatures are
317. 1:03:22labeled accordingly such as average temperature minimum temperature and maximum temperature yeah by the way the rabbit
318. 1:03:31R1 is useless now solve very easy in your um algebra equations that I need help with it can also interact with you
319. 1:03:38know code bases and see the outputs of plots and everything like this going on on a [Applause] computer so a few minutes ago we asked
320. 1:03:51the live audience on X to submit few requests for what they like us to try out here so I will take a couple of
321. 1:04:00prompts same same same TK she said she's getting emotional how to know if4 is capable ofel translation try this one sure yeah let's
322. 1:04:11do it I speak Italian so we can just do English Italian try to do English Italian sure let's do it hey Chachi how are you I'm doing
323. 1:04:23fantastic thanks for asking how about you how's your day going I'm uh doing great so I would like you to function as
324. 1:04:28a translator I have a friend here who only speaks Italian and I only speak English and uh every time you hear
325. 1:04:34English I want you to translate it to Italian and if you hear Italian I want you to translate it back to English is that good perfo that's
326. 1:04:49great Mike she wonders if whales could talk what would they tell us um they might ask how do we solve linear
327. 1:05:05equations wow certainly yes great looks like it [Applause] works all right so the next one is from
328. 1:05:21burito John 78 who asks can you tell what you're feeling just by looking at your face Barrett you want to give this
329. 1:05:29one a try absolutely let's try it out hey chat CHT hey there what's up how can I brighten your day today okay yeah so I'm
330. 1:05:41going to show you um a selfie of what I look like and then I'd like you to try to see what emotions I'm feeling based
331. 1:05:46on how I'm looking sounds like a fun challenge go ahead and show me that selfie and I'll put my emotional
332. 1:05:53detective hat on Okay so so here's me so what kind of emotions do you think I'm feeling H it seems like I'm looking at a
333. 1:06:02picture of a wooden surface oh you know what that was the thing I sent you before don't worry I'm not actually a
334. 1:06:07table um okay so so take a take another look ah that makes more [Laughter] sense a there we go it looks like you're
335. 1:06:17feeling pretty happy and cheerful with a big smile and maybe even a touch of excitement whatever's going on it seems
336. 1:06:25like you're in a great mood care to share the source of those Good Vibes yeah no uh the reason I'm in a really
337. 1:06:30good mood is cuz we were doing a presentation showcasing how useful and amazing you are oh stop it you're making
338. 1:06:42me amazing well that's it for today on live demos as you can see this is this just feels so magical and and that's
339. 1:06:51wonderful but we also want to remove some of the mysticism from the technology and bring it to you so you
340. 1:06:58can try it for yourself so over the next few weeks we'll be rolling out these capabilities to everyone next few weeks
341. 1:07:04today has been very much focused on the free users and the new modalities and new products but we also care a lot
342. 1:07:11about the next Frontier so soon we'll be updating you on our progress towards the next big thing and before we wrap up I just want
343. 1:07:22to thank the incredible open AI team and also thanks to Jensen and the Nvidia team for bringing us the most advanced
344. 1:07:29gpus to make this demo possible today and thank you all very very much for being a part of this today all right there you have it so
345. 1:07:41doesn't take actions so it's it's not an agent that takes actions but that's a hell of an update [Music]
346. 1:07:57math magical yeah that that's interesting um I was surprised they didn't bring Sam up but that's okay um maybe he's feeling a little
347. 1:08:09Overexposed these days and it's good to get some other people out there let's see what the internet is saying yeah so so
348. 1:08:23um doesn't take action doesn't have reasoning but um the speed of response a desktop app and live video
349. 1:08:34and audio input is pretty staggering I mean it and and the the uh the ability to to sort of guide it to have you know
350. 1:08:48whisper to me or you know be funny or this or that um thank you for broadcasting today you're welcome everybody buddy yeah
351. 1:08:56that's good interesting so over the next couple of weeks so we won't have anything to play with today um but uh
352. 1:09:04but yeah hey rabbit you got some [ __ ] work to do um here's what you do so uh chat GPT 40 is available in their API or
353. 1:09:14will be and then you you hook this up to that okay don't worry about building your own [ __ ] just hook it up to that
354. 1:09:23and then this will be useful again oh this isn't charged or I I have done a live demo with this
355. 1:09:38thing oh man um but are we just paying for Speed now you're paying for Speed and for so the free version is probably going to be um
356. 1:09:50hobbled pretty pretty like you'll probably rate limit out of the free version after whatever five or 10
357. 1:09:58prompts um so so as P pointed out you'll get up to five times as much rate limits as the non-paid people um I would assume
358. 1:10:09that when they come out with GPT 5 which probably isn't that far away at this point it's probably within a month maybe six weeks
359. 1:10:20then people who pay will get access to that um but if you've made a a GPT anyone can now use your GPT so that's
360. 1:10:29that's a big deal so it might be worth putting some time back into you need a nice R1 display stand to display your
361. 1:10:36artifact I've got it it came with a really nice stand oh are you talking a 3D printed one yeah we need we need something that
362. 1:10:45looks more like a more like a we could put it in you know we could do Vicky we could do like a a rabbit Tombstone and say rip May 13th
363. 1:10:582024 that's pretty good my gpts may actually be useful exactly that's really funny yeah that' be good like a little
364. 1:11:11Tombstone right with the little skull and [Laughter] crossbones Famous Last Words hold please that's really
365. 1:11:26funny all right everybody I'm going to get back to work now I got a pitch coming up I got to go do do uh busy
366. 1:11:33stuff but good hanging out with you um exciting times we will obviously uh um you know as soon as anything's
367. 1:11:43available I'll let you know and we'll we'll play with it we'll we'll dig into this and and see how capable it is so
368. 1:11:49it's exciting all right everybody have a fantastic day bye