OpenAI DEV DAY! It was seriously like Christmas morning. So many presents under the GPT4 tree!

Transcript

1. 0:00I need to set up my screenshotting let me see I should save that to desktop it is okay so now I can
2. 0:16screenshot if there's something good to screenshot for for later big news uh I don't know Source Camp we'll see this is
3. 0:24their this is the keynote for the developer conference today Sam Alman last night posted that he said it felt
4. 0:32like Christmas Eve which says to me they're going to announce some big stuff uh that he's excited about um and then and then the leaks the
5. 0:42leaks that happened on Saturday Friday or Saturday I think Friday um were a bot maker things like that so
6. 0:54going to going to be interesting stuff hey UT what's happening de de I'm not sure my brain can handle anymore
7. 1:03I'm right there with you I'm like I just decided to do this I've never really done like a live stream commentary
8. 1:10before so this could could be an absolute [ __ ] show but you know welcome welcome to AI learning lab happy open AI
9. 1:18day making Bots is AI news yep it is hey bud hey Jim Taylor what's happening good to see you good to see you human nice
10. 1:34name Raven toown and as soon as they go live I'll pop up let's see let's see their choice of Music let's see their choice of hold [Music]
11. 1:47music that sounds like it was ai ai composed that's looks like sounds like something you do on sound raw good morning good morning Ricky
12. 2:00Ticky Fabby hair growth geek what's shaking what's shaking I'm all excited oh wait is this a Daydream you're on once again
13. 2:15Ella Ella elun Funk Ella the elephunk yes yes yeah I I it does feel different doing this in the daytime I feel like I
14. 2:29I can't quite be myself but that's all right what are you going to do what are you going to do I have no body parts shaking and
15. 2:39that's a good thing here for the [ __ ] show or as DOI might say s s so show exactly what's happening Cindy good to
16. 2:54see you I'm excited for uh for what you're going to present at the salon tomorrow so Cindy [ __ ] who's a futurist
17. 3:01is speaking at tomorrow night's AI salon so if you um if you're not a part of the AI Salon go to the
18. 3:11salon. and um sign up for the Meetup you should also join the Discord even though we're going to move off that soon you
19. 3:19should still join it and become part of the community but oh that music's driving me crazy there's party favors yay
20. 3:31all right welcome and do me a favor if you would share this live so we can get as many people in here because I don't
21. 3:37normally go live this time of day and I also have my countdown timer says this isn't starting you this is the little
22. 3:43you're in the Green Room hanging out before the thing actually starts uh encourage Be not Afraid encourage more viewers to share that
23. 3:50would be awesome yes Genie and a bottle good to see you like the live wait can I invite how do
24. 4:04I share is this ituno Lazelle yeah this is good oh source Camp's already in
25. 4:28here all right I just shared the live too to some some folks AI learning lab shared with more than 10 friends yes I
26. 4:46did there's 12,200 people watching the uh the Youtube stream and we have 30 here so it's close we're close we're close to AI level or
27. 5:00open AI level numbers request to join and by the way this is if you go to
28. 5:15if you want to see this live on your own computer this is at uh open ai's YouTube channel and then click on
29. 5:22their live Tab and you'll see this so you can listen to it there locally CU I'll probably mute occasionally to talk
30. 5:29about [ __ ] is my I don't really know what I'm doing here like well that's that's the that's the whole point of the channel isn't
31. 5:40it I'm leaning into not knowing what I'm doing [Laughter] here oh man wait what happened with the time
32. 5:52change I have the stream happening in a day now no it should be they start started streaming 25 minutes ago with this little animated
33. 6:02opening so this was a non-live stream and and now it's a live stream so this is good this is unlike the haen uh thing that I went to
34. 6:15where they didn't get this going until 5 minutes after I'm listening while at work don't tell my boss would never I would never
35. 6:26tell your boss Forever Young this is listen this is work this is we're finding out what's happening with uh
36. 6:33with generative AI stuff that's going to completely transform your company so I think this is an appropriate use of your
37. 6:39time I will support you on that you like say to your boss go talk to Kyle Shannon who's Kyle Shannon
38. 6:47that's not important right now but he'll vouch for me I'll do it too I don't give it I don't give two
39. 6:55shits um let me make that how do I make that straight Kyle I request to your live not Dar just
40. 7:11resting oh dar dar dar dar dar the internet Tick Tock star bam all right I will most likely I don't know what I'm going to do it it depends
41. 7:27how I assume there's going to be a lot of kind of Dead Space where they're you know thanking people and things like
42. 7:33that so I'm going to try to just let it play so we can all see it together check my request oh your
43. 7:51request um do we have time what time is it we have 2 minutes um we can do it can you can you do it quick Sherry here you go hello
44. 8:06hello does this work what's happening oh that's cool okay it just works I just wanted to test if it works so next time
45. 8:13we could do live with a bunch of people bye okay cool awesome okay bye awesome bye see you how do I get rid of it now oh my
46. 8:23goodness I don't know there you go all right there's that oops oh man what the hell is going on with the hair time for a [Laughter]
47. 8:38haircut I don't mind it at night but live good Lord make a Kyle Shannon certificate of attendance for Future
48. 8:45boss oh that's not bad Rudy wow Mr Shannon you go live now yeah so this is we're we're here to uh I'm going to live
49. 8:53stream the open AI Dev keynote so we're going to be live for an hour and then I have a meeting right after after this so
50. 9:01I'll be shutting down right at 11: my time it's or 12 my time it's just about 11: my time so it is just
51. 9:11about 11 Mountain time and I'll go for an hour is this the 24hour live no no no I still haven't quite decided if I'm
52. 9:22G to do a 24-hour live but I'm going to do something I'm going to do something so we'll figure it out damn okay well I
53. 9:30I got excited when I saw you yeah no this is definitely a non-standard time when I'm going live I also feel like I
54. 9:37can't swear because people are watching this at work although for those of you on the other side of the world you're
55. 9:42probably watching this you know at night when the when when the East Coasters do on on the normal lives [Laughter]
56. 9:52so um it's good to know Sherry can do that for November 30th oh yeah yeah yeah exactly that's awesome terrific all right
57. 10:05so all right let me to pull something over here cuz I am at work oh this is getting louder there we go good morning thank
58. 10:15you for joining us today please welcome to the stage Sam [Music] mman good morning Welcome to our first
59. 10:31ever open AI Dev day we're thrilled that you're here and this energy is [Applause] awesome and welcome to San Francisco San
60. 10:43Francisco has been our home since day one the city is important to us and to the tech industry in general we're
61. 10:49looking forward to continuing to grow here so we've got some great stuff to announce today but first I'd like to
62. 10:56take a minute to talk about some of the stuff that we've done over the past year about a year ago November 30th we
63. 11:03shipped chat GPT as a low-key research preview and that went pretty well in March we followed that up with
64. 11:12the launch of GPT 4 still the most capable model out in the world yep that's not [Applause] [ __ ] and in the last few months we
65. 11:25launched voice and vision capabilities so that chat GPT can now see hear and speak and more Rec there's a lot you don't have to clap each
66. 11:36time and more recently we launched Dolly 3 the world's most advanced image model you can use it of course inside of chat
67. 11:43GPT for our Enterprise customers we launched chat GPT Enterprise which offers Enterprise grade security and
68. 11:50privacy higher speed gp4 access longer context Windows a lot more today we've got about 2 million Developers
69. 11:59wow building on our API for a wide variety of use cases doing amazing stuff over 92% of Fortune 500 companies building on our
70. 12:08products and we have about a 100 million weekly active users now on chbt Wow 100 million weekly incredible
71. 12:19on that is we got there entirely through Word of Mouth people just find it useful and tell their friends yeah open AI is
72. 12:25the most advanced and the most widely used AI platform in the world now but numbers never tell the whole
73. 12:32picture on something like this what's really important is how people use the products how people are using Ai and so
74. 12:39I'd like to show you a quick video I actually wanted to write something to my dad in talo I want a non-romantic way to tell my parent that
75. 12:50I love him and I also want to tell him that he can rely on me but in a way that still has the respect of like a child to parent relationship
76. 13:01that you should have in toino culture and in G when it's translated into G I love you very deeply and I will be with
77. 13:08you no matter where the path leads I see somebody possibility I was like who something I'm not sure oops hey this I'm thinking about so kind
78. 13:19give that more confidence the first thing that blew my mind was it levels with you like that's something that a
79. 13:25lot of people struggle to do it opened my mind to just what every creative could do if they just had a person
80. 13:35helping them out who listens so this is a to represent sickling hemoglobin and you built that with chat GPT chat GPT
81. 13:42built it with me using it for daily activities like hey here's a picture of my fridge can you tell me what I'm
82. 13:49missing because I'm going grocery shopping and I really need to do recipes that are following My Vegan Diet as soon
83. 13:54as uh we got access to code interpreter I was like wow this thing is awesome they could go spreadsheets it could do
84. 14:01anything I discovered chatty about three months ago 100 birthday wow is very friendly very patient very knowledgeable and very
85. 14:16it's been a wonderful thing I'm a 4.0 student but I also have four children while I started using chat T I realized
86. 14:23I could ask chat GPT that question and not only does it gives me an explanation didn't need booing as much it gave me a
87. 14:33life back it gave me time for my family and time for me I have chronic nerve pain uh on my whole left half of my body
88. 14:41of nerve damage I had like a spine a brain surgery and so I have like limited use of my left hand now you can just
89. 14:48have like the integration of voice input and the newest one where you can have the back and forth dialogue that's just
90. 14:54like accessibility maximum huge best interface for me it's [Music] [Applause]
91. 15:09here so we love hearing the stories of of how people are using the technology it's really why we do all of this okay
92. 15:16so now on to the new stuff and we have got a lot oh yeah here we go first we're going to talk about a bunch of
93. 15:25improvements we've made and then we'll talk about where we're headed next over the last year we spent a lot of
94. 15:32time talking to developers around the world we've heard a lot of your feedback it's really informed what we have to show you
95. 15:39today today we are launching a new model gp4 turbo [Applause] oh gp4 turbo will address many of the
96. 15:53things that you all have asked for so let's go through what's new we've got six major things to talk about for this
97. 16:00part number one context link yay a lot of people have tasks that require a much longer context length gp4 supported up
98. 16:10to 8K and in some cases up to 32k context length but we know that isn't enough for many of you and what you want
99. 16:16to do gp4 turbo supports up to 128,000 tokens of contact oh going after Claude that's 30 pages of a standard
100. 16:29book 16 times longer than our 8K context nice and in addition to longer context length you'll notice that the model is
101. 16:37much more accurate over a long context great number two more control we've heard loud and clear that developers need more control over the
102. 16:48model's responses and outputs so we've addressed that in a number of ways we have a new feature called Json
103. 16:54mode oh nice which ensures that the model will respond with valid Json this has been a huge developer request
104. 17:01it'll make calling apis much easier big deal the model is also much more accurate over a long conversation many
105. 17:09functions at once dunkaroo and it'll do better at following instructions in general we're also introducing a new
106. 17:15feature called reproducible outputs you can pass a SE parameter and it'll make the model return consistent outputs o
107. 17:22this of course gives you a higher degree of control over Model Behavior this rolls out in beta today wow
108. 17:32and in the coming weeks we'll roll out a feature to let you view log probs in the API now likely this is just going to be
109. 17:40an A in chat GPT playground it's not going to necessarily be in chat GPT to be able to access better knowledge that's my
110. 17:47guess so we're launching retrieval in the platform you can bring Knowledge from outside documents or databases into
111. 17:54whatever you're building o that's huge we're also updating the knowledge cuto off we we are just as annoyed as all of
112. 17:59you probably more the gp4s knowledge about the world ended in 2021 we will try to never let it get that out of date
113. 18:06again gp4 turbo has knowledge about the world up to April of 2023 and we will continue to improve that over time number four new
114. 18:18modalities surprising no one Dolly 3 gp4 Turbo with vision and the new text to speech model are all going into the API today oh
115. 18:31yes so if you're doing zapier automations you can now call all these things is what that means a handful of
116. 18:37customers that have just started using Dolly 3 to program programmatically generate images and Designs today Koke
117. 18:44is launching a campaign that lets his customers generate devali cards using Dolly 3 wow and of course our safety
118. 18:50systems help developers protect their applications against misuse those tools are available in the API wow gb4 turbo
119. 18:58can now accept images as inputs via the API wow generate captions classifications and Analysis for example
120. 19:06the eyes uses this technology to help people who are blind or have low vision with their daily tasks like identifying
121. 19:13products in front of them API stands for application programming interface it's how programmers can take data from their
122. 19:20app send it to open AI run it through gp4 and get really cool stuff Backes to choose from I'll play an example did you
123. 19:28know that Alexander Graham Bell the eminent inventor was enchanted by the world of sounds his ingenious mind led
124. 19:35to the creation of the graphophone which etched sounds onto wax making voices whisper through time this is much more natural than
125. 19:44anything else we've heard out there voice can make apps more natural to interact with and more accessible it
126. 19:50also unlocks a lot of use cases like language learning and voice assistance speaking of new modalities we're also releasing the next
127. 19:59version of our open- source speech recognition model whisper V3 today it'll be coming soon to the API Whisper 2 is
128. 20:06amazing features improve performance across many languages and we think you're really going to like it okay number five
129. 20:13customization fine tuning has been working really well for gbt 3.5 since we launched it a few months ago starting
130. 20:20today we're going to expand that to the 16k version of the model also starting today we're inviting active fin tuning users to apply for the
131. 20:29gp4 fine tuning experimental Access program the fine-tuning API is great for adapting our models to achieve better
132. 20:37performance in a wide variety of applications with a relatively small amount of data but you may want to model
133. 20:43to learn a completely new knowledge domain or to use a lot of proprietary data so today we're launching a new
134. 20:49program called custom models oo with custom models our researchers will work closely with a company to help them make
135. 20:57a great custom model especially for them and their use case using our tools think anyone with proprietary data
136. 21:06they're going to be able to build custom applications with their data using chat gp4 processing whatever else we won't be
137. 21:15able to do this with many companies to start it'll take a lot of work and in the interest of expectations at least
138. 21:20initially it won't be cheap but if you're excited to push things as far as they can currently go please get in
139. 21:25touch with us and we think we can do something pretty great okay and then number six higher rate limits we're doubling the tokens
140. 21:34per minute for all of our established gp4 customers so that it's easier to do more and you'll be able to request
141. 21:40changes to further rate limits and quotas directly in your API account settings in addition to these rate
142. 21:46limits it's important to do everything we can do to make it new successful building on our platform so we're introducing copyright
143. 21:55Shield oh interesting copyright Shield means that we will step step in and defend our customers and pay the cost
144. 22:01incurred if you face legal claims around copyright infringement and this applies both to chat GPT Enterprise and the API
145. 22:08they're following Microsoft there that's probably because their Enterprise customers are saying they need that on
146. 22:13data from the API or chbt Enterprise ever ever yeah so this is this is in response to customers there's actually
147. 22:21one more developer request that's been even bigger than all of these uh so I'd like to talk about that now and that's pricing oh this is
148. 22:31Big gp4 Turbo is the industry-leading model it delivers a lot of improvements that we just covered and it's a smarter model than
149. 22:43gp4 we've heard from developers that there are a lot of things that they want to build but gp4 just cost too much
150. 22:50they've told us that if we can decrease the cost by 20 25% that would be great it's going to be 10x cheaper I bet
151. 22:58I'm super excited to announce that we worked really hard on this and gbt 4 Turbo a better model is considerably cheaper than
152. 23:07gb4 bu a of 3x for prompt tokens that's [Applause] [Music] huge and two expert completion tokens starting today great
153. 23:24awesome so the new pricing is 1 cent per th prompt tokens and 3 cents per th000 completion tokens for most customers
154. 23:32that will lead to a blended rate more than 2.75 times cheaper to use for gp4 Turbo than gp4 great we worked super
155. 23:39hard to make this happen we hope you're as excited about it as we are so we decided to prioritize price
156. 23:50first because we had to choose one or the other but we're going to work on speed next we know that speed is
157. 23:54important too soon you will notice GPT 4 Turbo becoming a lot faster we're also decreasing the cost of GPT 3.5 turbo
158. 24:0516k also input tokens are 3x less and output tokens are 2x less which means the GPT 3.56k is now cheaper than the previous GPT 3.5 4K
159. 24:17model running a fine-tune GPT 3.5 turbo 16k version is also cheaper than the old fine-tuned 4K version okay so we just covered a lot
160. 24:27about the model itself we hope that these changes address your feedback we're really excited to bring all of these improvements to everybody
161. 24:35now in all of this we're lucky to have a part does this affect subscription rate I doubt it so I'd like to bring out a
162. 24:43special guest s Nella the CEO of Microsoft oh here we go this could be good this is going to be connect
163. 24:50connections to Office 365 I bet thank you huge thanks so much for coming here it's fantastic to be here and uh Sam congrats
164. 25:00I mean I'm really looking forward to Turbo and everything else that you have coming it's been just fantastic
165. 25:05partnering with you guys I love this guy he's great two questions won't take too much of your time how are how is
166. 25:09Microsoft thinking about the partnership currently first we love you guys look it's that's gonna change dunar
167. 25:20fantastic for us in fact I remember the first time I think you reached out and said hey do you have some Azure credits
168. 25:26we've come a long way from there uh thank you for that you guys have built something magical I mean quite frankly there are
169. 25:33two things uh for us when it comes to the partnership the first is these workloads and even when I was listening
170. 25:39backstage to how you're describing what's coming even it's just so different and new I've been in this infrastructure business for you know
171. 25:45three decades no one has ever seen infrastructure yeah and and the workload the pattern of the workload these you
172. 25:51know these training jobs are so synchronous and so large and so data parallel um and so the first thing that
173. 25:58we have been doing is building in partnership with you the system all the way from thinking from power to the DC
174. 26:05to the rack to the accelerators to the network uh and just you know really the a the shape of azure is drastically
175. 26:13changed uh and is changing rapidly in support of these models that you're building and so our job number one is to
176. 26:20build the best system so that you can build the best models and then make that all available to developers and so the
177. 26:26other thing is we ourselves are a developer so we're building products in fact my own conviction of this entire
178. 26:33generation tired Runner I don't I don't know that Microsoft will ever buy open AI but I I I doubt it unless they get in
179. 26:41trouble so we want to build our co-pilot get up co-pilot all as developers uh on top of open Ai apis and so we are very
180. 26:49committed to that and what does that mean to developers you look I Rudy Miss I just spent my 20 bucks a developer
181. 26:56company and a partner company and so we want to make you for example we want to make GitHub available GitHub co-pilot
182. 27:02available as the Enterprise Edition available to all the attendees here so they can try it out that's awesome yeah
183. 27:07we're very excited about that that's good when you going to give it to the rest of us buddy and right now count on
184. 27:14us to build the best infrastructure in Azure with your API support uh and bring it to all of you and then even things
185. 27:22like the Azure Marketplace so for developers who are building products out here to get to Market uh rapidly so
186. 27:27that's sort of really our intent here great and how do you think about the future future of the partnership or future of AI or whatever yeah
187. 27:36there that's you know like there are couple of things for me that I think are going to be very very key for us right
188. 27:43one is I just described how the systems that are needed as you aggressively push forward on your road map um requires us
189. 27:54to be on the top of our game and we intend fully to commit ourselves deeply to making sure you all as Builders of
190. 28:02these Foundation models have not only the best systems for training and inference but the most compute so that
191. 28:09do me Savor favor and please share the live if you can so we can get some more people in here way we want to make
192. 28:14progress the second thing I think both of us care about in fact quite frankly the thing that excited both sides to
193. 28:20come together is your mission our mission our mission is to empower every person and every organization on the planet to achieve
194. 28:28AI is only going to be useful if it truly does empower right I mean I saw the video you played early I mean that
195. 28:34was fantastic to see thank you thanks for sharing the live describe what AI meant for them and what they were able
196. 28:41to achieve so ultimately it's about being able to get the benefits of AI broadly decimated to everyone I think is
197. 28:47going to be the goal for us and then the last thing is of course we're very grounded in the fact that safety matters
198. 28:52and safety is not something that you care about later but it's something we do shift left on and we very very
199. 28:57focused on that with you all great well I think we have the best partnership in Tech I'm excited for us to build AGI
200. 29:02together no I'm really excited have a f thank you very much for coming nice just reiterating it's an important
201. 29:10partnership they're not going to let them flail okay make it safe for corporations a lot of great updates for developers
202. 29:18already and we got a lot more to come but even though this is a developer conference we can't resist making some
203. 29:24improvements to Chachi PT here we go so a small one chat GPT now uses GPT 4 Turbo with all the latest improvements
204. 29:33including the latest knowledge cut off which will continue update that means we get 128,000 tokens it can out browse the
205. 29:39web when it needs to write and run code analyze data take and generate images and much more and we heard your feedback
206. 29:45that model picker extremely annoying that is gone starting today might have to click around the drop down menu
207. 29:51starting today all of this will just work together chat GPT yeah I'm going to look now chat gbt will just know what to use and when you need
208. 30:03it but that's not the main thing uh and neither was price I still have the old version but we'll see
209. 30:09developer request there was one that was even bigger than that and I want to talk about where we're headed and the main
210. 30:15thing we're here to talk about today so we believe that if you give people better tools they will do amazing things
211. 30:23we know that people want AI that is smarter more personal more customizable can do more on your behalf eventually
212. 30:30you'll just ask the computer for what you need and it'll do all of these tasks for you these capabilities are often
213. 30:37talked in the AI field about as agents oh here we go here's the bots upsides of this are going to be tremendous at open
214. 30:45AI we really believe that gradual iterative deployment is the best way to address the safety issues the safety
215. 30:51challenges with AI we think it's especially important to move carefully towards this future of Agents it's going
216. 30:57to require a lot of technical work and a lot of thoughtful consideration by Society So today we're taking our first
217. 31:05small step that moves us towards this future we're thrilled to uh we're thrilled to introduce gpts G gpts are tailored versions of
218. 31:16chat GPT for a specific purpose these are Bots these are Bots you can build a GP just like customized version of chat
219. 31:22GPT for almost anything yeah instructions expanded knowledge and actions and then you can publish it for
220. 31:29others to use calling gpts is genius com instructions expanded knowledge and actions they can be more helpful to you
221. 31:38they can work better in any context and they can give you better control they'll make it easier for you
222. 31:43to accomplish all sorts of tasks or just have more fun Jim Ross it's like Christmas it is chat GT you can in effect program a GPT with
223. 31:53language former president Obama from Becky R is in charge of regulations very access and it gives agency to
224. 32:02everyone so we're going to show you what gpts are how to use them how to build them and then we're going to talk about
225. 32:09how they'll be distributed and discovered Jennifer L happy birthday developers we're going to show you how
226. 32:14to build these agent like experiences into your own apps so first let's look at a few examples our partners at code.org are
227. 32:24working hard to expand computer science in schools lesson planner they've got a curriculum millions of students
228. 32:30worldwide this is huge that you can publish these plan GPT to help teachers provide a more engaging experience for middle
229. 32:38schoolers if a teacher asks it to explain for Loops in a creative way it does just that in this case it'll do it
230. 32:46in terms of a video game character repeatedly picking up coins super easy to understand for an eighth grader as you can see this GPT brings
231. 32:54together code.org extensive curriculum and expert and lets teachers adapt it to their needs quickly and
232. 33:01easily next Cana has built a GPT that lets you start designing by describing what you want in natural language if you
233. 33:10say make for a Dev date reception this afternoon this evening just in a school board meeting thinking about chat gbt
234. 33:16it'll generate a few options to start with by hitting canvas apis now this concept may be familiar to some of you
235. 33:22we've evolved our plugins to be custom actions for gpts you can keep chatting with this to see different iterations when you see
236. 33:30one you like you can click through to canva for the full design experience wow so now we'd like to show you a GPT live
237. 33:39oh that's so cool here we go here has built a GPT that that lets you perform actions across 6,000 applications to
238. 33:45unlock all kinds of integration possib my God I'd like to introduce Jessica one of our Solutions no sleep for us going
239. 33:52to drive this demo this is done this is we this is thank you all holy crap thank you all for being here my name is Jessica Shay I work with
240. 34:05partners and customers to bring their product alive and today I I can't wait to show you how hard we've been working
241. 34:11on this so let's get started so to start where your gbt will live is on this upper left corner I'm going to start
242. 34:19with clicking on the zappier your AI actions and on the right hand side you can see that's my calendar for today so
243. 34:26it's quite a day I've going to use this before so it's actually already connected to my calendar to start I can
244. 34:33ask what's on my schedule for today we build gpts with security in mind so before it performs any action or share
245. 34:42data it will ask for your permission so right here I'm going to say allowed so gbt is designed to take in your
246. 34:51instructions make the decision on which capability to call to perform that action and then execute that for you so
247. 34:58you can see right here it's already connected to my calendar it pulls into my my information I've also prompted it to
248. 35:07identify conflicts on my calendar so you can see right here actually was able to identify that so it looks like I have
249. 35:14something coming up so what if I want to let Sam know that I have to leave early so right here I say Let Sam no I got to go um chasing gpus
250. 35:27so with that I'm going to swap to my conversation with Sam and then I'm going to say yes please run that Sam did you get that I
251. 35:42did awesome so this is only a glimpse of what is possible and I cannot wait to see Papa J yes it looks like Z zappier and cber
252. 35:56integrated but it sounds like we're going to be able to connect these Bots to other services so we'll be able to use a consumer version
253. 36:05of an API basically in addition to these there are many more kinds of gpts that people are creating and many many more
254. 36:12that will be [ __ ] genius that they're calling them gpts they're making it like Xerox a term that everyone will just use
255. 36:18always associate it with them brilliant you can program the GPT just by having a conversation we believe that natural
256. 36:25language is going to be a big part of how people use computers in the future and we think this is an interesting
257. 36:30early example so I'd like to show you how to build one he's gonna build one right now so I want to create a GPT uh that helps give
258. 36:41Founders and developers advice when starting new projects um I'm going to go to create a GPT here and this drops me into the GPT
259. 36:52builder getting emotional this is exciting devel always about how do I you know think about a business idea can you give me
260. 37:00some advice uh I'm going to see if I can build a GPT to help with that so to start GPT Builder asks me what I want to
261. 37:07make and I'm GNA say I want to help GPT Builder Founders this is it's like do it's this is app development like do you
262. 37:15just ask it for what you want it's GNA code it this is staggering after the founder has gotten can neural link
263. 37:23connect with gbt probably not that far off crypto Joe them on why they are not growing faster all right so to start off I just
264. 37:35tell the GPT a little bit about about what I want here and it's going to go off and start thinking about that and
265. 37:40it's going to write some detailed instructions for the GPT um it's also gonna let's see ask me about a name how
266. 37:46do I feel about startup Mentor that's fine that's good so if I didn't like the name of course I could call it's even
267. 37:54naming the the thing for you brilliant and start there and this is just like the right in preview mode that it's
268. 38:02starting to fill out the GPT um where it says what it does it has some like ideas of additional questions that I could ask
269. 38:11um and made an icon using DOL so it just generated a candidate of course I could regenerate that or change it but I sort
270. 38:18of like that so I will say that's great and you see now that the GP is being built out a little bit more as we
271. 38:28go this is unbelievable what I want this to do um how it can interact with users I could talk about style here but what
272. 38:35I'm going to say uh is I am going to upload transcripts of some lectures about startups I have given oh man give
273. 38:48advice based off of okay he's uploading his documents to inform this bot now uh it's going to go figure out how to do
274. 38:56that and I would like i' like to show you the configure tab so you can see were built out got your name written all
275. 39:01over it by by the Builder itself and you can see that there's capabilities here that I can enable um I could add custom
276. 39:07actions these are all fine to leave um I'm going to upload a file uh so here is a lecture that I picked that I used to
277. 39:16that I gave with some startup advice um and I'm going to add that here in terms of these questions uh this is a dumb
278. 39:23one the rest of those are reasonable uh and like very much things Founders often ask um I'm going to add one more thing
279. 39:30to the instructions here which is be concise and constructive with feedback right so it sets it up and now
280. 39:38you just go in and edit it again if I had more time i' show bunch of other things brilant but this is uh this is
281. 39:43like a decent start and now uh we can try it out over on this preview tab so I will say um that's a common question what are three things to
282. 39:55look what are three things to look for when hiring employees at an early stage startup now it's going to look at that
283. 40:07document I uploaded um it'll also have of course all of the background knowledge of gp4 look how fast it is too that's the
284. 40:15turbo that's pretty good those are three things that I definitely have said many times um now we could go on and it would
285. 40:21start following the other instructions and you know you can add your own data to your Bot you can add own data to your
286. 40:27Bot you can add your own data to your bot then you can publish it I can work on it later I can add more content I can
287. 40:34add a few actions that I think would be useful we're gonna make money with chat GPT so that's what it looks like to create a GPT with
288. 40:43thank that's amazing I think I need this rolled out a little slower I always wanted God aming man someday I'll be
289. 40:54able to make a bot that will do this and awesome so with gpts we're letting people easily share and discover all the
290. 41:03fun ways that they use chat GPT with the world you can make private gpts like I just did or you can share your Creations
291. 41:12publicly with a link for anyone to use awesome or if you're on chat GPT Enterprise you can make gpts just for your company
292. 41:21beautiful and later this month people have been asking about that in their lives GPT store later this month GPT store thank you one person
293. 41:34CLA democracy of AI yep indeed you can list a GPT there and we be able to feature the best and the most popular
294. 41:42gpts of course we'll make sure the gpts in the store follow our policies before they're accessible so just like the App
295. 41:49Store Revenue sharing is important to us here we go you can make money with C GPT the most useful and the most used GPT
296. 41:56a portion of our Revenue wow we're excited to foster a vibrant ecosystem with the GPT store just from what we've
297. 42:03been building ourselves over the weekend we're confident there's going to be a lot of great stuff who said that tired
298. 42:07Runners seems like they learned a lot from the plugins garbage so those are GS exactly and we can't wait to see what
299. 42:12you build holy crap that's huge people but this is a developer conference the coolest thing about this is that we're
300. 42:18bringing the same concept to apis amazing how do I sign up well go to platform of you have already been building if you want to get on the
301. 42:30developer side the playground go to platform. open.com playground and just get an account there that's then you're on the
302. 42:37developer side and definitely pay your 20 bucks on the consumer side on chat GPT and snaps my AI a customized chat
303. 42:45bot that can be added to group chats and make recommendations these experiences are it is isn't it jrc it is it's
304. 42:52emotional sometimes holy [ __ ] teams of dozens of Engineers there's a lot to handle to make this custom assistant
305. 43:00experience So today we're making that a lot easier with our new assistance API I was gonna say something API
306. 43:11includes persistent threads so they don't have to figure out how to deal with long conversation history oh built-in
307. 43:18retrieval code interpreter a working python interpreter in a sandbox environment and of course the improved
308. 43:25function calling that we talked about earlier so we'd like to show you a demo of how this works and here is Raman our
309. 43:33head of developer experience [Music] [Applause] welcome yeah Robert Stone it's with with it being able to do python the math
310. 43:43thing is going to be is going to be handled it's been so inspiring to see so many of you infusing AI into your apps
311. 43:51today co go go to YouTube go to the open AI Channel and click on their live Tab and you'll see this video AG so let's Dive Right
312. 44:02In imagine I'm building one theas a travel app for Global explorers and this is the landing page I've actually used
313. 44:09gp4 to come up with these destination ideas and for those of you with the Keen Eye these illustrations are generated
314. 44:15programmatically using the new dly 3 API available to all of you today so it's pretty remarkable but let's enhance this app by
315. 44:24adding a very simple assistant to it this is the screen we're g to come back to it in a second first I'm G to switch
316. 44:31over to the new assistant playground creating an assistant is easy you just give it a name some initial instructions
317. 44:38a model in this case I'll pick dpt4 turbo and here I'll also go ahead and select some tools I'll turn on code
318. 44:45interpreter and retrieval and save and that's it our assistant is ready to go wow next I can integrate with two New
319. 44:53Primitives of this assistance API threads and messages let's take a quick look at the code the process here is very simple for
320. 45:03each new user I will create a new thread and as these users engage with their assistant I will add their messages to
321. 45:10the threads very simple and then I can simply run the assistant at any time to stream the responses back to the app so
322. 45:19we can return to the app and try that in action if I say hey let's go to Paris all right that's it with just a few
323. 45:30lines of code users can now have a very specialized assistant right inside the app wow and I'd like to highlight one of
324. 45:37my favorite features here function coing if you have not used it yet function calling is really powerful and as some
325. 45:44mentioned we're taking it a step further today it now guarantees the Json output with no edit latency and you can invoke
326. 45:52multiple functions at once for the first time wow the the Jon thing was big people were having to write around that
327. 45:58so the fact that they fixed that's huge for developers have the assistant respond to that again and here what's interesting is
328. 46:06that the assistant knows about functions including those to annotate the map that you see on the right and so now all of
329. 46:13these pins are dropping oh my God that's remarkable and that if you didn't see what just happened there the the thing
330. 46:25made a list of things to do in Paris and then the function calling drop those pins on the map the harmony you can
331. 46:32build between Ai and UI where the assistant is actually taking action oh my God but next next let's talk about
332. 46:39retrieval and retrieval is about giving our assistant more knowledge Beyond this iMed this is huge too this retrieval
333. 46:45thing this is what Lang chain does tiet this basically puts Lang chain out of business can drop here this PDF what
334. 46:52it's including I can just sneak peek at it very typical United flight ticket and behind the scene here what's happening
335. 47:01is that retrieval is reading these files and boom the information about this PDF appeared on the screen wow wow and this is of course a very
336. 47:11tiny PDF but assistants can par longm documents I need some problems to solve I think we all do Lun deping what you're
337. 47:18building in fact I also booked an lbnb so I'm just going to drag that over to the conversation as well and by the way
338. 47:25we heard from so many of you developers how hard that is to build yourself you typically need to compute your un
339. 47:31biddings you need to set up chunking algorithm now all of that is taken care of wow and there's the chunking
340. 47:38algorithm means if you put in big um documents it will auto chunk them which means you know setting up a key value
341. 47:45store that means like handling the context window serializing messages and so forth that complexity now completely
342. 47:52goes away with this new stateful API so so the question is this going to be included with our paid subscription so
343. 47:58there's two different things here chat GPT is the 20 bucks a month what they're talking about now is the developer side
344. 48:04of this so if you're over on the playground working with their API that's what all this stuff is so a lot of what developers have access
345. 48:13to over here is looks like it's Incorporated in chat GPT but these are two distinct worlds let's move on to a
346. 48:21new capability that many of for a while wait let me interpreter is now available today in the API as well let's watch
347. 48:28this code interpreter in the API the ability to write and execute code on the fly but even generate fights so let's
348. 48:34see that in action if I say here hey will'll be four friends staying at DC rbnb what's my share of it plus my flights wow all
349. 48:54right here what's happening is that code interpreter noticed that it should write some code to answer this query so now
350. 49:02it's Computing you know the number of days in Paris the number of friends it's also doing some exchange rate
351. 49:07calculation behind the scene to get the sensor for us yeah Papa J not the most like math but you get the picture
352. 49:13imagine you're building a very complex like finance app that's crunching countless numbers plotting charts here's
353. 49:19here's your math tired Runner or whoever talked about the math will work great for you Yep this is now in the API I
354. 49:26think my trip to Paris is solid so to recap here we've just seen how you can quickly create an assistant that manages
355. 49:33state for your user conversations leverages external tools like no leg and retri yeah they're not they're they're
356. 49:39not going to show the answer donaroo because it's probably wrong how does Microsoft feel about the
357. 49:45demo on a MacBook they don't give a [ __ ] they've got they've got Mac products combined with our new modalities that we
358. 49:52launching most Engineers I know use Mac I built a small custom assistant that knows everything about this event wow
359. 50:00instead of having a chat interface while running around all day today I thought why not use voice instead oh here we go
360. 50:07voice for the dev conference here so you can see it on the right awesome so on the right you can see a very simple
361. 50:13Swift app that takes microphone input and on the left I'm actually going to bring up my terminal log so you can see
362. 50:19what's happening behind the scenes so let's give it a shot hey there I'm on the keynote stage right now can you greet our attendees
363. 50:28here at Dev day hey everyone welcome to Dev day it's awesome to have you all here let's make it an incredible
364. 50:44day isn't that impressive you have six unique and Rich voices to choose from in the API each speaking multiple languages
365. 50:52so you can really find the perfect fit for your app and on my laptop here on the left you can see the logs of what's
366. 50:57Happening behind the scenes too so I'm using whisper to convert The Voice inputs into text an assistant with gp4
367. 51:03tubo and finally the new TTS API to make it speak but thanks to function calling things get even more interesting when
368. 51:12the assistant can connect to the internet and take real actions for users so we've been talking about this here uh
369. 51:19together Bots that can take actions P assistant can you randomly select five de attendees here and give them $500 in open eye
370. 51:32credits yes checking the list of attendees wow five de attendees and added $500 of AP credits to their account congrats to
371. 51:45Christine M Jonathan C Steven G Lis K and surj S all right if you recognize yourself awesome congrats um yeah and
372. 51:56that's it a quick overview today of the new assistant CI combined with some of the new tools and modalities that we
373. 52:01launched we still have 20 minutes the Simplicity of a rich text or voice conversation for you and users we really
374. 52:09can't wait to see what you build and congrats to our lucky winners this is mindblowing you know what you're all
375. 52:15part of this amazing a community here so one last time before I step off the stage hey assistant can you actually
376. 52:24give everyone here in the audience $500 in open credits sounds great let me go through everyone look at [Applause] that all
377. 52:41right that function will keep running but I don't have time so thank you so much everyone have a great day back to you
378. 52:49son the Oprah of AI That's funny when is the remed class Kyle soon as I figure this [ __ ] out should I make a Dev account with the
379. 53:01same email yeah I use the same goes into beta today and we are super excited to see what you all do with it
380. 53:09any over time gpts and assistants are precursors to agents are going to be able to do much much more they'll
381. 53:18gradually be able to plan and to perform more complex actions on your behalf as I mentioned before we really believe in
382. 53:26the importance of gradual iterative deployment unless he does it one more thing important for people to start
383. 53:30building with and using these agents now to get a feel for what the world is going to be like as they become more
384. 53:36capable and as we've always done we'll continue to update our systems based off of your feedback so we're super excited that we
385. 53:45got to share all of this with you today we introduced gpts custom versions of chat GPT that combine instructions extended knowledge
386. 53:54and actions amazing we launched the assistance API to make it easier to build assisted experiences with your own
387. 54:01apps these are our first steps towards AI agents and will be increasing their capabilities over time we introduced a
388. 54:09new gp4 turbo model that delivers improved function calling knowledge lowered pricing new modalities and more
389. 54:17and we're deepening our partnership with Microsoft in closing I wanted to take a minute to thank the team that creates
390. 54:24all of this open ey has got remarkable Talent density but still it takes a huge amount of hard work and coordination to
391. 54:32make all this dunkaroo some of those tools are for developers but the gpts are for consumers we do all of this because we
392. 54:41believe that AI is going to be a technological and societal Revolution it will change the world in many ways and
393. 54:47we're happy to get to work on something that will Empower all of you to build so much for all of us we talked about earlier how if you
394. 54:55give people better tools they can change the world we believe that AI will be about individual empowerment and agency
395. 55:02at a scale that we've never seen before and that will Elevate Humanity to a scale we've never seen before either
396. 55:08we'll be able to do more to create more and to have more as intelligence gets integrated everywhere we will all have superpowers on
397. 55:17demand we're excited to see what you all will do with this technology and to discover the new future that we're all
398. 55:22going to architect together we hope that you'll come back next year what we launch today is going to look very
399. 55:29quaint relative to what we're busy creating for you now wow thank you for all that you do thank you for coming here today there you
400. 55:36[Applause] go holy crap there you have it unbelievable unbelievable all right what do you think Queen yeah what we're going to see a
401. 55:50year from now is going to be quaint is going to make this stuff look quaint um the fact that that we're going to be able to to make our own
402. 56:02[Music] um let me get that going make our own Bots with our own data is huge so more bots so Kyle what's up
403. 56:16um well the so Claude um the main reason I used Claude was for long documents that's going to be no longer necessary they so what they've
404. 56:32told us for all of this year is that gp4 was going to have a 32,000 token context window one of the things he announced
405. 56:40today was 128,000 tokens Claude has 100,000 tokens so they just they just flushed Claude down the toilet in terms
406. 56:48of a requirement if you have long documents um one of the things people ask for my lives all the time is but how
407. 56:56how do I get it to know [ __ ] about my data they just made that easy for consumers also easy for developers they
408. 57:04took all the stuff that Lang Chain's doing not maybe not all the stuff Lang Chain's doing a lot of the stuff Lang
409. 57:08chain is doing and they're making that available to developers right within chat GPT so that's a big thing um naming
410. 57:16these things gpts and not bot Bots is brilliant right this is similar to when when Apple launched their Vision Pro
411. 57:24goggles they never used the term metaverse once right why because they wanted to redefine it as spatial
412. 57:33Computing which they successfully did as evidenced by the fact that meta referred to what their goggles do is spatial
413. 57:41Computing like two months after Apple did that so chat GPT by calling these things gpts that's all anyone is ever going to
414. 57:50call these things are you going to GPT that oh give me that GPT hey do you have a GPT that does this it [ __ ]
415. 57:56brilliant people don't want Bots we already have a Hollywood narrative that the robots are going to kill us so if
416. 58:02you call them Bots everyone will be afraid of them but now it's just a GPT go GPT that yeah yeah so that's
417. 58:09huge um I don't even really remember any any of the other details those are the biggies uh thanks for going live I think
418. 58:16that was great awesome thank you yeah thanks for thanks for hanging out with me how do how much time do I have I have
419. 58:21a few more minutes here um party next year in San Francisco just got off the open AI live stream and mind blown I
420. 58:27know Nexus Nexus the a AI Hub it's I I mean the the amount the am the amount of announcements that just
421. 58:37happened is like it's it's really hard to unpack 128,000 token context window the collapsing of everything into a single tool that just does
422. 58:46everything gpts a GPT Marketplace a GPT marketplace with Revenue sharing so if you publish a publicly usable GPT that
423. 58:57probably ranks right in their different categories they're sharing Revenue with you um that's what we say to ourselves
424. 59:06when we think we can leave your live unless he does one hour or unless he does one more one more what oh one more thing oh yeah
425. 59:16exactly that's good yeah although my my one more things are never planned they're always just you know chat add brain fart [Laughter]
426. 59:27oh my God con actions can take actions on our behalf that was the other one River can take take actions is huge oh
427. 59:34and then the fact that you can upload just your documents to it amazing I've never been so glad for a Monday morning
428. 59:40meeting was postponed thank you I know I postponed a meeting I'm so glad I did because it was only like an hour ago I
429. 59:45thought why don't I go live and just talk about this stuff and though it was it was you know Sherry was asking about
430. 59:52you know why am I crying and someone else said I'm finding myself getting really emotional I'm headed over to pie
431. 59:57for some therapy like this was oddd