aiLL Feb 8, 2024 - (2 of 3) Google's Gemini AI Falls Flat: Disappointing Debut of ChatGPT Competitor

Transcript

1. 0:24hello hello hello hey Danielle Lun sck what's happening oh boy I listen listen don't don't pick on
2. 0:41[Laughter] Gemini oh Gemini I just got Gemini Advanced anyone else I signed up for the promo two months for free so far I'm
3. 0:54loving it Kayla's digging it who else we got what else we got here nothing there show and tell there's a couple of classic
4. 1:05prompts in here all right my phone battery was not prepared for an early live yeah well you know it it was
5. 1:18unceremoniously uh launched this morning um at like 7 a.m. I don't even know what time I woke up and people were already commenting about it
6. 1:30um so so Gemini Gemini Ultra is available it's 20 bucks a month um the image generation is pretty bad and uh here I'll show you D Danielle
7. 1:48started a bit of a uh a comedy forest fire dumpster fire so wait let me find it here okay this is it so so Danielle puts out this
8. 2:04post that that is actually like an awesome like one of the things we want to do in the salon right so so what she puts out is I'm going to
9. 2:15compare um the image generation tools right because a lot of people in the community use um use di some use co-pilot a lot use mid
10. 2:27Journey um things like that so what' she do then and then yeah Firefly so so what she did was she created a
11. 2:35prompt that was I don't know bare with magical wings I you know something is Gemini a worthy replacement of
12. 2:44Claude that I don't know lunatick one of the things that I find fascinating about Gemini right now is it doesn't have it
13. 2:51doesn't look like you can upload non-image files it looks like you're only uploading um image files so Claud
14. 2:59you can upload PDFs and csvs so it's not doing that yet so I don't think so um but anyway there's a dolly image of bear
15. 3:08with wings and then there's the co-pilot image with bear with wings which is also Dolly 3 so it makes sense that those
16. 3:15would be kind of in the similar neighborhood although you know I would argue that the chat GPT version is
17. 3:21better probably because they're doing better prompting on the back end um so that's that then you got Firefly which
18. 3:28you expect would expect to be sort of a level down just cuz Firefly has not been trained on on everything and then
19. 3:42you the Gemini bear it's too sad oh my God it's so bad it's so bad
20. 3:59he's just has got like dirty paint he's got like dirty paint on his fur and it's it's like his mom put together a costume
21. 4:07for Halloween at the last minute so sad and then the comments in this thread are [ __ ] hilarious so you should go check this
22. 4:20out it's it's in show and so so anyway um yeah Gemini is not getting a ton of love right now I also I [ __ ] all
23. 4:33over it this morning cuz I I still can't log in with work group and Pate rightfully said well you've just got to
24. 4:39go change your settings in your work you have to reach out to your administrator and have them set the settings which
25. 4:46I've done like multiple times before so I guess we have to do it on a product by product basis um but but basically if
26. 4:53you've got a workg group account they default you to not having access to it Gemini is giving Walmart version
27. 5:00AI EXA it kind of looks good in the store and then you get it home and you're like so anyway that's [ __ ] hilarious
28. 5:09so thank you Danielle for doing that just putting that out there um where's my Gemini why okay so here's Gemini so let me
29. 5:21see yeah it I can only upload an image so I can't I can't upload a PDF well wait let me try to upload a PDF um let me go search for pdf.pdf
30. 5:35Gemini bear Gemini bear is definitely a new AI learning lab um zoo zoo [Laughter]
31. 5:49member lordy lordy lordy uh let see PDF PDF document yeah no
32. 6:03yeah I can't okay so with Gemini Advance 20 bucks a month you can't upload um Megan I'm back great welcome you can't
33. 6:11upload PDFs or CSV files to it so no I don't think this is a replacement for Claude um trying to think let's see roleplay as
34. 6:26a character for a novel trying to think what things we could use that that would be an interesting test [Music]
35. 6:38um let's see help me come up with 10 low cost or how about 10 no
36. 6:55upfront cost businesses I can start in my spare time you too can have an awkward bear in
37. 7:10a tooth fairy costume I think I think that bear Danielle is going to be the hero image of the live [Laughter]
38. 7:26tonight oh Lordy all right freelance writing virtual assistant social media manager tutoring or teaching th those who can't do teach
39. 7:38those who can't teach teach AI That's bad that's just not right um graphic design web development translation services Consulting blogging
40. 7:54vlogging um um give me 10 non obvious ideas
41. 8:10be creative all
42. 8:27right reactionary Video Creator that's actually interesting upy furnit up cycled Furniture flipper that's good Niche meme account
43. 8:44curator let's see um I'm in [Music] Denver help me come up with 10 names for
44. 8:58number two two let's see if it understands what number two is absolutely Peak refurb okay so it understands that we're
45. 9:13in Denver incorporating a bit of the local flavor into the furniture flipping business so it it understood what I was
46. 9:21asking it about that's good that's a good sign focus on Colorado Mountain Vibes Peak refer Mile High makeovers Aspenwood
47. 9:30Ash upcycled Alpine trail head Transformations the flip side the flip side Workshop is actually a really good
48. 9:44name actually just the flip side is is a good name for for a business that does flipping you know relo Furnishings not your granny's
49. 9:54addict the renew shop found and flipped um PE refurb let's go with I like the flip
50. 10:10side can you please come up with 20 creative taglines not Kyle now becoming a flipper
51. 10:27I've flipped for years although I stopped this past year AI totally ate all my flipping energy um the flip side where where old
52. 10:37old finds new style up upcycled Furniture vintage Vibes fresh design unique Furniture finds from forgotten to
53. 10:45Fabulous the flip side from forgotten to Fabulous the alliteration is really nice that's good so let's go let's grab that
54. 11:00great let's go with this um please create a marketing plan
55. 11:16and then write the introduction post I can put on my Facebook account
56. 11:33I mean it seems it seems like it's like it hasn't fallen on its face in any of these text based things
57. 11:47um but the fact that I can't upload PDFs csvs things like that are not great um
58. 12:06Facebook introduction post image and eye-catching before and after of your best piece yet caption tired of boring
59. 12:14mass-produced Furniture so are we introducing the flip side from forgotten to Fabulous we rescue sad unwanted
60. 12:21furniture and give it a whole new lease on life modern makeovers BL hashtags Denver vintage so it remembered we were
61. 12:27in Denver consider running a small budget Facebook ad campaign let me know if you want any help flushing this out um let's make a
62. 12:38logo now my suspicion is it's going to describe the logo but let's see absolutely since we don't have visual design tools here yep could you
63. 12:51give it a website link and have it evaluate areas of improvement basically sounds like a semi- Improvement on bar
64. 12:59yeah so far wait you can actually upload a file tell me how Shay what do you do just drag it in there cuz I can upload a
65. 13:09picture tell me tell me what I'm missing where am I missing file upload um please make that image for
66. 13:26me Gemini bear please make that image for me it says go to canva go to canva or go to Fiverr and
67. 13:41hire someone oh god really okay let me try this make a concept image of what the logo might look like
68. 14:00using your image generation skills Kyle my man make it wides screen
69. 14:15too make what wide screen this thing are we going WID screen now can it do that uh yeah but then I can't read the
70. 14:27then I can't read the comments Tik Tok isn't quite there yet um all right it's just refusing to make an image so th this is something that's
71. 14:39just weird let let me see um make a photograph of a bear in the mountains with magical
72. 14:54rainbow crystal wings sure here's a photograph all right it's it's willing to do that so maybe if we get it into be
73. 15:12[Laughter]
74. 15:27making oh Lord Gemini bear you're so
75. 15:44sad at least it's got a consistent vision of of of what oh if this is legit now Google has the same words uh wait
76. 15:59now Google oh Google the same words and click the images if this is legit if what's legit this takes me back oh my God that's so
77. 16:10bad that's like it's like bad Photoshop it's like what did they train it on like a bunch of Engineers using Photoshop like
78. 16:23wow um let me see if we can add uh text to it great love them can you make a new image with the
79. 16:39words the flip side on the top and from forgotten to Fabulous on the
80. 16:57bottom uh love them can you make a new image of the bear let's see if it can make images with words and how well it does
81. 17:11that oh why was that so funny oh I'll show you why it was so funny we'll go I'll go show you oh boy oh
82. 17:20boy oh boy oh boy the uh the typography there's actually pretty good not I mean it's not horrible that wow wow there's there's
83. 17:34more dirty paint on the here here we go look at him he's Majestic for those of you that are wondering why this is funny so so
84. 17:49Danielle from the from the AI Salon put together this post that she was the inspiration for this put together this
85. 17:58post post where she said well let's let's try like how good is is Gemini's image Generation stuff so she said you
86. 18:05know here's Dolly 3 beautiful here's co-pilot which is also Dolly 3 nice not as not quite as sophisticated and nice
87. 18:14there but you know solid here's um Firefly which is you know argu arguably a weaker image generation tool but it's okay and then
88. 18:25and then here's Bard or gem it's just bad and then the ones I just did now I don't know what what prompt
89. 18:39she is so it it is very fair to say that I might have given it a shitty prompt but the consistency between her bears and my Bears are pretty
90. 18:51tight oh good lord uh so let me see um can you try try to mock up a logo using the same
91. 19:11tool I like that font though I like that font though too Kyle do did you use mid Journey now all of those images the the
92. 19:18what I'm in right now is I'm in Gemini Advance the new high-end version of uh Google's gp4 compe edor um it still
93. 19:30refuses to do a logo so so you can't you can't concept logos in this thing apparently um the image generation is
94. 19:40probably it's probably better than Dolly 2 was or maybe it's in the same neighborhood of Dolly 2 the typography was great yeah the
95. 19:49typography was good Best Day Ever um let me see what else I can do um make a
96. 20:05table comparing uh starting a flipping business with a Furniture building
97. 20:25business bye Joy party you're wel welcome thank you what's going on why are you alive now oh just because uh Google Gemini
98. 20:34Ultra came out and I've been playing with it and it's it's actually it's actually not worth going live for B
99. 20:41basically my message with Gemini Ultra right now is back to your regularly scheduled programming um don't there's
100. 20:48the chat gbt has been has not been knocked off the perch by a long shot um if whoever said that you can upload uh
101. 20:58files other than images to Gemini Advanced did did anyone let me know who's live at this time H well I'm
102. 21:08just live at this time because I hour to kill free trial so how did this do generally lower skill
103. 21:27set all right so I can make tables comparing things let's let's do a table make a table comparing gummy bears and
104. 21:43Sushi see if it flips it out if you do something nonsensical modern candy invention culinary tradition dating back centuries
105. 21:58all right so it did that pretty good like it seems to be doing you know the parlor tricks that gp4 does it seems to be doing them
106. 22:06well I mean the writing is not bad it understands what marketing concepts are um let's see write
107. 22:26a write a Flappy Bird's clone that can be run in a browser see what this thing does Gemini needs to be dropped what about coding
108. 22:41yeah that's what I'm trying to do now HTML structure it creates a game
109. 22:55canvas then CSS styling and then the JavaScript game I mean I would suspect it does good with
110. 23:13code um oh yeah yeah let's do let's do a um um give me a list of 10 sites where I can play
111. 23:30Flappy Birds clones that other developers have created let's see how it does the
112. 23:45search the internet thing they are [ __ ] Google so you'd think this is going to be pretty solid unfortunately all right crazy
113. 23:56games search for Flappy iOS store web and Retro Game sites so it gave us five so it didn't actually do much
114. 24:10searching I can go to Crazy Games and play in oh it this is interesting so it says go to Pokey which is a site and then it says
115. 24:20invalid URL removed that's good so it's okay that's something that that open AI is not doing is at least they're
116. 24:31comparing the URLs that it's it's giving someone with its database of known URLs and if it's not in there it's labeling
117. 24:40it invalid that's that's at least a something um let me search for YouTube let me do a new search new chat let's say
118. 24:54um how many videos are on the at AI learning lab
119. 25:08dtt um Channel on
120. 25:22YouTube there's no easy way for me to directly determine it YouTube FL ues no API access here's a link let's see if it
121. 25:33actually works I assume it will yep okay that's good um can you search the transcripts of
122. 25:50videos on this channel just saw from tech tech crunch Google saves convos for default of 3 years is that what that said I just got
123. 26:03access to the advanced version I haven't tried it yet hello Dr bod what's happening I'm sorry but unable to access this YouTube
124. 26:13content the content isn't a valid YouTube link they own [ __ ] YouTube they own YouTube they can search YouTube they know how to search
125. 26:26YouTube they know how to search they know how to search YouTube they own YouTube why is this not why can you
126. 26:42find anything on YouTube all right now it's doing a YouTube search here are some popular YouTube
127. 26:58videos um find any videos from Kyle Shannon or Story
128. 27:14vine all right now it's searching YouTube I found you some videos from here to there creative mornings okay so this is good so it can do it
129. 27:28um summarize the creative mornings video all right searching YouTube this is
130. 27:43promising YouTube search seems cool yeah this seems cool here's the summary the speaker is an artist and entrepreneur
131. 27:50one of the key points he makes is that AI is a powerful tool that could be used for a variety of purposes Shannon also
132. 27:56emphasizes the important of understanding understanding how AI works that's correct overall Shannon is positive and optimistic ha
133. 28:10um find me other videos on YouTube that have a similar Vibe let's give it a weird some weird
134. 28:27ver language and see if it can sus that out all right searching YouTube while I cannot search for similar or related
135. 28:43content here is some TED Talks so maybe they cut a deal with Ted
136. 28:58so it searched for other videos um do you know who David Shiro
137. 29:19is attorney poet filmmaker Economist there's is a YouTuber who talks about
138. 29:45AGI since these props won't work on chat chat GPT the transformation potential yeah this has got really bad like it
139. 30:00doesn't it just found me videos on AGI it didn't it doesn't reference David Shapiro anymore I ask about David Shapiro it
140. 30:09gives me four of them who are not it and then I say there's a you YouTuber who talks about AGI so it didn't connect
141. 30:16that to the fact that we were just talking about David Shapiro then it does a general AGI search on YouTube I would imagine that some of the
142. 30:27restrictions on searching YouTube have to do with privacy and security but that's still [ __ ] up it's I mean it should be better than
143. 30:35that um all right what else can we do maybe there's um new chat I don't know I don't know
144. 30:51what to do all right let's just chat let's chat for a little bit and then I'll go it's not it's not really worth it it's not
145. 31:00it's not worth it it's not it's not worth it it ain't wor that it ain't wor that I don't have a dog all right where's my other glasses
146. 31:16oh there on my shirt these prompts wouldn't work on chat GPT which which ones yes the whatever prompts I was using would work on chat
147. 31:30GPT is it janky Kyle oh it is beyond janky the the tool was uh Gemini Advanced which is based on the Gemini
148. 31:47ultra um underlying large language model the multimodal large language model it does not have the interface that they
149. 31:57demoed when they demoed it that had the infinite uh canvas with all the pictures on it it's not a visual interface it's
150. 32:07just like chat GPT it's just like Bard there they got rid of the name Bard um it's now going to be called
151. 32:14Gemini I think that's a good call I think Gemini is a better name it kind of implies quality
152. 32:30and it's it's really interesting some of the tech demos that they've shared of the Google image technology like they they
153. 32:40shared the style drop paper in the middle of the summer and it looked really impressive and then this is not great and it's you know and I
154. 32:52[Music] wonder if you have an organization that indexes dramatically toward engineers and not
155. 33:07toward the humanities right you have a company like apple that is one of the most advanced technology companies in the world and
156. 33:16they index you know heavily toward the humanities as a balance to the tech and Google's kind of the opposite
157. 33:26Google Go's like all Engineers all the time it's all about math [ __ ] you with your pretty pictures so it kind of makes sense
158. 33:34that the quality of the image generation tool is shitty but if they're if they're advertising Gemini Advanced as the
159. 33:43competitor to chat GPT and you can't easily do data analysis and upload PDFs and csvs and you can't easily janky Gemini
160. 33:54yep and you can't easily um upload upload PDFs do high quality images it's not good I uploaded um the
161. 34:09um the Whiteboard picture that I put that I used for the GPT 4 demo when I when I show the GPT Vision it did pretty good on
162. 34:21that but when it came time to uh make a poster poster in the airport if you've ever seen my demo of that I upload
163. 34:30the Whiteboard of a airport food ordering thing and then like three prompts in I'm like make me a concept
164. 34:37image of a poster in an airport with the interface and the name of the the app on it um chat GPT does that really well
165. 34:47Gemini for for three or four times wouldn't even make the image when it finally did make the image it was
166. 34:54horrible the bear with wings in Google search real close oh interesting yeah there you go so yeah maybe they're maybe I don't know I don't
167. 35:05know how they trained their image model but clearly it's not on good art after seeing the bear I'm hoping to
168. 35:12finally see what buffalo wings look like according to [Music] Gemini all right see later forever
169. 35:28[Music] hooked if they're using unrestricted images only like Adobe did yeah but even adobe's figured out how to get better like adobe's not
170. 35:46horrible I mean this really is like Dolly 2 kind of quality I think Dolly 2 was probably even a little better The
171. 35:52Prompt coherence is bad like like it it's not accurate it did typography okay so that's pretty promising could you compare the Privacy
172. 36:03policies of open Ai and Gemini I can I can look at those later um they say though you're you're right here so right on when you go to Gemini
173. 36:18Advanced the first thing they say big information Shield your conversations are processed by human reviewers to
174. 36:26improve the Technologies powering Gemini apps don't enter anything you wouldn't want reviewed or used so at least with open AI team you
175. 36:36can tell them not to or it defaults to not using your data um Gemini right now is saying people are going to be looking
176. 36:44at this this isn't just um your data is going to go into an algorithm this is human beings are going to be looking at your your answers
177. 36:57[Music] oh no I was talking about private matters Kyle you need to create the Janes AI award show oh actually that's
178. 37:13not a bad [Music] idea
179. 37:28[Music] yeah that's not a bad idea [Music] actually I think I think at the top of
180. 37:42the list is Google making it hard for their paid customers to access their services that one's astounding to me that one's astounding to
181. 37:53me oh I'm sorry you give us money no you can't use these Tools H pixels I have a crypto account called Gemini yep good old Gemini what did I
182. 38:09miss um you missed me playing with with Gemini and then here let's put up the we'll put up the Gemini
183. 38:25bear oh Gemini what have you done there's the Gemini bear with its bad its bad costume wings I asked it to
184. 38:38create a Corvette on fire with a body and they flagged me for violent images yeah yeah this is this has not
185. 38:47been I listen I this is one of the things that I that I I've been talking about a fair amount this year I think
186. 38:55that go Google one of their one of their I think a massive Achilles heel for them you you know how I joke around and
187. 39:07I say that that generative AI is Revenge of the liberal arts Majors you have in Google a company that said the humanities are [ __ ] this is
188. 39:18just about Engineering in fact they they fired their management layer years ago and they that it's just going to be
189. 39:29engineers and so you have a 200,000 person organization that's good at engineering brilliant at engineering they invented
190. 39:40the [ __ ] that we're all playing with right now and you have no balance in there for them to create tools that a huge part of what they
191. 39:51do is generate creative output music images creative writing you know um business
192. 40:09writing how are they going to how do they backfill that lack of experience because what an engineer will
193. 40:19say is did it did it hit the Benchmark here's the benchmark test that says if it's good or not here's our technology it hit the
194. 40:29Benchmark and then human beings go in there and go the bear looks funny well it produced a bear the bear clearly has wings ERG go we have
195. 40:42succeeded I don't how I think that's this is a bigger mountain to climb than than than maybe they're thinking it
196. 40:52is because cuz quite frankly from what I've experienced experienced they're nowhere close to gp4 I don't give a [ __ ] what the numbers
197. 41:03say they might be accurate maybe for certain tasks but that's not what they advertised what they advertised was a
198. 41:11true multimodal engine multimodal from the ground up that can do all this multimodal stuff and they have laughably bad
199. 41:23images and it doesn't always even do images it can't it can't mock up a logo what so
200. 41:39so who's in there testing this stuff Engineers I think the bear has a club now that's
201. 41:54awesome oh man all right let me let me run I'm going to go um yeah wild wild wild wild
202. 42:09wild I'm bummed I'm bummed I was really hoping we had someone that came in and kind of kicked chat GPT in The
203. 42:25Shins and we didn't and we didn't so we're going to just have to wait for open AI to innovate unless someone else
204. 42:32comes along I mean we're going to have apple in the game I think Apple's probably going to live in a very
205. 42:38specific space is my guess like with personal agents um and that's probably not going to be until June like who else is
206. 42:55coming I mean meta meta's training llama 3 and they're going to open source it but they just made that announcement two or three weeks
207. 43:08ago so that's probably 6 months out maybe four all right well it's back in Sam alman's Court make [ __ ] better all
208. 43:21right inflection AI they may come in they may come in but right now they're not like I think inflection is going to come in in the
209. 43:31agent space I don't think they're going to come in in the multimodal space bite dance possibly bite dance possibly yep that's
210. 43:41an interesting one Detroit Jay they have lots of data they have lots of audience although you
211. 43:55know as specific as Tik Tok is it's not going to be easy for them to create a chat GPT like thing I don't
212. 44:05maybe it is I don't know I don't know we'll see like you can't just cram you just can't keep cramming new features
213. 44:11into the already overloaded Tik Tok interface right like it's all it's already like laughably over complicated so I don't know
214. 44:29interesting meanwhile people are loving the uh Vision Pros I think the vision Pros have have have I think apple has a
215. 44:36[ __ ] hit on their hands like I I haven't seen a like the the um the bad reviews of it are not bad they're like
216. 44:45little nitpicky details but the core reviews of it are holy [ __ ] I've seen the future so maybe the activity shifts a
217. 44:55little bit away from large language models and into that space although there's not going to be a lot of people playing with it at 3500
218. 45:02bucks so I don't know man crazy times crazy times all right peace out have a great evening Kyle oh I'm going to be going later
219. 45:10tonight I'm G to be going on at 9:00 I got a networking event have a great evening we just have to wait a little
220. 45:15longer yeah exactly exactly what in the history of Google made you think that something good was going to happen today
221. 45:22I don't know a man can dream uh I guess maybe what it was was uh their marketing video that everyone bitched about being
222. 45:31faked I was expecting something I I was not expecting something this bad so I I expected it to be somehow
223. 45:40better or or or like I expected it to be really better in at least an area or two and I was thinking it might be better an
224. 45:46interface and it's the same [ __ ] interface I totally missed something you just missed we just played with Gemini
225. 45:53uh Advanced which is the new Ultra version it's very disappointing you have to see my chat in AI I've seen the inside of the
226. 46:05hive all right everybody I'm out of here peace I'll talk to you some other time oh tonight 9:00 Mountain I'll make a video with a timer
227. 46:16on it all right peace out everyone