Future of AI: Run LLMs Locally on NEW Macs! #shorts

Transcript

1. 0:00I just saw a post today that it looks like the M7 the M7 processors that are coming out in like a year and a half
2. 0:12are going to have up to 1.5 terabytes of unified memory. So, you know, 2 years from now, 3 years from now, you'll be able to run something
3. 0:27like the GLM 5.2 model on a local machine. Can you say that again about the Mac? I'm about to purchase a new one. Okay.
4. 0:37I did a graphic on this. I don't know where it is. Let me see if it's in chat GPT. Found it. Okay. So,
5. 0:52so if you go to the AI Salon, am I still sharing? Let me make sure I'm still sharing. I am. Go to the AI Salon. Um
6. 1:04go up to the top where it says get started. You have to be at one of the top level things to search everything.
7. 1:12It's it's in the community feed. So, you can either go to the community feed and search. Actually, let's let's do this. So, if I
8. 1:19go to the community feed and I search for local LLM. It's the second It's the second graphic. Okay. So, let me explain this graphic.
9. 1:35What this talks about on the left-hand side of it is Apple versus PC workstation. The the big difference here is that
10. 1:47the term unified memory is really important. So, when you buy a Mac, the M series Macs, and it's got 64 gigs of unified memory.
11. 2:00Both the GPUs and the CPUs can use the same memory. When you buy a PC, you've got RAM for your CPU, and then you've got graphics
12. 2:13cards with VRAM for the GPU. >> Watch the full replay at community.thesalon.ai.