Me:: what's the cheapest 64GB laptop that will run Llama 3.3 70B ? #AskingForAFriend :-) Simon Willison:: I can now run a GPT-4 class model on my laptop
Discovered: Dec 10, 2024 15:24 Me:: what’s the cheapest 64GB laptop that will run Llama 3.3 70B ? #AskingForAFriend :-) Simon Willison:: I can now run a GPT-4 class model on my laptop <– QUOTE: Meta’s new Llama 3.3 70B is a genuinely GPT-4 class Large Language Model that runs on my laptop. ... Just 20 months ago I was amazed to see something that felt GPT-3 class run on that same machine. The quality of models that are accessible on consumer hardware has improved dramatically in the past two years. ... My laptop is a 64GB MacBook Pro M2, which I got in January 2023—two months after the initial release of ChatGPT. All of my experiments running LLMs on a laptop have used this same machine.