Welcome, humans.
Meta might finally be becoming the good guy in tech. How the tables turned.
Here’s what’s going on in the world of AI today:
- Stanford researchers introduce Alpaca 🦙️
- Microsoft fires ethics team 🧯️
- Microsoft's 9-figure supercomputer 🧑💻
- Our first AI poll ✋
Introducing Alpaca, Stanford's ChatGPT-like Model 🦙️
AI researchers and personalities like Elon Musk have long been worried about OpenAI and Microsoft's potential dominance in AI. But new research might abate those concerns:
Stanford researchers just upgraded Meta's LLaMA to create Alpaca 7B, a model that performs at the same level as ChatGPT. And it achieved Alpaca by using ChatGPT itself.
Researchers spent only $600 training and fine-tuning LLaMA on data generated by OpenAI's GPT-3 to build Alpaca 7B. Impressively, fine-tuning LLaMA took them just 3 hours on 80GB A100s (which costs less than $100 on most cloud providers).
That's like winning a cooking competition using your competitor's ingredients ... for nearly free.
Our big takeaway: open-source (i.e., LLaMA) is catching up to closed-source (i.e., OpenAI).
- Giving people access to models makes it easier to train and optimize them to fit specific use cases.
- Alpaca is just the latest project built on top of LLaMA; Other projects have made LLaMA small enough so that you can run it on your own at home on your own laptop.
What the future looks like: more (and more specialized) ChatGPT competitors. Next up: camels?
Microsoft Fires Entire AI Ethics & Society Team 🗡
Included in Microsoft's recent layoffs is its AI Ethics and Society team, which worked to ensure that product designs reflected the company's responsible AI principles.
While Microsoft insists that it's continuing to invest in responsible AI oversight, the move represents an ongoing tension for tech companies to ship fast and ship responsibly.
So far, it's clear which path Microsoft has prioritized:
“The pressure from [CTO] Kevin [Scott] and [CEO] Satya [Nadella] is very, very high to take these most recent OpenAI models and the ones that come after them and move them into customers hands at a very high speed.”
John Montgomery, Microsoft's corporate vice president of AI
And it's no accident. Microsoft is doing everything possible to speed ahead of Google in AI-powered search, software, and computing.
Only time will tell if it comes at the expense of the rest of us. For now, expect Microsoft to move fast and break (a lot) of things.
Around the Horn 🦄
- Thousands of AI startups have been potentially saved after the FDIC's decision to protect all SVB depositors.
- Microsoft combined tens of thousands of Nvidia graphics chips to build a supercomputer to support OpenAI (and it cost hundreds of millions of dollars).
- How AI's victories in Go inspired the game's top players to improve their abilities.
- Fans are loving the ability to talk to various characters through Character.ai.
- Animators are really not fans of how a production studio used AI to make an anime video.
Treats To Try 🍿
- From our partners: Salad offers easy, flexible, and affordable inference. Create 1,000 Stable Diffusion images for just $1. Why pay AWS 4x as much when you don't have to? Just sign up for a SaladCloud Portal account and start sending requests.
- Clipdrop is the ultimate suite of AI tools, plugins, and resources to create and edit amazing visuals.
- An OpenAI Chat that provides you with summaries, notes, and reviews of pull requests.
- A GPT bot that creates custom and interactive web pages from prompts (aidev.codes).
- SwiftGPT, a macOS app for ChatGPT that you can download on your Mac.
- How to use ChatGPT to generate amazing interior design photos in Midjourney.
DM us links on Twitter: @nonmayorpete & @noahedelman02.
Leo Sends His Regards
Source: DeepLearning.AI on Twitter
We're running polls! Choose one of these options and we'll share the results here tomorrow.
It's 2030. AI's leading models are ...
Login or Subscribe to participate in polls.
- That's all we have for today. See you cool cats on Twitter if you're there: @nonmayorpete & @noahedelman02.
- Get your brand in front of 22,000+ professionals by sponsoring The Neuron.
