😺 ChatGPT might be deteriorating...

PLUS: "Apple-GPT"

Welcome, humans.

Beep boop. This is your favorite AI newsletter that’s not written by an AI. 🤖

Here’s what’s going on in AI today:

GPT has deteriorated since March, according to a study.
Apple is testing an internal chatbot with no plans to release it yet.
GPT-4 prompts are increasing to 50 every three hours.
Stack Overflow posts are down 16% this year thanks to AI.

Sponsor The Neuron | New Here? Subscribe!

Is ChatGPT Getting Worse? Maybe…..

Over the past month, we heard over and over from coders that ChatGPT was getting dumber.

OpenAI insisted ChatGPT hasn’t changed.

But now, a new study has evidence that ChatGPT’s behavior has changed since March.

Stanford researchers found that ChatGPT (in June) performed worse than ChatGPT (in March) across tasks in math, reasoning, and code. Reddit, you might’ve been onto something.

But just because its behavior changed, doesn’t mean ChatGPT itself has changed.

Let’s explain.

ChatGPT is made up of components.
These components haven’t been fundamentally altered.
But over time, OpenAI has nudged these components to act differently (fine-tuning).
Now, the components seem to perform worse in some areas.

Why it matters: Honestly, no one knows exactly WTF is going on. Could be fine-tuning, could be a GPU shortage. OpenAI said that it’s looking into it.

What we do know is that ChatGPT is closed-source, so we’ll never really know what’s going on under the hood. That is unless they make it open-source. Devs have been pushing for it. Meta is doing it. Just sayin’. 🤷

FROM OUR PARTNERS

Are you seeing the light? We are with this free newsletter.

It’s 1879, and you’ve just received a telegram informing you that Thomas Edison has filed a patent for his breakthrough innovation - a carbon-filament light bulb!

Armed with this knowledge, you are suddenly able to make plans to profit from this revolutionary invention.

Now fast forward 144 years and meet Patent Drop.

This free twice-weekly newsletter scours the U.S. Patent and Trademark website to uncover the latest innovations in big tech that will shape the direction of our future.

Be the first to know of Big Tech’s modern-day “lightbulb moments” by subscribing to Patent Drop here. 💡

Apple Is Working On Its Own AI Chatbot 🍎

Apple has been slow to get into AI.

But there’s a huge opportunity for them to put AI at the center of iOS.

One obvious use case is Siri.

Siri is bad. It has worse hearing than my grandma. Embedding a GPT-like chatbot behind Siri (& connecting it with all our daily productivity apps like Calendar) could be a 10x improvement overnight.

According to Bloomberg, Apple is working on an internal chatbot that could potentially fill this gap.

Details are TBD (apparently, even Apple doesn’t know), but employees liken the chatbot to ChatGPT, Bard, and Bing.

Why it matters: Instead of “move fast and break things," Apple’s ethos has always been “be methodical and nail it.”

That’s their playbook for AR/VR. That’s their approach to AI. We expect to see the first signs of AI on Apple devices later this year.

Around the Horn 🦄

OpenAI is increasing the number of messages you prompt GPT-4 to 50 every 3 hours.
SAP, the consulting giant, invested in AI startups Anthropic, Cohere, and Aleph Alpha.
OpenAI is worried that ChatGPT with visual search could be used for facial recognition.
Qualtrics plans to spend $500 million on AI over the next four years.
Posts on Stack Overflow are down 16% this year thanks to ChatGPT.