😺 ChatGPT sees your screen

Welcome, humans.

We're now accepting advertising partners for Q1 2024, and inventory’s moving faster than the price of Bitcoin right now.

With 470,000+ readers, a 42% open rate, and a new standalone secondary placement to offer, there's never been a better time to get your product in front of our audience.

Want in? Fill out our 60-second partnership form and let's make some magic happen.

Advertise in The Neuron here.

Here’s what you need to know about AI today:

• ChatGPT’s desktop apps can see your code on your screen.
• Anthropic tests Claude with nuclear agency for security.
• Pony AI plans a major U.S. IPO.
• Virgin Media O2's AI bot wastes scammers' time.

ChatGPT's Mac update quietly sets the stage for January's big “Operator” release (and by Operator, we mean “agent”).

If you missed yesterday’s story (and even if you read it), you might have missed this:

While January is a long time from now (AGES, in AI years), OpenAI just released two big updates to its desktop app that set the stage for what’s to come:

1. ChatGPT for Windows is now available to everyone, with features like Alt + Space for quick access + companion windows to pick up where you left off.
2. ChatGPT for MacOS can now “see” exactly what you see on your desktop, and help you do stuff within apps.

Video demo of how this works in action

For the Mac update (which is the really interesting one), ChatGPT's desktop app can now directly interact with apps on your screen.

For developers, this means ChatGPT can now read directly from:

• VS Code (coding tool) and Xcode (Mac-app specific coding tool).
• Terminal and iTerm (the interface for talking to your computer to run programs and commands).
• Even basic text editors (like TextEdit, where you can write simple code or notes).

The best way to think of this update is as a test run for how ChatGPT will interact with your computer when it becomes a full-fledged agent in January. For now, it can only see these apps, but soon it’ll be able to act on your behalf.

Here’s how you can try it yourself:

1. Download the Mac Desktop app + VS Code if you don’t have them already.
2. Install this extension (link starts a download fyi), open VS Code, hit CMD + Shift + P, and type “Extensions: Install from VSIX” (official explainer here).
3. Select “Work with Apps” in ChatGPT, and add the Option for VS Code and Terminal access with the “+” next to both.

To stop sharing your editor and terminal with GPT, just click Stop.

Once this is set up, ChatGPT sees everything in your open editor panes + the last 200 lines of your terminal. You can even highlight specific sections to focus GPT’s attention, just like you would with a human programming partner.

From here, ask ChatGPT to guide you as you write the code for your app (or write the code for you), then troubleshoot things for you in real-time.

FROM OUR PARTNERS

Metaview: The World’s #1 AI scribe for recruiting

This is awesome: Metaview’s AI automates the toil of note-taking during interviews so that you can be fully present and focused on the conversation. With Metaview’s highly accurate AI notes, recruiters and hiring managers at companies like Deel, Deliveroo, Sony, and HelloFresh are saving 10 hours per week.

• “If you’re not using Metaview yet, you’re making a mistake.” Zack, Founder, Pac Heights Partners

You can get started with Metaview in minutes, and it works alongside all of your existing tools.

Oh, and speaking of awesome? As The Neuron reader, you're invited to an extended free trial. That's what we're talking about!

Give Metaview a spin on your first 10 calls—completely free.

Treats To Try.

1. *If you want to learn how data scientists are solving real practical challenges with agentic workflows, you need to join Vellum’s GenAI webinar. Learn best practices on building agentic workflows that automate research tasks—from making restaurant calls with voice to scraping review sites for due diligence. Seats are limited - grab yours now.
2. Symphony Creative Studio from TikTok generates fresh TikTok videos from your basic product details, letting you add avatars, translations, and TikTok-style edits without filming anything yourself (more details here).
3. ElevenLabs Projects helps you turn books and scripts into polished audio content by letting you organize chapters, assign different AI voices to characters, and edit specific sections.
4. Gemini has an app now for talking via voice chat to get answers, summaries, and help with tasks.
5. CuriosityXR turns your Meta Quest into an interactive teacher that shows you 3D models of anything you ask about in real time.
6. Recall.ai streams your web apps directly into video calls, letting you add interactive tools like language translators and sales agents to your meetings.
7. Zepic automates your customer messaging across WhatsApp and email.

See our top 51 AI Tools for Business here!

*This is sponsored content. Advertise in The Neuron here.

Around the Horn.

Check it out here, code here.

• Anthropic partnered with the U.S. Department of Energy's National Nuclear Security Administration to test whether its Claude models could accidentally share sensitive nuclear information in classified settings.
• Pony AI, a Chinese self-driving car company, announced plans to raise up to $195M in a U.S. IPO at a valuation of up to $4.48B.
• Virgin Media O2 revealed Daisy, an AI who keeps phone scammers occupied by chatting endlessly about knitting and family stories in a convincing elderly voice, wasting up to 40 minutes of their time per call.

FROM OUR PARTNERS

You can now Transform Adobe Stock images with Firefly AI.

Check this out: New features in Adobe Stock enable creators like you to find more unique, relevant content you can customize to your needs. Swap backgrounds, remove elements, expand frames, match styles, and replicate compositions—and preview all changes before purchasing. Learn more here.

Intelligent Insights

Dario Amodei: Anthropic CEO on Claude, AGI & the Future of AI & Humanity | Lex Fridman Podcast #452

• A robot who trained on hours of videos of skilled surgeons conducting surgeries performed the same surgery at the same skill level without human assistance.
• Sam Altman apparently wants to do a $1T training run at some point, which he believes will help solve physics + nuclear fusion (full video)
• Fraudsters are uploading AI music to Spotify under established artists' names to steal streaming revenue.
• An ICU nurse says AI systems are being increasingly implemented in hospitals, from patient monitoring to documentation—and shares why that’s “terrifying.”
• Microsoft teamed up with The Vatican to create an AI 3D digital twin of St. Peter’s Basilica for online visitors to explore (here’s a preview video) and teamed up with NASA to make an “Earth Copilot” that uses geospatial data to answer questions about the world (video here).
• Gartner predicted that 40% of AI data centers would face power shortages by 2027 due to rapid growth in energy consumption from generative AI systems.

A Cat's Commentary.