šŸ˜ø How to fine-tune GPT-4o

PLUS: OpenAI landed its first gov client?!
August 21, 2024
In Partnership with

Welcome, humans.

A ginger cat named Chubby has been going viral lately. From battling poverty to getting arrested for shoplifting, Chubby's heartrending stories have racked up millions of viewsā€¦ all to the tune of a cat-themed cover of a Billie Eilish song (call it a ā€œmeowā€-mix!)

His ā€œunstoppable riseā€ stems from the perfect storm: social media algos focusing more on ā€œmediaā€ than social, AI empowering spammers to make bank producing content at scale, and humanityā€™s undeniable love of cats. šŸ˜ø

In fact, the trend is so popular that creators of these videos now sell courses. If you ask us, that orange cat looks a LITTLE too familiarā€¦ should we get in on craze?!

Hereā€™s what you need to know about AI today:

  • OpenAI launched GPT-4o fine-tuning with free tokens.
  • USAID adopted ChatGPT Enterprise for administrative efficiency.
  • NVIDIA created AIs for weather forecasting and game NPCs.
  • Virginia's water usage surged due to AI-driven data centers.

Advertise in The Neuron here.

You can now fine-tune OpenAIā€™s best modelā€”hereā€™s how.

Big news: OpenAI launched fine-tuning for GPT-4o, allowing anyone to customize OpenAIā€™s best model for their specific use case.

You know the old adage, ā€œGive a man a fish, you feed him for a day; teach a man to fish, you feed him for a lifetime?ā€

Fine-tuning is like teaching ChatGPT how you like your fish, so it cooks them the same way every time!

Between now and September 23, OpenAI is offering 1M free training tokens per day (~750,000 words), so itā€™s basically the best time for anyone to give fine-tuning a tryā€”even you, non-coders!

Here's how to do it:

  1. Go to the OpenAI Fine Tune Dashboard.
  2. Select ā€œgpt-4o-2024-08-06ā€ as your Base Model.
  3. Upload your training dataā€”think of ā€œtraining dataā€ as example chats.

Now, you canā€™t just upload a bunch of text or PDFs for ChatGPT to use in its responses (if you wanna do that, try creating a CustomGPT instead.)

For ChatGPT to understand, you need to put your data in a format called JSONā€”think of this like a recipe that GPT can follow to prepare your dish.

If youā€™ve never coded before, this looks intimidating, but itā€™s actually really simple. Each example needs:

  1. The ā€œsystemā€ message (telling GPT its role).
  2. The ā€œuserā€ message (the ā€œpromptā€).
  3. The ā€œassistantā€ message (how GPT will respond).

Hereā€™s what it looks like all together:

{"messages": [{"role": "system", "content": "You are a helpful assistant."}, {"role": "user", "content": "What's the capital of France?"}, {"role": "assistant", "content": "The capital of France is Paris."}]}

Make sure each example is on its own line, and follows the correct JSON format.

You need 10 examples minimum, but ~50-100 is recommended for better results. Keeping with the fish metaphor, itā€™s like showing chatGPT a bunch of different fish, all cooked w/ the same ā€œfinesse.ā€

Itā€™s easier to write these in something like Visual Studio Code, but you can use any basic text editor (Notepad, TextEdit) and save the file with a .jsonl extension (e.g. ā€œtraining_data.jsonlā€).

Now, upload your data, give your model a suffix (e.g.: Neuron-joke-bot), leave everything else on auto, and click ā€œcreate.ā€

Once done, go to the OpenAI Playground and chat with it to try it out!

P.S.: Want a video tutorial? This one makes the whole process super simple.

Whatā€™d you thinkā€”should we do more tutorials like this?

Yes, I want to learn how to improve my AI skills.

Yes, but stick to user-friendly tools only.

No, itā€™s too technical for me.

No, I prefer news updates only.

FROM OUR PARTNERS

šŸ”’Learn how to unlock GenAI's power without risking your business.

ā€‹ā€‹Protecting your data shouldn't mean missing the GenAI revolutionā€”but while you're grappling with compliance concerns, your competitors are launching super-valuable GenAI apps.

Ready to do both?

The team at OctoAI has gathered a panel of industry experts to share insider tips and help you innovate securely and efficiently.

Sign up to join the free round table session on August 27th, and youā€™ll learn how to navigate:

  • Data security.
  • Private deployment.
  • Regulatory compliance.
  • Quality evaluations.

ā€¦And so much more!

Sign up now to secure your place. Can't make it live? No worriesā€”when you register, you still get the recording. Register here.

Around the Horn.

  • OpenAI has a new customer in the federal governmentā€”USAID, who will use ChatGPT enterprise to ā€œreduce administrative burdens.ā€
  • NVIDIA created an AI called StormCast that can forecast thunderstorms and demoed a new AI to make video game NPCs respond more naturally to players.
  • Water usage in Virginia, known as ā€œdata center alleyā€, jumped up by 60%+ over the last 4 years (1.85B gallons!) largely due to AI.

Treats To Try.

  1. *Dell's Precision AI-ready workstations powered by NVIDIA RTXā„¢ GPUs are the most efficient way to handle demanding AI workloads without costing a fortune. Check them out for yourself here.
  2. Luma Labs launched Dream Machine 1.5 with higher quality image to video and text to video that better understands your prompts, plus custom text rendering.
  3. Eppo accelerates and simplifies A/B testing and feature management for organizations, making advanced experimentation accessible to everyone. (raised $47.5M)
  4. STORI creates and manages personalized marketing strategies for branding, content creation, and social media tasks.
  5. Evidently evaluates, tests, and monitors AI-products, offering tools for LLM observability, ML model assessment, and data pipeline quality control.
  6. Molypix generates customizable designs for various occasions using AI, offering templates for posters, invitations, postcards, and cards.
  7. See our top 51 AI Tools for Business here!

*This is sponsored content. Advertise in The Neuron here.

What gives it away that this is AI?

Every Monday/Wednesday, weā€™ll post a new AI video, and your job is to tell us what about the video gives it away as being AI.

Ready? One look, everyone knows the rules:

What gives it away that this video is AI?

Write in

Write in, pt. 2

Hereā€™s what #Neuron readers had to say about last weekā€™s videosā€¦

The Otter video:

  • C.H: ā€œOne of its paws suddenly grows a human finger towards the end.ā€
  • R.B: ā€œOtters never travel alone. Plus the phone screen is wonky, evidenced by the left-side edge.ā€
  • C.D: ā€œOtters are more likely to use android than apple tech.ā€

The party animal:

  • T.C: ā€œTerrible fake shadow that follows the young man. It does not match the shadow behind him or the one on the wall.ā€
  • L.S: ā€œthe hat seems to be floating independent of the head.ā€
  • S.A: ā€œmeme is too old, timelines donā€™t match.ā€ šŸ˜‚

Where do you #Neuron?!

Submit where you #Neuron here for a chance to be featured in our newsletter next week!

Kenny from Pendleton, IN: Work, designing lighting trusses for the entertainment world

Albert from Banff: Keeping up with AI news in the majestic wilderness of the Canadian Rockies.

Victor: From Versailles with love!

Antoinette from Daytona Beach, Florida: Reading my fave newsletter while waiting for my fave guy to call me šŸ˜Š (hope he called!)

A Cat's Commentary.

High praise!

cat carticature

See you cool cats on X!

Get your brand in front of 450,000+ professionals here
www.theneuron.ai/newsletter/how-to-fine-tune-gpt-4o

Get the latest AI

email graphics

right in

email inbox graphics

Your Inbox

Join 450,000+ professionals from top companies like Disney, Apple and Tesla. 100% Free.