New gpt-4o-audio-preview models

[simonw]

Released today: https://openai.com/index/o1-and-new-tools-for-developers/

gpt-4o-audio-preview-2024-10-01 is a new alias for the old model.

gpt-4o-audio-preview-2024-12-17 is a new model with reduced audio token costs.

gpt-4o-audio-preview still currently points to the older, more expensive model but they may update that in the future.

[simonw]

Pricing: https://openai.com/api/pricing/

gpt-4o-audio-preview

• Text
  • Input: $2.50 / 1M tokens
  • Output: $10.00 / 1M tokens
• Audio
  • Input: $100.00 / 1M tokens
  • Output: $200.00 / 1M tokens

gpt-4o-audio-preview-2024-12-17

• Text
  • Input: $2.50 / 1M tokens
  • Output: $10.00 / 1M tokens
• Audio
  • Input: $40.00 / 1M tokens
  • Output: $80.00 / 1M tokens

gpt-4o-audio-preview-2024-10-01

• Text
  • Input: $2.50 / 1M tokens
  • Output: $10.00 / 1M tokens
• Audio
  • Input: $100.00 / 1M tokens
  • Output: $200.00 / 1M tokens

[simonw]

Testing these:

llm -m gpt-4o-audio-preview -a https://static.simonwillison.net/static/2024/pelican-joke-request.mp3
llm -m gpt-4o-audio-preview-2024-10-01 -a https://static.simonwillison.net/static/2024/pelican-joke-request.mp3
llm -m gpt-4o-audio-preview-2024-12-17 -a https://static.simonwillison.net/static/2024/pelican-joke-request.mp3
llm logs -n 3 -u

Output:

---

2024-12-17T19:16:22 conversation: 01jfb0spnx30539577eamvbk2k

Model: gpt-4o-audio-preview

Prompt:

None

Attachments

1. audio/mpeg: https://static.simonwillison.net/static/2024/pelican-joke-request.mp3

Response:

Why don't pelicans carry smartphones? Because they'd always be "winging" it with their "bill"!

Token usage:

55 input, 21 output, {"prompt_tokens_details": {"audio_tokens": 44}}

2024-12-17T19:16:29 conversation: 01jfb0swy3h33xresn4wjxebwa

Model: gpt-4o-audio-preview-2024-10-01

Prompt:

None

Attachments

1. audio/mpeg: https://static.simonwillison.net/static/2024/pelican-joke-request.mp3

Response:

Why did the pelican get kicked out of the restaurant? Because he had a very big bill!

Token usage:

55 input, 20 output, {"prompt_tokens_details": {"audio_tokens": 44}}

2024-12-17T19:16:35 conversation: 01jfb0t2pj3a7p5z6cypa3vw7r

Model: gpt-4o-audio-preview-2024-12-17

Prompt:

None

Attachments

1. audio/mpeg: https://static.simonwillison.net/static/2024/pelican-joke-request.mp3

Response:

Why did the pelican refuse to play cards at the beach? Because he was worried about too many cheeps and pecks!

Token usage:

55 input, 26 output, {"prompt_tokens_details": {"audio_tokens": 44}}

[simonw]

The mini ones are available too now.

[simonw]

llm -m gpt-4o-mini-audio-preview -a pelican-joke-request.mp3
llm -m gpt-4o-mini-audio-preview-2024-12-17 -a pelican-joke-request.mp3
llm logs -n 2 -u

Output:

---

2024-12-18T04:25:58 conversation: 01jfc0819emhfvqbv6k7n82n62

Model: gpt-4o-mini-audio-preview

Prompt:

None

Attachments

1. audio/mpeg: /Users/simon/Dropbox/Development/llm/pelican-joke-request.mp3

Response:

Sure! Here you go: Why do pelicans never invite other birds to their parties? Because they always have too big a bill to pay!

Token usage:

55 input, 29 output, {"prompt_tokens_details": {"audio_tokens": 44}}

2024-12-18T04:26:14 conversation: 01jfc08gd69fn74zk3cmtpg8qb

Model: gpt-4o-mini-audio-preview-2024-12-17

Prompt:

None

Attachments

1. audio/mpeg: /Users/simon/Dropbox/Development/llm/pelican-joke-request.mp3

Response:

Sure, here's a joke about a pelican:

A man walked into a restaurant with a large pelican perched on his shoulder. The waiter looked at the pelican and said, "Wow, that's amazing! Where did you get him?"

The pelican replied, "I got him at the pet store. They have tons of them, but this one was the smartest of the bunch!"

Token usage:

55 input, 79 output, {"prompt_tokens_details": {"audio_tokens": 44}}