How do you start calling GPT-3.5 Turbo?

Use the model ID gpt-3.5-turbo through the OpenAI-compatible chat completions endpoint. It is optimized for chat and traditional completions.

Can you call GPT-3.5 Turbo with the OpenAI SDK you already use?

Yes. GPT-3.5 Turbo is served through an OpenAI-compatible endpoint. You can continue using your existing SDK.

What is the rate limit for gpt-3.5-turbo?

gpt-3.5-turbo rate limits vary by your MixRoute subscription plan. Check your plan details in the console for requests per minute (RPM) and tokens per minute (TPM) limits. Run a small load test before production to confirm your effective quota.

When was GPT-3.5 Turbo released, and is it still maintained?

GPT-3.5 Turbo was released on 2023-05-28. Its catalog status is stable. Check the model page for deprecation notices before you build a long-lived integration on it.

Does gpt-3.5-turbo have a free tier?

GPT-3.5 Turbo is billed per use and the record publishes no free-tier allowance. The current published rates are input $0.5000 per 1M tokens and output $1.0000 per 1M tokens. Trial credit or promotional quota is tied to your account rather than to the model, so check the console before planning around a free tier.

How do you get a cache hit on gpt-3.5-turbo?

The current GPT-3.5 Turbo listing publishes no cache-read rate, so cached-prefix billing is not part of its pricing. Treat repeated prefixes as fresh input when you size the workload, and confirm with the provider before designing for a cache saving.

How should you set the output budget for gpt-3.5-turbo?

For gpt-3.5-turbo, set the max_tokens or max_completion_tokens parameter to control spending per call. Start with a budget aligned to your typical response length and increase only when longer outputs are genuinely needed. Monitor token usage in the API response headers to tune your budget over time.

Model detail

GPT-3.5 Turbo

Provided by OpenAI

Pay-as-you-go

GPT-3.5 Turbo is OpenAI's fastest model. It can understand and generate natural language or code, and is optimized for chat and traditional completion tasks. Training data up to Sep 2021.

Model specs

Model ID: gpt-3.5-turbo

Context length: 16.385K
Max output: 4.096K
I/O modalities
Released: 2023-05

API endpoints

One MixRoute gateway, OpenAI-compatible

OpenAI-compatible /v1/chat/completions POST

Pricing

Flat rate, unit: /1M Tokens

Input

$0.5000 /1M Tokens

Completion

$1.0000 /1M Tokens

Selection summary

Quickly judge whether it fits your workload

What is this model good for?

Fast, cost-effective chat and traditional completions

Use GPT-3.5 Turbo for chat and traditional completion tasks where speed and cost are prioritized over maximum accuracy. It is OpenAI's fastest model.

What should you check before using it?

Consider GPT-4o Mini for better performance

GPT-4o Mini offers significantly better intelligence at a comparable cost. Test your tasks to determine if GPT-3.5 Turbo still meets your needs. Knowledge cutoff: 2021-09-01.

Why use it through MixRoute?

GPT-3.5 Turbo runs tools and structured output here

Tool calling and structured output run on that route as well. MixRoute serves GPT-3.5 Turbo on the OpenAI-compatible endpoint /v1/chat/completions; point your existing client at https://api.mixroute.ai/v1 with the model ID gpt-3.5-turbo and re-run your integration tests.

Capabilities & compatibility

Unconfirmed capabilities stay "Unknown," no guesses

Structured output

GPT-3.5 Turbo can produce JSON-formatted output on demand.

EX response_format: { type: "json_schema" } forces valid JSON output.

Streaming

GPT-3.5 Turbo supports streamed responses.

EX stream: true streams tokens incrementally, so chat UIs render as they arrive.

OpenAI SDK

Call GPT-3.5 Turbo through MixRoute's OpenAI-compatible endpoint.

EX Change base_url to https://api.mixroute.ai/v1; everything else follows the OpenAI style.

Token cost estimator

Live estimate from this page's pricing, not an actual bill

Input tokens Max per request 16.385K

Output tokens Max per request 4.096K

Requests / month

Cache hit rate –

This model has no cache-read price; caching is not counted

FAQ

GPT-3.5 Turbo is OpenAI’s fastest model, optimized for chat and traditional completion tasks. It can understand and generate natural language or code.

Get started

01

Create an API key

Generate a key in the Console; one key calls every model.
02

Set the base URL

Fully OpenAI SDK-compatible; just swap the URL to connect.

https://api.mixroute.ai/v1
03

Specify the model ID

In the request's model field, enter:

gpt-3.5-turbo

Create an API key

New users get $5 in free credits

Test this model and alternate routes with the same request format

Start from a real workload, then let quality, total cost, and failure conditions decide whether to send production traffic.

Create an API key View integration docs