Model detail
gpt-3.5-turbo-16k
This model offers four times the context length of gpt-3.5-turbo, allowing it to support approximately 20 pages of text in a single request at a higher cost. Training data: up to Sep 2021.
Model specs
- Context length
- 16.385K
- Max output
- 4.096K
- I/O modalities
- Text
- Released
- 2023-08
02
API endpoints
One MixRoute gateway, OpenAI-compatible
-
OpenAI-compatible
/v1/chat/completionsPOST
03
Pricing
Flat rate, unit: /1M Tokens
Input
$3.0000 /1M Tokens
Completion
$6.0000 /1M Tokens
05
Selection summary
Quickly judge whether it fits your workload
What is this model good for?
GPT-3.5 Turbo with extended 16K context
Use gpt-3.5-turbo-16k for tasks requiring longer context, supporting approximately 20 pages of text in a single request. It offers four times the context length of standard GPT-3.5 Turbo.
What should you check before using it?
Consider newer models with larger context windows
Newer models offer significantly larger context windows (up to 1M tokens). Test your long-context tasks to determine if this 16K variant still meets your needs.
Why use it through MixRoute?
Use the OpenAI-compatible endpoint with stable model ID
Use the confirmed compatible endpoint with model ID gpt-3.5-turbo-16k through MixRoute.
08
Token cost estimator
Live estimate from this page's pricing, not an actual bill
This model has no cache-read price; caching is not counted
09
FAQ
gpt-3.5-turbo-16k is a variant of GPT-3.5 Turbo with four times the context length, supporting approximately 20 pages of text in a single request.
One endpoint, a testable decision
Test this model and alternate routes with the same request format
Start from a real workload, then let quality, total cost, and failure conditions decide whether to send production traffic.