TokenizerHub
Input
GPT-3.5 Turbo
Tokens
50
Context
0.31%
Remaining
16K
Tokens
cl100k<|im_start|>system
You are a helpful assistant<|im_end|>
<|im_start|>user
Tokens are the in-game currency of this world.<|im_end|>
<|im_start|>assistant
Token ids
50 total
27913185011912991251982675527264111901832827913186345913972791318501191298821983040052727930419959116673154201917161349131863459139727913185011912978191198
Compare
| Model | Tokens | Context |
|---|---|---|
| GPT-4.1 | 50 | 0.00% |
| GPT-4 | 50 | 0.61% |
| GPT-3.5 Turbo | 50 | 0.31% |