Developers
Inference
An OpenAI-compatible API for open-weight models inside trusted execution environments (TEEs), verified before every call.
Thinkr Inference is an OpenAI-compatible API for the open-weight models of the private lane. The SDK verifies the enclave's remote attestation, then encrypts each request to it, so every server on the way sees only ciphertext.
Inference opens to developers from its waitlist.
Features
Requests and responses follow the OpenAI API, streaming included, so existing code moves over with a new client.
The SDK verifies the enclave's remote attestation against its published measurement, and sends nothing if the verification fails.
Each request is encrypted with Hybrid Public Key Encryption (HPKE) to a key that only the enclave holds.
With tool calling, models call your functions and APIs, so agents and workflows run on private inference too.
Vision models read the images and screenshots that you send.
Structured outputs return JSON that follows your schema.
What protects each request
| Part | Value |
|---|---|
| API | OpenAI-compatible |
| Encryption | HPKE, RFC 9180 |
| Cipher | AES-256-GCM |
| CPU | AMD SEV-SNP · Intel TDX |
| GPU | NVIDIA, confidential computing |
| Verification | Remote attestation |
| Verified by | The SDK |
| Failed verification | Nothing sent |
| Thinkr sees | Ciphertext |
Verification explains each step that the SDK takes.
Models
Every model of the private lane.
| Model | Maker | Context | About |
|---|---|---|---|
| GPT-OSS 120B | OpenAI | 131K | OpenAI's open-weight reasoning model, quick and light. |
| DeepSeek V4.1 Flash | DeepSeek | 524K | DeepSeek's fast open-weight model, with a long context. |
| Kimi K3 | Moonshot AI | 262K | Moonshot AI's largest open-weight model, for hard reasoning, code, and long tasks. |
| GLM-5.3 | Z.ai | 524K | Z.ai's open-weight flagship for coding and long, multi-step work. |
| Gemma 4 31B | 262K | Google's open-weight model for everyday tasks. | |
| Llama 3.3 70B | Meta | 131K | Meta's open-weight model for fast chat in many languages. |