ReadyGPU TEE

Qwen2.5 7B Instruct

Model IDqwen/qwen-2.5-7b-instructModel weights

Qwen2.5 7B is the latest series of Qwen large language models. Qwen2.5 brings the following improvements upon Qwen2: - Significantly more knowledge and has greatly improved capabilities in coding and mathematics, thanks to our specialized expert models in these domains. - Significant improvements in instruction following, generating long texts (over 8K tokens), understanding structured data (e.g, tables), and generating structured outputs especially JSON. More resilient to the diversity of system prompts, enhancing role-play implementation and condition-setting for chatbots. - Long-context Support up to 128K tokens and can generate up to 8K tokens. - Multilingual support for over 29 languages, including Chinese, English, French, Spanish, Portuguese, German, Italian, Russian, Japanese, Korean, Vietnamese, Thai, Arabic, and more. Usage of this model is subject to [Tongyi Qianwen LICENSE AGREEMENT](https://huggingface.co/Qwen/Qwen1.5-110B-Chat/blob/main/LICENSE).

Start building Docs

input

$0.10/M

output

$0.20/M

context

33K

created

Oct 3, 2025

Supported API shape

input

text

output

text

max output tokens

32,768

tools

Supported

json mode

Not listed

Verification

Available evidence. Use a verified client to authenticate the quote, connection, and receipt.

Verify private inference

receipt

signed receipt + hashes

attestation

gateway report

session

attested upstream

serving provider

read from receipt session

Provider

Phala

GPU TEE

input

$0.10/M

output

$0.20/M

context

33K

Performance comparison

Last 72h · UTC

$ pip install openai

1from openai import OpenAI
2import os
3
4MODEL = "qwen/qwen-2.5-7b-instruct"
5
6client = OpenAI(
7    base_url="https://inference.phala.com/v1",
8    api_key=os.environ["PHALA_AI_API_KEY"],
9)
10
11response = client.chat.completions.create(
12    model=MODEL,
13    messages=[{"role": "user", "content": "Run this privately."}],
14)
15
16print(response.id)
17print(response.choices[0].message.content)

$ npm install openai

1import OpenAI from "openai"
2
3const MODEL = "qwen/qwen-2.5-7b-instruct"
4
5const openai = new OpenAI({
6  baseURL: "https://inference.phala.com/v1",
7  apiKey: process.env.PHALA_AI_API_KEY,
8})
9
10const response = await openai.chat.completions.create({
11  model: MODEL,
12  messages: [{ role: "user", content: "Run this privately." }],
13})
14
15console.log(response.id)
16console.log(response.choices[0].message.content)

1curl https://inference.phala.com/v1/chat/completions \
2  -H "Authorization: Bearer $PHALA_AI_API_KEY" \
3  -H "Content-Type: application/json" \
4  -d '{
5    "model": "qwen/qwen-2.5-7b-instruct",
6    "messages": [
7      { "role": "user", "content": "Run this privately." }
8    ]
9  }'

More models

Other private inference routes.

View catalog

encrypted

Jared Palmer: Kev 4B

Kev 4B is an open-weight System One model from Jared Palmer, fine-tuned from Qwen3.5 4B Base. It makes fast, structured decisions for software: given a state and typed questions, it returns calibrated answers instead of text, as a yes/no probability (noul), a pick among options (choice), or a level on a scale (score). Call it through POST /v1/systemone, compatible with the TypeSafe SDK; it does not serve chat. Served on Phala in a TDX-attested enclave with an 8,192-token context.

context

input

$0.042/M

encrypted

Phala: Qwen3.8 27B Uncensored (Aggressive)

HauhauCS Qwen3.8-27B Uncensored Aggressive, using the pinned Q8_K_P GGUF and BF16 vision projector. Served with SGLang on a Phala TDX-attested H200, with text and image input and a 262144-token context.

context

262K

input

$0.30/M

$0.05/M cache read

encrypted

Qwen: Qwen3.8 27B

Qwen3.8 27B is an open-weight dense vision-language model from Qwen. It is suited for coding, professional workflows, research, multimodal interaction, and long-running agent tasks, with flexible thinking that can be enabled or disabled. Served on Phala in a TDX-attested enclave.

context

input

$0.20/M

$0.05/M cache read

encrypted

Phala: Gemma-4 26B-A4B Uncensored (Heretic)

Uncensored "Heretic" variant of google/gemma-4-26B-A4B-it created using Heretic v1.2.0 with the Arbitrary-Rank Ablation (ARA) method and row-norm preservation. Refusals drop from 100/100 to 11/100 with KL divergence 0.0499 vs the base model. The base Gemma 4 26B A4B is a Mixture-of-Experts model with 25.2B total / 3.8B active parameters (8 active / 128 total experts), 30-layer transformer with hybrid local sliding (1024) + global attention, supporting a 256K context window. Natively multimodal (text + images, variable aspect ratios). Strong on coding, reasoning, function calling, with native system prompt support across 35+ languages. Served on Phala in TDX-attested H200 enclave with end-to-end ECDSA response signing; vLLM-compatible FP8-Static quantization by cloud19 (router excluded from quantization).

context

262K

input

$0.15/M

$0.05/M cache read