Capabilities & Performance
- SOTA MTEB retrieval performance
- Ultra-low cost at $0.057/M tokens down to $0.043/M wholesale
Dense semantic vector embedding model with high retrieval accuracy for enterprise RAG and semantic search.
Params
8B Dense
Context
32K
Max Output
4096 dim
| Lane | Public Rate | Cached |
|---|---|---|
| Realtime API | $0.057 / $0.000 | N/A |
| Batch Queue | Batch rates available on rollout | N/A |
Prices per 1M tokens. Cached prompt rate applies on prefix hits.
from openai import OpenAI
client = OpenAI(
base_url="https://api.batchin.tech/v1",
api_key="BATCHIN_API_KEY"
)
resp = client.chat.completions.create(
model="qwen3-embedding-8b",
messages=[{"role": "user", "content": "Benchmark system architecture performance and cost profile."}]
)
print(resp.choices[0].message.content)import OpenAI from "openai";
const client = new OpenAI({
baseURL: "https://api.batchin.tech/v1",
apiKey: process.env.BATCHIN_API_KEY,
});
const resp = await client.chat.completions.create({
model: "qwen3-embedding-8b",
messages: [{ role: "user", content: "Benchmark system architecture performance and cost profile." }],
});
console.log(resp.choices[0]?.message?.content);curl https://api.batchin.tech/v1/chat/completions \
-H "Authorization: Bearer $BATCHIN_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "qwen3-embedding-8b",
"messages": [{"role":"user","content":"Benchmark system architecture performance and cost profile."}]
}'Alibaba flagship reasoning model with native 1M context window and state-of-the-art benchmark capabilities.
DeepSeek next-gen MoE reasoning flagship for complex architectural design, autonomous coding loops, and math proofs.
High-throughput, ultra-low latency DeepSeek model optimized for rapid tool calls and high-frequency agent loops.