CostTrim
ComparisonUpdated for Inline Auto-Optimization
CostTrim vs Portkey
If you're evaluating Portkey and want a lighter-weight gateway that optimizes cost automatically out of the box rather than through hand-configured routing rules, here's what CostTrim specifically adds.
Portkey is a real, established tool focused on AI gateway — multi-provider routing, fallbacks, and config-driven load balancing. This page compares it to CostTrim on the specific features below — verify current pricing and feature details on Portkey's own site, since those change over time and this page doesn't track them live.
At a glance
| Feature | CostTrim | Portkey |
|---|---|---|
| Logs cost, tokens, latency per request | Yes | Yes |
| Actively reduces cost (not just reports it) | Yes — Auto-Optimization Proxy | No |
| Hard spend kill-switch before the call goes out | Yes — Auto-Block | Varies |
| Free tier, no card required | Yes | Varies |
| No-code embeddable chat widget | Yes | No |
| Per-client reseller billing / markup | Yes | No |
Portkey column reflects its core, generally-available offering as of this writing — verify current specifics on their site, since both products evolve.
What CostTrim adds
✓
Inline Auto-Optimization Proxy
The one thing pure observability tools structurally can't do: CostTrim actively rewrites outgoing requests before they hit the provider — trims verbose system prompts and silently reroutes short classification-style calls to a cheaper same-family model (gpt-4o → gpt-4o-mini). On by default, one click to disable per workspace.
✓
Real-time budget Kill-Switch (Auto-Block)
Rejects requests with a 429 the instant a user or workspace crosses a spend threshold — before the upstream provider is even called, so the overage never happens.
✓
Live token-saving suggestions
Dashboard → Insights refreshes in real time after every request: free rule-based heuristics for every workspace, plus an actual Claude Haiku review of your costliest prompts on paid plans.
✓
Reseller / per-client billing
Run one Chat Widget per client with its own markup % — the dashboard shows your real cost next to what to bill them, no multi-account juggling.
✓
5-provider coverage from one proxy
OpenAI, Claude, Groq, DeepSeek, and Llama API all logged to the same dashboard — point your existing SDK's baseURL at CostTrim and nothing else changes.
✓
No-code embeddable chat widget
Paste a provider key into a form, get an <iframe> — fully tracked, no backend required on the embedder's side.
✓
Free to start, no card required
10,000 requests/month on the free tier with full dashboard access — sign up and see your numbers before paying anything.
Frequently asked
Is CostTrim a drop-in replacement for Portkey's gateway?
For the core proxy use case — routing your LLM traffic through a gateway to get cost, token, and latency tracking — yes, same integration pattern. Portkey's config-driven routing rules (fallbacks, load balancing across many keys/providers) are a deeper, more configurable version of routing than CostTrim's built-in Smart Routing, which is intentionally simple and automatic rather than something you hand-configure.
Does CostTrim do prompt caching and cost optimization like Portkey?
Yes — response caching (configurable TTL, served from your own Postgres) and the Inline Auto-Optimization Proxy (system prompt trimming plus automatic redirection of simple classification-style calls to a cheaper same-family model) are both on by default, not an add-on you have to wire up separately.
Is there a free plan?
Yes — 10,000 requests/month with full dashboard access, no card required.
Does CostTrim support the same providers?
OpenAI, Claude (Anthropic), Groq, DeepSeek, and Meta's Llama API — all logged to one dashboard.
See your own LLM cost breakdown in under 5 minutes.