LLMxRay is listed as Open Source. Check https://github.com/LogneBudo/llmxray for the current plan limits, as vendors change pricing frequently.

LLMxRay

Q: What is LLMxRay?

LLMxRay is a code AI tool listed on Use AI Tools. LLMxRay is a local observability interface for the models you run through Ollama. One command opens a browser tab with token-by-token streaming, cache diagnostics, model comparison, benchmarks and cost tracking, alongside chat, reasoning, RAG and introspection views.

Q: What is LLMxRay best for?

LLMxRay is commonly used for Ollama users, Debugging local models, Cache and cost diagnostics. It supports English.

Code🔥 Intermediate✅ Global access

Ollama usersDebugging local modelsCache and cost diagnostics

Open SourceEnglish

LLMxRay is a local observability interface for the models you run through Ollama. One command opens a browser tab with token-by-token streaming, cache diagnostics, model comparison, benchmarks and cost tracking, alongside chat, reasoning, RAG and introspection views.

Visit Website Compare

Community Rating

Be the first to rate LLMxRay. Your feedback helps other users decide.

🎯 Real-World Use Cases

Watch a Stream Token by Token

Inspect generation as it happens rather than after

Compare Local Models

Run benchmarks across the models you host

Diagnose Cache Behaviour

See prompt cache diagnostics for each request

⚖️ Honest Review

✅ Pros

+One command to a full dashboard
+Covers chat, reasoning, RAG and metrics in one interface
+Also exposed as an MCP server

⚠️ Cons

−Built around Ollama specifically
−Small project with a deliberately narrow scope

📚

Guides and comparisons about code tools

Local inference running on consumer hardware

CodeOct 18, 2026