llm-analytics

Privacy first toolkit for analyzing your ChatGPT and Claude exports. Model tracking, prompt effectiveness analysis, cost efficiency metrics (POD/DLOD/POE), topic classification, and industry benchmarks. 49 tests. pip installable. Everything runs locally.

Understand how your brand shows up in LLM responses.

OpenTelemetry + Wireshark + Cloudflare for AI Agents. Monitor, inspect, secure, replay, and optimize all traffic between Users, AI Agents, LLMs, and MCP Servers.

Production-grade Modern Data Stack (MDS) pipeline built with Prefect, dbt, and Postgres. Features least-privilege DB hardening, semantic query caching (ChromaDB + OpenAI) for AI analytics, and complete containerization.

Langfuse MCP server with built-in analytics. 34 tools — traces, observations, sessions, scores, prompts, datasets + accuracy metrics, failure detection, token percentiles, cost breakdowns, latency analysis, context breach scanning. Works with Claude Code, Cursor, Codex.

Self-hosted LLM cost analytics & optimization dashboard. Track OpenAI & Anthropic API spend, tokens, and latency with a 3-line Python SDK. Budgets, forecasting, and savings recommendations.

Public metadata for the hosted LLM Pulse MCP server

Local-first analytics tool to track AI coding spend and token costs across Claude Code, Cursor, Copilot, Gemini & 36+ tools.

Intelligent automated data analysis and EDA platform powered by LLMs for exploratory statistical insights.

Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like AI Agent, LLM and tools tracing, debugging multi-agentic system, self-hosted dashboards and advanced analytics with timeline and execution graph view.

Local, single-file HTML dashboard for Claude Code usage and estimated USD cost — token totals across all classes (input/output/cache), per-model spend at list API prices, live current-day data, MCP activity, web research, AI-clustered themes. One uv-runnable Python script.

Selecting the most effective AI strategy for human interaction. Optimizing the advisor agent based on the personality of the interlocutor.

A transparent proxy to allow cost comparisons between locally run LLMs and the higher costs cloud hosted models

playwright reports serving, llm analysis and tracking

Moesif is an API analytics, monitoring, monetization, and governance platform for API and AI product teams. The platform unifies API observability (analytics, logs, metrics, traces via OpenTelemetry), usage-based monetization (billing meters, product catalog, prepaid credits, Stripe integration), quotas and governance (rate limiting, contract…