Skip to content

feat: RAG pipeline analytics#3

Merged
jaikoo merged 1 commit into
mainfrom
feat/rag-pipeline-visibility
Feb 17, 2026
Merged

feat: RAG pipeline analytics#3
jaikoo merged 1 commit into
mainfrom
feat/rag-pipeline-visibility

Conversation

@jaikoo
Copy link
Copy Markdown
Owner

@jaikoo jaikoo commented Feb 17, 2026

Summary

  • Adds GET /v1/llm/rag endpoint for RAG pipeline analytics over retrieval span metadata (rag.* convention)
  • New dashboard RAG tab with stat cards (total retrievals, avg relevance, context utilization), source table with latency percentiles, and relevance distribution bar
  • Trace detail view shows inline RAG metadata on retrieval spans
  • Migration 021 adds span_type index for efficient retrieval span filtering
  • 3 new integration tests, E2E seed data with RAG trace, and spec updates

Test plan

  • cargo test --features llm-tracing — 153 tests pass (48 LLM tracing including 3 new RAG tests)
  • Manual: ingest trace with rag.* metadata, verify /v1/llm/rag returns populated response
  • Manual: dashboard RAG tab renders stat cards and source table
  • E2E: RAG tab appears in tab list and renders content

Add /v1/llm/rag endpoint with DuckDB queries over rag.* metadata on
retrieval spans. Dashboard gets a RAG tab with stat cards (total
retrievals, avg relevance, context utilization), source table with
latency percentiles, and relevance distribution. Trace detail view
shows RAG metadata inline on retrieval spans.

- Migration 021: span_type index for efficient retrieval span filtering
- 3 DuckDB SQL queries: overview, hourly metrics, relevance summary
- Uses json_extract with quoted key notation for dot-containing keys
- 3 new integration tests + E2E seed data and spec updates
@jaikoo jaikoo merged commit 9475bf5 into main Feb 17, 2026
9 checks passed
@jaikoo jaikoo deleted the feat/rag-pipeline-visibility branch February 26, 2026 16:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant