LLM Reliability and Evaluation Platform (CI/CD Incident Analysis)

A production-style platform to version prompts, run golden-set evaluations, detect regressions, and monitor quality, cost, and latency for LLM-powered features.

Demo domain: CI/CD and incident analysis (log summarization, root-cause extraction, and next steps).

Tech Stack (planned)

• Backend: FastAPI + SQLModel + Postgres
• Frontend: React + TypeScript (Vite)
• Local Dev: Docker Compose
• CI: GitHub Actions

Status

Bootstrapping the project. Repo scaffold and health checks next.