-
Notifications
You must be signed in to change notification settings - Fork 234
UI: LLM health status widget in dashboard #322
Copy link
Copy link
Open
Labels
ai-friendlyWell-documented task suitable for AI-assisted developmentWell-documented task suitable for AI-assisted developmentarea:observabilityLogging, monitoring, notesLogging, monitoring, notesarea:web-uiReact web UI functionalityReact web UI functionalityenhancementNew feature or requestNew feature or requesthelp wantedExtra attention is neededExtra attention is needed
Milestone
Metadata
Metadata
Assignees
Labels
ai-friendlyWell-documented task suitable for AI-assisted developmentWell-documented task suitable for AI-assisted developmentarea:observabilityLogging, monitoring, notesLogging, monitoring, notesarea:web-uiReact web UI functionalityReact web UI functionalityenhancementNew feature or requestNew feature or requesthelp wantedExtra attention is neededExtra attention is needed
Ref #316, #319
The backend now exposes
GET /api/ui/v1/llm/healthwhich returns circuit breaker state for all configured LLM endpoints. This data isn't surfaced in the UI yet.What to add:
API response shape:
{ "enabled": true, "healthy": false, "endpoints": [{ "name": "litellm", "circuit_state": "open", "healthy": false, "consecutive_failures": 3, "last_error": "unhealthy status code: 500", "last_success": "2026-03-31T17:17:57Z" }] }This was a key complaint in #316 — no way to tell if the LLM backend was the problem.