EPIC: Observability and Metrics

[justinthelaw]

Description

Define and implement strategies for logging and log aggregation, usage and resource metric production and consumption, and automated scaling so that we can productionize LeapfrogAI components.

Use the UDS Package CR to enable integration with UDS services:

• Grafana - Monitoring
• Loki - Log Aggregation
• Metrics Server - Metrics
• Prometheus Stack - Monitoring
• Promtail - Log Aggregation

Acceptance Criteria

The following issues must be closed or completed in order to complete this EPIC:

Tasks:

Preview Give feedback

1. spike: observability metrics list and rationale #1017
   enhancement +1
2. feat: LeapfrogAI and UDS Prometheus Integration #1018
   enhancement +1
   
3. feat: logger profiles for development, staging and production environments #1019
   enhancement +1
4. feat: create metrics endpoints for each service #1020
   enhancement +1
5. feat: Kubernetes metrics-server integration and usage #1021
   enhancement +1
6. feat: Grafana default dashboard construction and docs #1022
   enhancement +1
7. chore: add load tests to pipeline #798
   chore +1
   

Additional Context

Potential Blockers

The following is a running list of other EPICs and/or issues that are potential blockers that could slowdown and/or disrupt the progress of this EPIC:

• ADR: Bitnami Supabase deprecation continuation #968

Dependent Issues

The following is a running list of other EPICs and/or issues that are dependent on the full or partial closure of issues in this EPIC:

• EPIC: Made for UDS #727

LeapfrogAI Cluster Components

1. LeapfrogAI API
2. Supabase Operator¹
   • Supabase-Meta
   • Supabase-Auth
   • Supabase-Kong
   • Supabase-Rest
   • Supabase-Realtime
   • Supabase-Storage
   • Supabase-Studio
3. Migrations
4. LeapfrogAI UI
5. vLLM backend
6. LLaMA-CPP-Python backend
7. Text-Embeddings backend
8. Whisper backend

Footnotes

1. Depends on Supabase ADR determinations ADR: Bitnami Supabase deprecation continuation #968 ↩