Backend Integration Tickets
Distributed Tracing
JIRA-DEVOPS-001: Implement OpenTelemetry Distributed Tracing
Description: Implement a tracing mechanism so all the calls from the backend all the way to the HAE are being traced with the OpenTelemetry trace ID being pushed to GCP.
Tasks:
- Integrate OpenTelemetry in backend services
- Add tracing to HAE service
- Configure trace export to GCP
- Implement trace ID propagation
- Create trace analysis dashboards
- Add trace-based alerting
Queue System
JIRA-DEVOPS-002: Design Queue Architecture
Description: Design queuing system for handling high load and failed requests with user visibility. When system load is high or errors occur, users receive little feedback and failed requests require manual intervention.
Tasks:
- Select queue technology (Redis, RabbitMQ, SQS)
- Design message schema
- Define retry policies and dead letter queues
- Create monitoring strategy
JIRA-DEVOPS-003: Implement Backend Queue System
Description: Build queuing infrastructure to handle request processing, automatic retries for transient failures, and reprocessing when necessary.
Tasks:
- Set up queue infrastructure
- Implement producer/consumer logic
- Add retry and error handling
- Create monitoring and alerting
- Support reprocessing for failed jobs
JIRA-DEVOPS-004: Build Queue UI Components
Description: Create user-facing queue status displays so users are notified when requests are queued and can view request status.
Tasks:
- Design queue status UI
- Implement real-time status updates
- Add queue position indicator
- Create retry/cancel controls
- Integrate user notifications
Health Monitoring
JIRA-DEVOPS-005: Implement Comprehensive Health Check System
Description: Implement a full health check monitoring system for everything - database, pub/sub, emailing, logging. Currently there's no unified way to verify operational status.
Tasks:
- Create /health endpoints for all services
- Add database connectivity checks
- Implement pub/sub health validation
- Add email service health checks
- Create logging system health checks
- Build centralized health dashboard
- Implement health-based alerting
Mobile Line Detection
JIRA-DEVOPS-006: Implement Mobile Line Detection
Description: Offload image line detection to mobile for faster feedback. Currently all line detection is on backend (HAE), leading to erroneous images without control/test lines being sent.
Tasks:
- Create webcam-based prototype
- Port TensorFlow model to mobile via TensorFlow JS
- Implement on-device detection algorithm
- Add immediate visual feedback UI
- Create backend fallback when mobile detection fails