F1: OpenTelemetry OTLP Collector & Ingest Buffer

Overview

Accepts OpenTelemetry-compliant trace telemetry over HTTP/JSON and Protobuf. Implements a bounded in-memory buffer with async worker flushing, backpressure rejection (HTTP 429), and strict PII attribute redaction.

---

Technical Flow & Architectural Traces

Edge Cases & Failure Handling

• Network Timeouts: Requests automatically retry with exponential backoff and jitter.
• Malformed Spans: Dropped and recorded in dead-letter counters without halting valid span batches.
• Memory Pressure: Dynamic backpressure returns HTTP 429 when buffer capacity exceeds 90%.

---

Say It Out Loud

"For this feature, I implemented an asynchronous pipeline that balances high throughput with data safety. Spans are validated, buffered in memory, and flushed in batches, ensuring that upstream microservices experience minimal latency while downstream analytics receive complete, uncorrupted telemetry."