Observability Case Study on Honeycomb Implementation

This case study details the implementation of Honeycomb at Outreach, a sales engagement platform. The document outlines the challenges faced by the Outreach engineering team in managing production issues due to an overwhelming volume of log entries generated from HTTP requests. Initially relying on Elasticsearch for log querying, the team found this method unmanageable as customer adoption increased. To address performance bottlenecks, they sought a metrics-based approach that allowed for user-specific performance analysis. The study describes how the team evaluated Honeycomb against Jaeger, ultimately choosing Honeycomb for its superior user experience. It also discusses the cultural shift within the engineering team towards service ownership and observability, highlighting the importance of internal training sessions. Furthermore, the case study mentions the adoption of Service Level Objectives (SLOs) using Honeycomb, emphasizing the thoughtful consideration of Service Level Indicators (SLIs) over extended time frames. The document serves as a comprehensive account of Outreach's journey towards enhanced observability and performance optimization.