Summary
This whitepaper outlines the deployment of the ELK stack (Elasticsearch, Logstash, Kibana) on Baremetal Kubernetes, specifically focusing on a multi-VRF (Virtual Routing and Forwarding) architecture. The document addresses the challenges organizations face in managing large-scale log aggregation across isolated network boundaries while ensuring security. It details the solution architecture, which utilizes Cilium BGP Control Plane V2 to enable a single Kubernetes cluster to serve multiple VRFs. The paper presents key innovations such as intelligent data tiering for hot and cold storage, full automation of the infrastructure provisioning process, and the performance benefits of using bare metal over cloud environments. Additionally, it discusses the requirements for log ingestion, query performance, and availability, emphasizing the need for a centralized logging service that maintains security isolation. The document concludes with insights into the performance results and business benefits achieved through this deployment.
