Open Source Summit Japan

Debugging and monitoring standalone applications used to be solved, but at scale there is a huge complexity involved that affects log management and data analysis: multiple applications generating data from different sources and formats at high rates.

The following presentation will dig into the complexity of log management at scale, the internals phases of a logging pipeline, constrains in containers and approaches that can be used to have a scalable logging layer in a Kubernetes cluster through the implementation of Log Forwarders and Log Aggregators.