Open Source Summit Japan

The OpenStack CI system processes hundreds of patches a day. All the test jobs generate considerable amounts of logs and test results. The OpenStack community has developed tools and infrastructure to enable CI at scale, and simplify analysis of test results. Elastic-recheck for instance can identify some failures automatically based on a known signature. Finding the right signatures may require a considerate amount of experience and time. Andrea will briefly present what data OpenStack collects from test runs, what tools are available to analyse it, and some of the challenges of testing at this scale. Andrea will dive into the issue of dealing with large amounts of test data: what new knowledge could be extracted from them; he will describe his experience with techniques to make the most relevant information emerge, to help developers in their work, and keep CI running smoothly.