Learn more about Open Source Summit Japan and register here
Back To Schedule
Thursday, June 1 • 14:50 - 15:30
Parallelizing CI Using Docker Swarm-Mode - Akihiro Suda, NTT Corporation

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
Slowness of CI is a critical issue in software development, because it discourages engineers from writing tests, and hence deteriorates the quality of the product.

In this presentation, Akihiro Suda will talk about how to accelerate CI by executing test functions in parallel, across a Docker Swarm-mode cluster.
One of the major challenges was the nonuniformity of the makespan. e.g. some chunk of test functions can take 30 minutes, some chunk can take just 10 seconds...
So, he mitigates such a nonuniformity by randomizing the composition of chunks of test functions.

As a result, for example, the integration test of Docker itself that had taken more than 80 minutes can be finished in 4 minutes, with 10 Docker Swarm-mode nodes.
This hack can be easily applied to CI of other software as well.

avatar for Akihiro Suda

Akihiro Suda

Software Engineer, NTT Corporation
Akihiro Suda is a software engineer at NTT Corporation, a Japan-based telecommunication company. He has been a maintainer of several opensource container software such as Moby, BuildKit, containerd, runc, and Lima. He has previously talked at several FLOSS conferences such as KubeCon... Read More →

Thursday June 1, 2017 14:50 - 15:30 JST
Room 6