Learn more about Open Source Summit Japan and register here
Back To Schedule
Wednesday, May 31 • 11:00 - 11:40
10 Million Smart Meter Data with Apache HBase - Masahiro Ito, Hitachi, Ltd.

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
In recent years, IoT (Internet of Things) has become a trend, and various sensor devices generate large amounts of data. HBase is one of the data stores for managing such big data. We evaluated the performance of HBase for managing the power consumption data collected from 10 million smart meters. With this test, we got the following results.
  1. HBase showed high data insert performance by processing at least 64 requests in parallel. 
  2. The acquisition request for time series data showed more than 35 times percormance compared with non - time series data. 
  3. By choosing an appropriate compression algorithm, the storage size of time series data could be compressed to 1/5. 
From these results, we confirmed that HBase is suitable for storing and referring data generated by many sensors. In this session, I will introduce various know-how gained through the performance test.


Masahiro Ito

Software Engineer, Hitachi, Ltd.
Masahiro Ito has been working on development of Big Data Solution with Apache Hadoop and its related OSS for 3 years. He is working on offering and co-creating progressive Hadoop solutions to customers who are going to build enterprise system. He is currently focusing on Apache Hadoop... Read More →

Wednesday May 31, 2017 11:00 - 11:40 JST
Restaurant Carnelian
  Conference Session