Loading…
This event has ended. View the official site or create your own event → Check it out
This event has ended. Create your own
Learn more about Open Source Summit Japan and register here
View analytic
Wednesday, May 31 • 11:00 - 11:40
10 Million Smart Meter Data with Apache HBase - Masahiro Ito, Hitachi, Ltd.

Sign up or log in to save this to your schedule and see who's attending!

Feedback form is now closed.
In recent years, IoT (Internet of Things) has become a trend, and various sensor devices generate large amounts of data. HBase is one of the data stores for managing such big data. We evaluated the performance of HBase for managing the power consumption data collected from 10 million smart meters. With this test, we got the following results.
  1. HBase showed high data insert performance by processing at least 64 requests in parallel. 
  2. The acquisition request for time series data showed more than 35 times percormance compared with non - time series data. 
  3. By choosing an appropriate compression algorithm, the storage size of time series data could be compressed to 1/5. 
From these results, we confirmed that HBase is suitable for storing and referring data generated by many sensors. In this session, I will introduce various know-how gained through the performance test.

Speakers
MI

Masahiro Ito

Software Engineer, Hitachi, Ltd.
Masahiro Ito has been working on development of Big Data Solution with Apache Hadoop and its related OSS for 3 years. He is working on offering and co-creating progressive Hadoop solutions to customers who are going to build enterprise system. He is currently focusing on Apache H... Read More →


Wednesday May 31, 2017 11:00 - 11:40
Restaurant Carnelian

Attendees (30)