We are already in the era of ‘connected things’ - our mobile phones, computers, tablets, etc. sync and talk via ‘cloud’. It is not hard to imagine the next wave as more and more devices are connected (cars, thermostats, etc.). This is what is called as ‘Internet of Things’ (IoT).

IoT presents a lots of challenges, especially data coming in at high volume and high velocity. Imagine billions of devices each sending readings every few seconds or minutes. All this data need to be analyzed pretty quickly. Plus we need to think about security, privacy and compliance.

In this talk we will present a reference architecture for IoT. We draw on industry’s best practices on Big Data including Lambda architecture patterns. Lambda architecture outlines generic, scalable and fault-tolerant data processing. We will illustrate a potential data pipeline and discuss how each stage might be implemented and technology choices at each stage. The talk will also highlight up and coming Big Data technologies that may play a key role in IoT infrastructures.