How IoT and microservices can overcome the mass data challenge

Our planet is changing. An ever-growing population combined with a rapidly-escalating increase in traffic and the number of extreme weather events is putting continuous pressure on our infrastructure assets. IoT technology is no longer a ‘nice-to-have’ but increasingly a necessity when it comes to the future, across everything from smart devices in the home, to helping manage the smartest cities on the planet.

In the UK, the infrastructure challenges are ever-present, with a population that has increased by 8% since 2006, motorway traffic rising by 10% and extreme weather events occurring four times more frequently as our planet continues to change. These changes present clear challenges, both to private businesses and to the broader public sector, and planning for the future is a must, says Manish Jethwa, chief product & technology officer at Yotta.

To give our infrastructure the best chance of coping with this new environment, we can no longer take a reactive approach to maintenance and services. Today, a more predictive way of working is urgently required.

Sensors play a crucial role in this process. When placed on infrastructure assets such as highways, streetlights and drain gulleys, they essentially become the pulse of the road. Every minute, these devices feed back countless amounts of data into a communication network, which can then be passed to a management analytics device before being displayed in an application.

However, it is easy for data to become unmanageable when quantities continue to rise over terabytes and petabyte levels, where it becomes imperative that there is a sound infrastructure in place to mediate the collected data. That’s where meta-level data analytics can help. While businesses can use the cloud to help reduce the sheer amount of data that is being gathered by sensors and probes, it’s important to analyse what infrastructure is being used to hold and manage the data.

To ease the mass data challenge, a connected asset management platform such as Yotta’s new revolutionary Alloy can help extract large volumes of data collected through the help of microservices. Microservices are built as a suite of modular services that each have a specific role to perform.

These microservices are critical because they can help drive crucial data to the right places, which then allows data analysis to happen at a more general level. Microservices can also be built for predefined service levels for each sector. These thresholds can then be used to detect any notable changes in the sensors, such as a significant rise in traffic, or an increase in water levels within a drain.

Manish Yotta

A further example of this type of data collection in practice is the collection of temperature variations within cities. A process which may require a number of different sensors to collect regular readings. Microservices can provide a valuable service in reducing multiple measurements into key notifications of predefined thresholds being exceeded. It is easy to imagine similar technology being used to monitor noise and air pollution too.

While microservices play a vital role in ensuring data is collected in an efficient way, individual assets must be connected to truly represent the value of a network. When connected and placed on a visual map, the status of an asset network can be clearly assessed and maintained to the highest standard. In practice, it enables the asset manager to make informed decisions on each individual asset, such as repairing a streetlight before it fails.

With a recent BBC study predicting that 70% of the world’s population will be living in cities by 2050, the need for infrastructure to become more advanced in urban environments is essential to the development of the even smarter city.

The author of this blog is Manish Jethwa, chief product & technology officer at Yotta

Manish Jethwa will also be speaking at the IoT Tech Expo Global Conference 2018 at London Olympia on the 18 – 19 April.

Comment on this article below or via Twitter: @IoTNow_OR @jcIoTnow

RECENT ARTICLES

SandboxAQ’s AQtive Guard deployed by SoftBank for cryptographic security

Posted on: April 16, 2024

SandboxAQ have announced the deployment of its AQtive Guard cryptography management platform by the Advanced Research Group of SoftBank. This followed testing of AQtive Guard’s abilities to discover cryptographic and certificate-based vulnerabilities to AI-based and quantum computer-based cyber attacks against IT systems, including networks, end-points and applications.

Read more

VOZIQ AI sets AI retention strategy for Hawx

Posted on: April 15, 2024

VOZIQ AI recently concluded the executive review meeting with Hawx’s leadership team, where VOZIQ AI’s chief data scientist, Vasudeva Akula, rolled out a 365-day roadmap for proactive customer experience management, proactive renewals and loyalty management, using AI driven insights for each customer.

Read more
FEATURED IoT STORIES

What is IoT? A Beginner’s Guide

Posted on: April 5, 2023

What is IoT? IoT, or the Internet of Things, refers to the connection of everyday objects, or “things,” to the internet, allowing them to collect, transmit, and share data. This interconnected network of devices transforms previously “dumb” objects, such as toasters or security cameras, into smart devices that can interact with each other and their

Read more

The IoT Adoption Boom – Everything You Need to Know

Posted on: September 28, 2022

In an age when we seem to go through technology boom after technology boom, it’s hard to imagine one sticking out. However, IoT adoption, or the Internet of Things adoption, is leading the charge to dominate the next decade’s discussion around business IT. Below, we’ll discuss the current boom, what’s driving it, where it’s going,

Read more

9 IoT applications that will change everything

Posted on: September 1, 2021

Whether you are a future-minded CEO, tech-driven CEO or IT leader, you’ve come across the term IoT before. It’s often used alongside superlatives regarding how it will revolutionize the way you work, play, and live. But is it just another buzzword, or is it the as-promised technological holy grail? The truth is that Internet of

Read more

Which IoT Platform 2021? IoT Now Enterprise Buyers’ Guide

Posted on: August 30, 2021

There are several different parts in a complete IoT solution, all of which must work together to get the result needed, write IoT Now Enterprise Buyers’ Guide – Which IoT Platform 2021? authors Robin Duke-Woolley, the CEO and Bill Ingle, a senior analyst, at Beecham Research. Figure 1 shows these parts and, although not all

Read more

CAT-M1 vs NB-IoT – examining the real differences

Posted on: June 21, 2021

As industry players look to provide the next generation of IoT connectivity, two different standards have emerged under release 13 of 3GPP – CAT-M1 and NB-IoT.

Read more

IoT and home automation: What does the future hold?

Posted on: June 10, 2020

Once a dream, home automation using iot is slowly but steadily becoming a part of daily lives around the world. In fact, it is believed that the global market for smart home automation will reach $40 billion by 2020.

Read more

5 challenges still facing the Internet of Things

Posted on: June 3, 2020

The Internet of Things (IoT) has quickly become a huge part of how people live, communicate and do business. All around the world, web-enabled devices are turning our world into a more switched-on place to live.

Read more