EMQX cloud rolls out shadow service for convenient IoT data caching

EMQ, the software provider of open-source IoT data infrastructure has announced a notable value-added service for its fully managed MQTT messaging platform, EMQX Cloud. The new Shadow service provides out-of-the-box platform-side data caching, helping dev teams to accelerate the development process for many IoT use cases.

Previously, developers needed to transfer IoT data to third-party services through the data integration component of EMQX Cloud before they could conduct further data processing, analysis, and application development. The Shadow service avoids reliance on third-party services, allowing developers to centralise device data caching, modification, and viewing directly within EMQX Cloud. They can quickly create object models, device shadows, and other resources related to data reporting and distribution that reduce build times, latency, and transmission costs.

As the global IoT industry continues to experience unprecedented growth, quickly connecting IoT devices and platform applications to support rapid implementation and market validation is becoming key to shaping core competitiveness and achieving business innovation. However, in the case of message interactions between IoT devices and applications, it is very common that the device side network is unstable, low-power devices are dormant, and mobile applications do not consume data regularly. To ensure reliable interactions, caching or persisting data, such as the latest reported messages from devices or configuration parameters issued by applications, in the MQTT message access layer can be an important requirement.

EMQX Cloud Shadow service solves the above-mentioned issues, empowering companies to speed up development while enhancing the reliability of data processing. After activating the service, users can configure shadow models, access data through a standard API, and monitor usage without requiring third-party integrations.

The long-awaited Shadow service on EMQX Cloud was informed by real customer needs across the automotive, manufacturing, finance, and other smart industries deployed in EMQX environments. Many IoT applications can benefit from Shadow service, such as the interactions between smart home devices, low-power smart meter data collection and configuration, and telematics message pushing.

With the data caching capability of the Shadow service, users can develop many applications without configuring external storage and network connectivity. It’s especially suitable for tracking device status.

Application requests to get device status are complicated by several conditions:

  • Devices may go online and offline frequently because of network instability, so they cannot respond to application requests normally.
  • Devices may need to respond to requests from multiple applications simultaneously, straining their limited processing capacity.
  • Devices may transmit information even when there is no data consumer.
  • Devices may transmit the same information in response to every request, even though different applications need to read different parts of the device information.

With the use of device shadowing, the device state change only needs to be synchronised to the device shadow once. Regardless of whether the application is online, the number of requests, and whether the device is online, the current state of the device can be obtained from the device shadow cache, enabling the decoupling of the application and the device.

Applications can send commands to devices, but when a device is offline or the device goes online and offline frequently because of an unstable network, the commands will fail to be sent. Using the device shadow mechanism, the commands issued by the application can be stored in the device shadow with a timestamp. When the device goes online again, it can obtain the commands from the device shadow and determine whether to execute them according to the timestamp.

Furthermore, Shadow service provides both MQTT and REST API interfaces to add, delete, and check cached documents for easy invocation by MQTT devices and application services. The MQTT interface provided by the Shadow service is fully compliant with the MQTT standard, and the client can invoke the Shadow service as long without the need for a customised SDK and without platform binding.

With the fully managed MQTT messaging service provided by EMQX Cloud combined with the Shadow service, users can easily integrate MQTT device access and message caching, greatly accelerating the speed of IoT application development. The flexible message caching data structure in the Shadow service can also help later business expansion, providing a guarantee for continuous business development.

Comment on this article below or via Twitter: @IoTNow_OR @jcIoTnow


LEXI develops universal IoT platform for easing IoT experience

Posted on: December 5, 2022

Berkeley, United States – LEXI, the company behind the comprehensive IoT technologies that are transforming how both enterprises and consumers manage and automate their smart spaces, announced the LEXI IoT platform – a sizable step forward in easing the IoT experience for everyone connecting products, across apps, and across ecosystems.

Read more

CloudBees joins Amazon EC2 Spot Ready Partner program

Posted on: December 5, 2022

San Jose, United States – CloudBees, a software delivery platform for enterprises, announced that it achieved the Amazon Web Service (AWS) Service Ready program for Amazon Elastic Compute Cloud (Amazon EC2) Spot instances. This designation recognises that CloudBees and its CloudBees CI solution has demonstrated support for Amazon EC2 Spot instances.

Read more

The IoT Adoption Boom – Everything You Need to Know

Posted on: September 28, 2022

In an age when we seem to go through technology boom after technology boom, it’s hard to imagine one sticking out. However, IoT adoption, or the Internet of Things adoption, is leading the charge to dominate the next decade’s discussion around business IT. Below, we’ll discuss the current boom, what’s driving it, where it’s going,

Read more

9 IoT applications that will change everything

Posted on: September 1, 2021

Whether you are a future-minded CEO, tech-driven CEO or IT leader, you’ve come across the term IoT before. It’s often used alongside superlatives regarding how it will revolutionize the way you work, play, and live. But is it just another buzzword, or is it the as-promised technological holy grail? The truth is that Internet of

Read more

Which IoT Platform 2021? IoT Now Enterprise Buyers’ Guide

Posted on: August 30, 2021

There are several different parts in a complete IoT solution, all of which must work together to get the result needed, write IoT Now Enterprise Buyers’ Guide – Which IoT Platform 2021? authors Robin Duke-Woolley, the CEO and Bill Ingle, a senior analyst, at Beecham Research. Figure 1 shows these parts and, although not all

Read more

CAT-M1 vs NB-IoT – examining the real differences

Posted on: June 21, 2021

As industry players look to provide the next generation of IoT connectivity, two different standards have emerged under release 13 of 3GPP – CAT-M1 and NB-IoT.

Read more

IoT and home automation: What does the future hold?

Posted on: June 10, 2020

Once a dream, home automation using iot is slowly but steadily becoming a part of daily lives around the world. In fact, it is believed that the global market for smart home automation will reach $40 billion by 2020.

Read more

5 challenges still facing the Internet of Things

Posted on: June 3, 2020

The Internet of Things (IoT) has quickly become a huge part of how people live, communicate and do business. All around the world, web-enabled devices are turning our world into a more switched-on place to live.

Read more

What is IoT?

Posted on: July 7, 2019

What is IoT Data as a new oil IoT connectivity What is IoT video So what’s IoT? The phrase ‘Internet of Things’ (IoT) is officially everywhere. It constantly shows up in my Google news feed, the weekend tech supplements are waxing lyrical about it and the volume of marketing emails I receive advertising ‘smart, connected

Read more