Streaming for ‘extremely fast’ event processing in IoT, edge and cloud environments simplified by Hazelcast Jet

Kelly Herrell of Hazelcast

In-memory computing platform company, Hazelcast has unveiled Hazelcast Jet, said to be the only streaming engine with no external system dependencies. According to the company, the result is the industry’s fastest stream processing engine that dramatically simplifies implementation from the smallest to largest deployments.

Whether deployed in constrained environments, such as Internet of Things (IoT) sensors, or cloud-scale applications, Hazelcast Jet ingests, categorises and processes vast amounts of data with ultra-low latency to support continuous intelligence practices.

“SigmaStream specialises in high-frequency data and works with some of the world’s largest companies that operate in the most constrained environments. By integrating Hazelcast Jet’s high-performance streaming engine with our Hummingbird visualisation and processing platform, we process high-frequency data from dozens of channels and address inefficiencies in real-time,” said Hari Koduru, CEO of SigmaStream. “The performance and optimisation at such a fine level enable SigmaStream’s customers to shrink the time spent on a project, ultimately saving them millions of dollars.”

Single system design

Normally, deploying other streaming engines requires enterprises to invest the time and endure the complexity of integrating multiple components from different sources. For example, a Flink implementation would necessitate integrating a combination of Kafka, ZooKeeper, RocksDB, Hadoop File System and resource managers to ingest, categorise and process data.

Hazelcast Jet significantly simplifies deployment because it is a single, lightweight system that elegantly addresses a complex set of architectural requirements. Hazelcast Jet’s unique single-system design enables rapid time-to-value, eliminates costs and complexity associated with multi-component architectures, and reduces the need for multiple skill sets.

Millisecond speeds

Internal benchmarks demonstrate Hazelcast Jet’s ability to maintain millisecond speeds at extreme scale, where other open source-based projects drop into the seconds. Hazelcast Jet maintains its ultra-low latency, regardless of scale, due to a distributed architecture and in-memory processing.

“Hazelcast has once again delivered a powerful leap forward for the industry, this time by radically simplifying how stream event processing is implemented,” says Kelly Herrell, CEO of Hazelcast. “Time is money, and the ability to process data at the moment it is generated — wherever it is generated — produces measurable business benefits, whether at a financial trading desk or edge-based sensors. When time matters, companies choose Hazelcast and now they have a compelling and flexible streaming solution for fast data processing in Hazelcast Jet.”

Hazelcast Jet also delivers low-latency performance regardless of scale, whether running at the IoT edge in small-format hardware or as a massive cluster in data centres and clouds.

Run anywhere

Hazelcast Jet’s architecture is simultaneously lightweight and highly scalable, allowing it to run wherever customers need high-performance stream processing. Its small file size and architecture provide numerous deployment options, including in Kubernetes microservices environments, private data centres, public clouds or embedded in applications.

Furthering the deployment simplicity of Hazelcast Jet, it is Kubernetes-ready to support containerised workloads and validated to run in Pivotal Cloud Foundry and Red Hat OpenShift cloud environments.

As workloads increase, Hazelcast Jet’s clustering model scales up and down without job interruption.

Hazelcast Jet clusters can be taken offline without losing data and jobs can be upgraded without interrupting processing, a significant benefit for long-running continuous streaming applications. In the event of an outage, in-memory data replication provides a robust, yet performant means of fault tolerance, with Hot Restart for fast recovery. The in-memory data can also be continuously persisted to disk for maintenance shutdowns or lights-out events.

Machine learning

Whereas most streaming engines use batch processing to manage data, Hazelcast Jet is capable of processing the event upon ingestion. With real-time processing, Hazelcast Jet is a reliable solution for serving machine learning models that require the latest information to inform decisions.

Furthermore, Hazelcast Jet integrates with TensorFlow to run real-time classification and prediction workloads at scale. Customers can choose whether they want to use the embedded, in-process Java runner or a remote TensorFlow Serving option.

In-Memory computing platform

Combining Hazelcast Jet with Hazelcast IMDG enables enterprises to deploy a high-performance and scalable in-memory computing platform that handles data in motion and at rest.

Hazelcast presents customers with the ability to utilise a common architecture and skill sets to ingest and process streaming data, while also providing storage and computation of data, all at industry-leading low latency. Hazelcast Jet 3.0 is available today for download.

Comment on this article below or via Twitter: @IoTNow_OR @jcIoTnow


What Matter? – The newly smart home standard

Posted on: December 2, 2022

Matter is an industry-unifying IoT wireless network standard that still needs to be released. It strives to become a reliant, frictionless, safe communication basis for connected objects. The project was announced and started in 2019. By utilising a specific collection of IP-based networking technologies, initiating with Thread, wi-fi, and Ethernet, Matter is a platform built

Read more

Ericsson, Thales launches IoT accelerator device connect with eSIMs for enterprises

Posted on: December 2, 2022

Ericsson’s Internet of Things (IoT) business, in partnership with Thales, launches IoT Accelerator Device Connect, a service offering generic eSIMs unbundled from pre-selected Service Providers. For the first time, enterprises have the flexibility to select one or more Service Providers easily and instantly at the time of device activation. This new business model dramatically accelerates

Read more

The IoT Adoption Boom – Everything You Need to Know

Posted on: September 28, 2022

In an age when we seem to go through technology boom after technology boom, it’s hard to imagine one sticking out. However, IoT adoption, or the Internet of Things adoption, is leading the charge to dominate the next decade’s discussion around business IT. Below, we’ll discuss the current boom, what’s driving it, where it’s going,

Read more

9 IoT applications that will change everything

Posted on: September 1, 2021

Whether you are a future-minded CEO, tech-driven CEO or IT leader, you’ve come across the term IoT before. It’s often used alongside superlatives regarding how it will revolutionize the way you work, play, and live. But is it just another buzzword, or is it the as-promised technological holy grail? The truth is that Internet of

Read more

Which IoT Platform 2021? IoT Now Enterprise Buyers’ Guide

Posted on: August 30, 2021

There are several different parts in a complete IoT solution, all of which must work together to get the result needed, write IoT Now Enterprise Buyers’ Guide – Which IoT Platform 2021? authors Robin Duke-Woolley, the CEO and Bill Ingle, a senior analyst, at Beecham Research. Figure 1 shows these parts and, although not all

Read more

CAT-M1 vs NB-IoT – examining the real differences

Posted on: June 21, 2021

As industry players look to provide the next generation of IoT connectivity, two different standards have emerged under release 13 of 3GPP – CAT-M1 and NB-IoT.

Read more

IoT and home automation: What does the future hold?

Posted on: June 10, 2020

Once a dream, home automation using iot is slowly but steadily becoming a part of daily lives around the world. In fact, it is believed that the global market for smart home automation will reach $40 billion by 2020.

Read more

5 challenges still facing the Internet of Things

Posted on: June 3, 2020

The Internet of Things (IoT) has quickly become a huge part of how people live, communicate and do business. All around the world, web-enabled devices are turning our world into a more switched-on place to live.

Read more

What is IoT?

Posted on: July 7, 2019

What is IoT Data as a new oil IoT connectivity What is IoT video So what’s IoT? The phrase ‘Internet of Things’ (IoT) is officially everywhere. It constantly shows up in my Google news feed, the weekend tech supplements are waxing lyrical about it and the volume of marketing emails I receive advertising ‘smart, connected

Read more