Data storage is the key to autonomous vehicles’ future


Mark Pastor, product marketing director for archive products at Quantum, says autonomous driving depends on interlinked technologies, including data collection and storage, which are often overlooked.

Most of the public’s focus is on the machine-learning aspect of driving, that is the system that helps vehicles detect hazards and respond accordingly, based on incoming data. However, data collection and storage can substantially influence the pace of development for autonomous vehicle designers.

Data speed bumps

The road to self-driving cars is full of speed bumps that are slowing the development process. The first issue for manufacturers to address is that all data captured on the road is essential to developing a safe and fully automated driving experience. The problem is that there is so much of it to handle and process.

IDC forecasts that by 2025, the global data sphere will grow to 163ZB (that is, a trillion gigabytes). That’s 10 times the 16.1ZB of data generated in 2016. Inside the vehicles themselves the news is daunting too. Autonomous vehicles’ data is growing even faster thanks to autonomous test vehicles, which typically generate between 5TB and 20TB of data per day, per vehicle.

This includes cameras, which tend to generate 20 to 60Mbps, depending on the quality of the images that are captured, which ranges from standard definition to higher definition, as well as sonar (10 to100kbps) radar (10kbps), LIDAR systems (10 to 70Mbps) and GPS (50kbps). The key is to ensure that sensors are collecting the right data and it is processed immediately, stored securely and transferred to other technologies in the chain.

Manufacturers will have a lot of decisions to make when it comes to how they architect the systems that receive and retain in-vehicle captured data. Most important here is how to create an infrastructure and workflow that enables a smooth transition of data throughout its life. This goes from initial in-vehicle capture all the way through long-term retention of data that will be critical for future development, reference, compliance or litigation.

One proven approach is a high-performance front-end, based on solid state drives or disks, and low-cost storage for massive, scalable retention usually based on tape, but sometimes disk. Public cloud infrastructures are also useful for ‘cloud burst’ analysis, which is when demand for processing resources spike beyond the level that is typically needed or available on the premises.

Racing to 5G

Mark Pastor

We can’t speak about autonomous vehicles and data without mentioning how 5G will enable a new era of connected cars. Most vehicles on the road today are fitted with some form of in-vehicle communications system or internet access.

New developments in communications standards and networks have shown speeds of over 10Gbps and latencies of less than 10ms, which deliver high speed, wide bandwidth and extremely low latency.

5G expands the data potential for autonomous vehicles tenfold: as it does not need a carrier, most of the data ingest and transfer can be done without wide area network coverage. We’re looking at vehicle-to-vehicle and vehicle-to-infrastructure communications at a speed and capacity that wasn’t previously possible with older generation networks. Industry experts believe that autonomous driving will not truly be achievable until 5G kicks in, but there’s still a lot of work to be done before driverless cars become the norm.

There’s no doubt that 5G will dominate mobile communications and will add to the data burden shouldered by autonomous vehicles. Automotive manufacturers need to remember that the car of the future is going to be in essence a mobile data centre, that will carry and handle enormous volumes of data.

However, as much as we like to talk about acceleration in the connected car race, the move to fully connected vehicles will be gradual. We still need to resolve some challenges around this, including the high frequency waves utilised by 5G. They can’t travel far, are easily absorbed by their surroundings and these factors can limit how quickly and far information travels between stations.

Perhaps we will see more base stations and more trials, but wide coverage will take some time to achieve. With so much data at such high frequencies, the full benefits of autonomous driving won’t be realised until years from now.

One thing is certain: data volumes will continue to grow. Having the right in-vehicle and back-end storage infrastructures is central to the development of autonomous vehicles.

The author of this blog is Mark Pastor, product marketing director at Quantum

Comment on this article below or via Twitter: @IoTNow_OR @jcIoTnow


Aeris Intelligent IoT network provides System Loco with reliable connectivity for worldwide track and trace of sustainable IoT-enabled smart pallets

Posted on: July 5, 2022

Aeris, the global Internet of Things (IoT) solutions provider, announced that System Loco, a global provider of supply chain and asset tracking solutions, has selected the Aeris Intelligent IoT Network to provide next generation connectivity to support and manage the worldwide track and trace of smart pallets employed by System Loco’s customers throughout the world.

Read more

Removing IT bottlenecks: The key’s simplicit

Posted on: July 5, 2022

A report by Mulesoft found that the IT teams of just 37% of organisations completed all of their assigned projects last year. Digitalisation can gather valuable data insights and optimise processes, but progress is often held back by the large IT workload such projects create. Here, Johan Jonzon, CMO and co-founder in edge analytics for

Read more

9 IoT applications that will change everything

Posted on: September 1, 2021

Whether you are a future-minded CEO, tech-driven CEO or IT leader, you’ve come across the term IoT before. It’s often used alongside superlatives regarding how it will revolutionize the way you work, play, and live. But is it just another buzzword, or is it the as-promised technological holy grail? The truth is that Internet of

Read more

Which IoT Platform 2021? IoT Now Enterprise Buyers’ Guide

Posted on: August 30, 2021

There are several different parts in a complete IoT solution, all of which must work together to get the result needed, write IoT Now Enterprise Buyers’ Guide – Which IoT Platform 2021? authors Robin Duke-Woolley, the CEO and Bill Ingle, a senior analyst, at Beecham Research. Figure 1 shows these parts and, although not all

Read more

CAT-M1 vs NB-IoT – examining the real differences

Posted on: June 21, 2021

As industry players look to provide the next generation of IoT connectivity, two different standards have emerged under release 13 of 3GPP – CAT-M1 and NB-IoT.

Read more

IoT and home automation: What does the future hold?

Posted on: June 10, 2020

Once a dream, home automation using iot is slowly but steadily becoming a part of daily lives around the world. In fact, it is believed that the global market for smart home automation will reach $40 billion by 2020.

Read more

5 challenges still facing the Internet of Things

Posted on: June 3, 2020

The Internet of Things (IoT) has quickly become a huge part of how people live, communicate and do business. All around the world, web-enabled devices are turning our world into a more switched-on place to live.

Read more

What is IoT?

Posted on: July 7, 2019

What is IoT Data as a new oil IoT connectivity What is IoT video So what’s IoT? The phrase ‘Internet of Things’ (IoT) is officially everywhere. It constantly shows up in my Google news feed, the weekend tech supplements are waxing lyrical about it and the volume of marketing emails I receive advertising ‘smart, connected

Read more
IoT Newsletter

Join the IoT Now online community for FREE, to receive: Exclusive offers for entry to all the IoT events that matter, round the world

Free access to a huge selection of the latest IoT analyst reports and industry whitepapers

The latest IoT news, as it breaks, to your inbox