Artificial intelligence receiving huge Kubernetes boost

Carmine Rimi of Canonical

There has been a 14-times increase in the amount of Artificial Intelligence (AI) start-ups launching since the turn of the century, according to a study by Stanford University. In the UK alone, says Carmine Rimi, AI product manager at Canonical – the company behind Ubuntu, AI developers witnessed a 200% spike in venture capital funding in the past year alone; as the transformative potential of AI smashes all boundaries.

The creation of AI applications to enhance ways of doing business and, indeed, people’s lives is a huge task. These applications are complicated to develop and build, as they involve such varying types of data; making porting to different platforms troublesome.

Above these challenges, several steps are needed at each stage to start constructing even the most basic AI application. A spectrum of skills is necessary, including feature extraction, data collection verification and analysis, and machine resource management, to underpin a comparatively tiny subset of actual ML code. A lot of work needs to happen before taking a position on the start line; alongside a large amount of ongoing effort to keep the applications up to date. All developers are searching for ways to beat these big challenges.

Contain yourself

The result of this search, to keeps apps up to date and balance workloads in app development, often comes to the same answer – Kubernetes. This open source platform can be a facilitator, as it can automate the deployment and management of containerised applications, comprising complicated workloads such as AI and Machine Learning. Kubernetes has enjoyed something spectacular because its capable of these things, but also as a container orchestration platform.

Forrester recently stated that “Kubernetes has won the war for container orchestration dominance and should be at the heart of your microservices plans”. Containers deliver a compact environment for processes to operate in. They are straightforward to scale, portable on a range of environments and they, therefore, enable large, monolithic applications to be split into targeted, easier-to-maintain, microservices. The majority of developers say they are leveraging Kubernetes across a variety of development stages, according to a Cloud Native Computing Foundation survey. 

Most companies are running, or plan to start using, Kubernetes as platform for workloads. Of course, AI is a workload that is rapidly garnering importance. Kubernetes is ideal for this task, because AI algorithms must be able to scale to be effective. Certain deep learning algorithms and data sets need a large amount of compute. Kubernetes can help here, because it is focused on scaling around demand.

Kubernetes can also provide a roadmap to deploying AI-enabled workloads over multiple commodity servers, spanning the software pipeline, while abstracting out the management overhead. After the models are trained, serving them in differing deployment scenarios, from edge compute to central datacentres, is challenging for non-containerised application forms. Once again, Kubernetes can unlock the necessary flexibility for a distributed deployment of inference agents on a variety of substrates.

Changing focus

As businesses move their attention to AI to slash operating costs, improve decision-making and cater for customers in new ways, Kubernetes-based containers are rapidly becoming the number one technology to support companies in adopting AI and Machine Learning. Last December Kubernetes project unveiled Kubeflow, which is focused on making deployments of Machine Learning workflows on Kubernetes simple, portable and scalable.

While Kubernetes began life with just stateless services, the project stated that customers had started to move complex workloads to the platform, leveraging Kubernetes’ ‘rich APIs, reliability and performance’. One of the most rapidly growing use cases for Kubernetes is as the deployment platform of choice for Machine Learning.

At the start of 2017 only the Google Cloud Platform supported Kubernetes, with its Google Kubernetes Engine. At the culmination of the year, every major public cloud vendor was on board. Especially, after Microsoft added Kubernetes support to the Azure Container Service and Amazon debuted the Amazon Elastic Container Service for Kubernetes.

The ways that Kubernetes is being rolled out and leveraged by businesses is seemingly boundless. In a relatively short life span, Kubernetes has achieved a lot. This underlines the extent to which tech vendors, and their clients, are flocking to the notion that containers provide huge benefits in developing and managing the AI parts of applications. The emergence of AI is triggering a huge interest in containers to introduce repeatability and fault tolerance to these complicated workloads.

Kubernetes is becoming a de facto standard and fantastic match to manage containerised AI applications. It has proved itself and should go on to be of dramatic benefit to businesses for a long time to come.

The author is Carmine Rimi, AI product manager at Canonical.

Comment on this article below or via Twitter: @IoTNow_OR @jcIoTnow

RECENT ARTICLES

Get a US$50 Amazon voucher for sharing your IoT brand knowledge

Posted on: March 28, 2024

We want to know what you know about the IoT space. Just 3 minutes could earn you a US$50 Amazon digital gift card!

Read more

Enhance EV charging performance with cellular connectivity

Posted on: March 28, 2024

Electric vehicles (EVs) are steadily growing their market share at the expense of internal combustion engine vehicles. The growth is fuelled by several factors. Perhaps most importantly, prices for EVs have started to drop as competition in the industry is intensifying. New players and models are emerging, prompting several established EV makers to lower their

Read more
FEATURED IoT STORIES

What is IoT? A Beginner’s Guide

Posted on: April 5, 2023

What is IoT? IoT, or the Internet of Things, refers to the connection of everyday objects, or “things,” to the internet, allowing them to collect, transmit, and share data. This interconnected network of devices transforms previously “dumb” objects, such as toasters or security cameras, into smart devices that can interact with each other and their

Read more

The IoT Adoption Boom – Everything You Need to Know

Posted on: September 28, 2022

In an age when we seem to go through technology boom after technology boom, it’s hard to imagine one sticking out. However, IoT adoption, or the Internet of Things adoption, is leading the charge to dominate the next decade’s discussion around business IT. Below, we’ll discuss the current boom, what’s driving it, where it’s going,

Read more

9 IoT applications that will change everything

Posted on: September 1, 2021

Whether you are a future-minded CEO, tech-driven CEO or IT leader, you’ve come across the term IoT before. It’s often used alongside superlatives regarding how it will revolutionize the way you work, play, and live. But is it just another buzzword, or is it the as-promised technological holy grail? The truth is that Internet of

Read more

Which IoT Platform 2021? IoT Now Enterprise Buyers’ Guide

Posted on: August 30, 2021

There are several different parts in a complete IoT solution, all of which must work together to get the result needed, write IoT Now Enterprise Buyers’ Guide – Which IoT Platform 2021? authors Robin Duke-Woolley, the CEO and Bill Ingle, a senior analyst, at Beecham Research. Figure 1 shows these parts and, although not all

Read more

CAT-M1 vs NB-IoT – examining the real differences

Posted on: June 21, 2021

As industry players look to provide the next generation of IoT connectivity, two different standards have emerged under release 13 of 3GPP – CAT-M1 and NB-IoT.

Read more

IoT and home automation: What does the future hold?

Posted on: June 10, 2020

Once a dream, home automation using iot is slowly but steadily becoming a part of daily lives around the world. In fact, it is believed that the global market for smart home automation will reach $40 billion by 2020.

Read more

5 challenges still facing the Internet of Things

Posted on: June 3, 2020

The Internet of Things (IoT) has quickly become a huge part of how people live, communicate and do business. All around the world, web-enabled devices are turning our world into a more switched-on place to live.

Read more