Logo Header Menu

Big Data LDN: Why you need to modernise your IT infrastructure for AI

Brian Carpenter, senior director, technology strategy, Pure Storage, discusses why enterprises need to modernise their IT infrastructure if they wish to succeed with AI  Big Data LDN: Why you need to modernise your IT infrastructure for AI image

AI represents a new approach to turning unstructured data into insights. It holds tremendous promise for enterprises looking to innovate faster and extend their competitive edge. As such, investment in AI initiatives has skyrocketed, with companies worldwide investing between $26B and $39B in 2016 alone, according to a McKinsey report.

However, AI requires a different approach to scale-out infrastructure and its complexities are holding back enterprises from moving forward towards an AI-first world. Indeed, deep neural networks comprise millions of trainable parameters, connected through a configurable network of layers. In addition, each network has countless variations of topologies, connection strategies, learning rates, etc. – collectively referred to as hyper-parameters.

At Big Data LDN, Brian Carpenter, senior director, technology strategy, Pure Storage, explained how enterprises could seamlessly fit AI projects into a unified analytics plan with the right infrastructure built for scaling.

“AI software is only as good as the hardware that it runs on,” said Carpenter. “While data scientists don’t have to be infrastructure experts, infrastructure determines their success.”

Why you need to modernise

Carpenter argued that because AI requires new, modern technologies like GPUs, scale-out flash, and RDMA fabric to move tremendous amounts of data, too many AI initiatives are stalled with the complexities of a ‘do-it-yourself’ approach using legacy technologies, leading to months of delays and idle time.

Indeed, from an infrastructure perspective, one thing is clear. As AI projects grow beyond the experimentation stage to adoption, demand for more computing resources is inevitably going to increase.

In addition to large-scale computational requirements, recent research shows that training accuracy increases logarithmically with the volume of training data. Thus, small improvements in accuracy could require a 10x or greater increase in dataset size. Along with large-scale computing power, creating state-of-the-art models requires larger, more diverse data sets with high-performance access.

The truth about digital transformation – Cloud and on-premise: the best of both worlds

In recent years there have been countless examples of how digital transformation is proving to be a great asset to a wide variety of businesses. From global giants like Amazon branching into drone delivery and cashier-less stores to Uber investing huge amounts of capital in self-driving technology

What does AI-ready infrastructure look like?

According to Carpenter, AI-ready infrastructure should be:

  1. Scalable: Can’t bring everything down whenever one application needs more compute.
  2. Flexible: This is from a tools perspective; tools change every day. Enterprises need to avoid lock-in to keep pace with rapidly evolving ecosystems and the rapidly changing needs of data science team as their work matures.
  3. Portable: You want to be able to take things on and off the cloud. Think of experimental vs. productive environments.

Carpenter added: “If you have an 18-month roadmap for improving your infrastructure, you’re not moving quickly enough. If your tools change every six months, you’re crazy to go past 12 months.”

While you don’t want to set lines in the sand, according to Carpenter, you want to have a general idea of where you’re going.

The data journey: It’s only the beginning for digital transformation — Big Data LDN

In one of the opening keynotes from Big Data LDN, Doug Cutting — Chief Architect at Cloudera — discussed the importance of the data journey in the pursuit of digital transformation. Read here

This article is tagged with: Cloud Infrastructure, IT, Pure Storage

Sign up for Information Age Newsletters

Latest news

divider
Cloud & Edge Computing
Navigating open standards for Kubernetes

Navigating open standards for Kubernetes

29 October 2020 / Among organisations that have adopted cloud-native infrastructure, 78% of them run their container clusters on [...]

divider
Software and Applications
How low-code eases the strain on engineers

How low-code eases the strain on engineers

29 October 2020 / Depending on who you ask, there were between 19 million and 24 million software engineers [...]

divider
People Moves
Dean Gulzar appointed as head of insurance at NTT DATA UK

Dean Gulzar appointed as head of insurance at NTT DATA UK

29 October 2020 / Hired to lead the insurance team at NTT DATA UK, Gulzar will drive new client [...]

divider
Research
Value of European tech companies soars to €618 billion

Value of European tech companies soars to €618 billion

29 October 2020 / The value of European tech companies is now worth four times what it was five [...]

divider
Research
47% of firms to increase investment in IoT, says Gartner study

47% of firms to increase investment in IoT, says Gartner study

29 October 2020 / According to the Gartner research, 35% of organisations reduced investment in IoT during the Covid-19 [...]

divider
Releases & Updates
Infosys turns carbon neutral, announces ESG 2030 pledge

Infosys turns carbon neutral, announces ESG 2030 pledge

28 October 2020 / In the lead-up to turning carbon neutral in accordance with PAS 2060 standards, Infosys has [...]

divider
Healthcare
Sensyne Health and Microsoft partner to further develop clinical AI

Sensyne Health and Microsoft partner to further develop clinical AI

28 October 2020 / The partnership between Sensyne Health and Microsoft will entail the aim of improving, augmenting, and [...]

divider
Automation
RPA and the rise of intelligent automation in healthcare

RPA and the rise of intelligent automation in healthcare

28 October 2020 / The Robotic Process Automation (RPA) market is booming. It provides businesses with a huge opportunity [...]

divider
Business & Strategy
Management strategies must adapt to remote working — VMware

Management strategies must adapt to remote working — VMware

28 October 2020 / According to the new research from VMware, exploring the notion that employees can work from [...]

Do NOT follow this link or you will be banned from the site!

Pin It on Pinterest