Logo Header Menu

Big Data LDN: Why you need to modernise your IT infrastructure for AI

Brian Carpenter, senior director, technology strategy, Pure Storage, discusses why enterprises need to modernise their IT infrastructure if they wish to succeed with AI  Big Data LDN: Why you need to modernise your IT infrastructure for AI image

AI represents a new approach to turning unstructured data into insights. It holds tremendous promise for enterprises looking to innovate faster and extend their competitive edge. As such, investment in AI initiatives has skyrocketed, with companies worldwide investing between $26B and $39B in 2016 alone, according to a McKinsey report.

However, AI requires a different approach to scale-out infrastructure and its complexities are holding back enterprises from moving forward towards an AI-first world. Indeed, deep neural networks comprise millions of trainable parameters, connected through a configurable network of layers. In addition, each network has countless variations of topologies, connection strategies, learning rates, etc. – collectively referred to as hyper-parameters.

At Big Data LDN, Brian Carpenter, senior director, technology strategy, Pure Storage, explained how enterprises could seamlessly fit AI projects into a unified analytics plan with the right infrastructure built for scaling.

“AI software is only as good as the hardware that it runs on,” said Carpenter. “While data scientists don’t have to be infrastructure experts, infrastructure determines their success.”

Why you need to modernise

Carpenter argued that because AI requires new, modern technologies like GPUs, scale-out flash, and RDMA fabric to move tremendous amounts of data, too many AI initiatives are stalled with the complexities of a ‘do-it-yourself’ approach using legacy technologies, leading to months of delays and idle time.

Indeed, from an infrastructure perspective, one thing is clear. As AI projects grow beyond the experimentation stage to adoption, demand for more computing resources is inevitably going to increase.

In addition to large-scale computational requirements, recent research shows that training accuracy increases logarithmically with the volume of training data. Thus, small improvements in accuracy could require a 10x or greater increase in dataset size. Along with large-scale computing power, creating state-of-the-art models requires larger, more diverse data sets with high-performance access.

The truth about digital transformation – Cloud and on-premise: the best of both worlds

In recent years there have been countless examples of how digital transformation is proving to be a great asset to a wide variety of businesses. From global giants like Amazon branching into drone delivery and cashier-less stores to Uber investing huge amounts of capital in self-driving technology

What does AI-ready infrastructure look like?

According to Carpenter, AI-ready infrastructure should be:

  1. Scalable: Can’t bring everything down whenever one application needs more compute.
  2. Flexible: This is from a tools perspective; tools change every day. Enterprises need to avoid lock-in to keep pace with rapidly evolving ecosystems and the rapidly changing needs of data science team as their work matures.
  3. Portable: You want to be able to take things on and off the cloud. Think of experimental vs. productive environments.

Carpenter added: “If you have an 18-month roadmap for improving your infrastructure, you’re not moving quickly enough. If your tools change every six months, you’re crazy to go past 12 months.”

While you don’t want to set lines in the sand, according to Carpenter, you want to have a general idea of where you’re going.

The data journey: It’s only the beginning for digital transformation — Big Data LDN

In one of the opening keynotes from Big Data LDN, Doug Cutting — Chief Architect at Cloudera — discussed the importance of the data journey in the pursuit of digital transformation. Read here

Latest news

divider
M&A
Global software sector has seen a surge in M&A deals

Global software sector has seen a surge in M&A deals

6 December 2019 / The volume of M&A deals in the global software sector has soared to its highest [...]

divider
Releases & Updates
BP to move data to AWS, closing European data centres

BP to move data to AWS, closing European data centres

5 December 2019 / This move by BP, which involves closure of their two Europe-based mega centres, was made [...]

divider
Cloud & Edge Computing
AWS and Verizon partner to deliver 5G edge solutions

AWS and Verizon partner to deliver 5G edge solutions

4 December 2019 / In what’s been touted as a world-first, the solution is set to be deployed on [...]

divider
Telecoms
More than mobile: how rapidly diversifying telcos can avoid critical overload and downtime

More than mobile: how rapidly diversifying telcos can avoid critical overload and downtime

4 December 2019 / How can telcos avoid downtime? As industry rivals go, telecoms businesses are among the fiercest [...]

divider
Digital Transformation
How are ASEAN countries leading the digital transformation wave

How are ASEAN countries leading the digital transformation wave

4 December 2019 / Association of Southeast Asian Nations (ASEAN) has one of the most robust economies in Asia. [...]

divider
Automation
Top five automation challenges in 2020, according to Forrester analyst

Top five automation challenges in 2020, according to Forrester analyst

4 December 2019 / Every enterprise is automating. That’s not the story. The challenge most CTOs face is that [...]

divider
Cybersecurity
10 ways businesses can protect customer data

10 ways businesses can protect customer data

3 December 2019 / The Information Commissioners Office (ICO) has warned organisations that they should be doing everything they [...]

divider
AI & Machine Learning
AI and the future of design

AI and the future of design

2 December 2019 / The design industry is yet another area where AI is making huge strides. Just recently, [...]

divider
Diversity
Women in IT Awards New York 2020: Nominations Open!

Women in IT Awards New York 2020: Nominations Open!

2 December 2019 / Taking place at the Grand Hyatt, this will be the third annual iteration of New [...]

Do NOT follow this link or you will be banned from the site!

Pin It on Pinterest