Logo Header Menu

The hardest part of AI & analytics is not AI, it’s data management

The hardest part of AI & analytics is not AI, it’s data management image

At Big Data LDN,  Greg Hanson, VP EMEA at Informatica, discussed with IA the benefits of an end-to-end data engineering approach to achieving clean data that you can trust for successful AI initiatives. This approach includes data discovery, ingestion, integration, quality, prep, and governance.

It’s hard to meet a business leader who isn’t excited by the potential of AI and predictive analytics in helping drive their organisation’s efficiency. Fraud detection, next-best-action, operational efficiency and forecast analysis are among the many business challenges that AI and analytics can help solve. However, bad data is currently hindering AI since machine learning (ML) models are only as good as the data you feed them.

“Looking back at the early days of big data, it’s clear a lot of people lacked a maturity around data quality,” said Hanson. “Many people working on AI initiatives wrongly assume that their AI engine will be able to remove inconsistencies and inaccuracies in their data automatically. This is not the case; if you put garbage in, you’ll get garbage out.”

Improving data quality

To enhance the quality of data, Hanson argued that enterprises should build a catalogue of assets. This drives informed decisions —  once you’ve got a centralised catalogue of assets, you can start to do things like bringing data together and making it searchable.

He said: “This is going to enable organisations to train their AI and ML algorithms with a more complete, more comprehensive and less biased sets of data.”

According to Hanson, this can be done by using good data engineering tools with AI built-in.

“What we actually need is not just artificial intelligence in the analytics layer — in terms of generating graphical views of data and making decisions in real-time around data — we need to make sure that we’ve got artificial intelligence in the backend to ensure we’ve got well-curated data going into our analytics engines.”

Information Age Roundtable: Developing a data and AI strategy

While much is known about creating a business strategy, creating a data and AI strategy is newer territory fraught with challenges

He warned that if organisations fail to do this, they won’t see the benefit of analytical AI going forward.

“In my opinion, a lot of mistakes could be made, some serious mistakes, if we don’t make sure that we train our analytical AI with high quality, well-curated data,” said Hanson.

He added, if the data sets aren’t good, then AI advocates in organisations are not going to get the results they expect. This could hinder any future investment in the technology.

The CTO role: ‘It’s about planning and business opportunities’

Greg Hanson, VP EMEA at Informatica, believes CTOs should be more focused on sales than the actual development of products

Next-gen solutions

However, Hanson is an optimist. He argued that thanks to the cloud and next-gen analytics, making data available in an AI-supported self-service manner to business analysts and data scientists has become more accessible.

“AI tools can now help to make sure that that propagation of data and the lifecycle of that data is tracked, traced and made available to organisations to help manage,” said Hanson. ”

Simply, AI has the potential to be used to pull insights from data sets, helping discover commercial opportunities. As well as assessing data readiness and technical feasibility.


Related articles

A guide to artificial intelligence in enterprise: Is it right for your business?

EU artificial intelligence guidelines will help unlock potential of AI technology

AI and data security: a help or a hindrance?

AI skills: 93% of organisations committed to AI but skills shortage is a challenge

The role of AI in cyber security

Artificial intelligence: What changed in 2018 and what to expect in 2019


Sign up for Information Age Newsletters

Latest news

divider
Tech and society
Dispatches from Davos 2020: Messages, meanings and more

Dispatches from Davos 2020: Messages, meanings and more

24 January 2020 / Davos 2020 is about unity. And the biggest unifying force this week that wove into [...]

divider
Digital Transformation
Why the perception of digital transformation needs to change

Why the perception of digital transformation needs to change

24 January 2020 / According to the Management Consultancies Association (MCA), management consultancy has grown by an additional 7% [...]

divider
Blockchain
Crypto Valley report shows rise in blockchain companies

Crypto Valley report shows rise in blockchain companies

24 January 2020 / The report’s fourth edition takes into account blockchain companies with over 4,400 employees, and includes [...]

divider
Telecoms
Telecoms is facing an unprecedented level of mobile network changeover

Telecoms is facing an unprecedented level of mobile network changeover

24 January 2020 / The telecoms sector is one of those industries that needs perpetual reinvestment. Every so often [...]

divider
Case Studies
Attraqt works with Bridewell Consulting to achieve ISO 27001 accreditation

Attraqt works with Bridewell Consulting to achieve ISO 27001 accreditation

24 January 2020 / Attraqt has achieved ISO 27001 accreditation. provides leading retailers with the ability to power exceptional [...]

divider
Tech and society
Dispatches from Davos 2020: Bring on the night, where the real deals get done

Dispatches from Davos 2020: Bring on the night, where the real deals get done

23 January 2020 / By day Davos is amazing, but as the sun drops below the alps, the air [...]

divider
AI & Machine Learning
How should we go about establishing strong AI regulation?

How should we go about establishing strong AI regulation?

23 January 2020 / This week, Alphabet CEO Sundar Pichai and IBM CEO Ginni Rometty called for AI to [...]

divider
Case Studies
SaaS transformation: Tax Automation partners with Pulsant

SaaS transformation: Tax Automation partners with Pulsant

23 January 2020 / Founded in 2001, Tax Automation has recently undergone a SaaS transformation. It is a software [...]

divider
Case Studies
Pulsant takes Cintra’s disaster recovery capability to the next level

Pulsant takes Cintra’s disaster recovery capability to the next level

23 January 2020 / Cintra HR & Payroll Services is a well-established, privately held business based in Gateshead that [...]

Do NOT follow this link or you will be banned from the site!

Pin It on Pinterest