HPC Halloween horrors: terrifying nightmares around the cobweb-like complexities of HPC storage

Todd Ruff, VP Corporate Marketing, Panasas, explores the cobweb-like complexities and Halloween nightmares often involved in HPC storage.   
Todd Ruff, VP Corporate Marketing, Panasas, explores the cobweb-like complexities and Halloween nightmares often involved in HPC storage.   

From rendering the latest horror film, to sequencing the genome of Frankenstein’s monster or carrying out simulations to make aeroplanes as streamlined as a ghost through a wall, HPC IT environments are the driving force behind a growing number of industries and use cases. According to the World Economic Forum, by 2025, an estimated 463 exabytes of data will be created on a daily basis. Organizations of all shapes and sizes, from governments to banks to automotive manufacturers, are taking advantage of this ever-growing mountain of data to make quicker and better-informed decisions. Indeed, the global HPC memory market is growing at an average rate of 7% and is expected to reach seven billion US dollars by 2023.

However, there is a dark side to this market: the majority of HPC storage solutions are shrouded in complexity, unreliability and frighteningly high costs. A global study by Hyperion Research highlights three ways in which organizations can become ensnared in a hair-raising high total cost of ownership.

1. The alarming cost of HPC storage staffing

Employees represent a monstrous cost factor for HPC storage; 18% of HPC storage installations each require four or more people to manage it, while almost 14% had expenditures of US$500,000 or more for HPC storage staff. For 38% of organizations, recruiting and training storage professionals alone was the most difficult operational aspect of HPC storage.

2. Installation and maintenance nightmares

Organizations are also haunted by complicated installation and maintenance tasks. Just 6% of organizations had their new HPC storage rigs up and running within a day, while 28% were still installing after a week. And the gremlins and goblins do not disappear once the storage system is up and running. Almost half had to tune and retune systems monthly, with 4% returning weekly (and 2% even daily!).

3. Spine-chilling outages

Last but certainly not least, the most petrifying of HPC horrors: outages. One-third of organizations suffered monthly failures and 8% weekly outages. 41% revealed that recovery took two days or longer. The expense of just a single day’s outage is blood-curdling: depending on company size, a day’s outage can cost up to, or even over, $1mn.

These entanglements of complex and unreliable storage trap organizations into a haunted house where they are victims of a shockingly high total cost of ownership, impacting their productivity and, ultimately, their bottom lines. As HPC storage installations increasingly tackle a broader range of use cases, the shortcomings of traditional approaches are becoming increasingly clear, and the hidden costs of HPC storage, such as staffing and outages, are harder to disguise or ignore.

READ MORE:

To avoid HPC storage costs spinning out of control, organizations must take a step back to re-evaluate their storage solutions and demand predictability, ease of use, and reliability from their technology providers to ensure that they have no skeletons hidden in their closets that may end up haunting the users later on.

For more news from Top Business Tech, don’t forget to subscribe to our daily bulletin!

Follow us on LinkedIn and Twitter

Amber Donovan-Stevens

Amber is a Content Editor at Top Business Tech

Custom Software Development

Natalia Yanchii • 04th October 2024

There is a wide performance gap between industry-leading companies and other market players. What helps these top businesses outperform their competitors? McKinsey & Company researchers are confident that these are digital technologies and custom software solutions. Nearly 70% of the top performers develop their proprietary products to differentiate themselves from competitors and drive growth. As...

The Impact of Test Automation on Software Quality

Natalia Yanchii • 04th October 2024

Software systems have become highly complex now, with multiple interconnected components, diverse user interfaces, and business logic. To ensure quality, QA engineers thoroughly test these systems through either automated or manual testing. At Testlum, we met many software development teams who were pressured to deliver new features and updates at a faster pace. The manual...

Custom Software Development

Natalia Yanchii • 03rd October 2024

There is a wide performance gap between industry-leading companies and other market players. What helps these top businesses outperform their competitors? McKinsey & Company researchers are confident that these are digital technologies and custom software solutions. Nearly 70% of the top performers develop their proprietary products to differentiate themselves from competitors and drive growth. As...

Six ways to maintain compliance and remain secure

Patrick Spencer VP at Kiteworks • 16th September 2024

With approximately 3.4 billion malicious emails circulating daily, it is crucial for organisations to implement strong safeguards to protect against phishing and business email compromise (BEC) attacks. It is a problem that is not going to go away. In fact, email phishing scams continue to rise, with news of Screwfix customers being targeted breaking at...

Enriching the Edge-Cloud Continuum with eLxr

Jeff Reser • 12th September 2024

At the global Debian conference this summer, the eLxr Project was launched, delivering the first release of a Debian derivative that inherits the intelligent edge capabilities of Debian, with plans to expand these for a streamlined edge-to-cloud deployment approach. eLxr is an open source, enterprise-grade Linux distribution that addresses the unique challenges of near-edge networks...
The Digital Transformation Expo is coming to London on October 2-3. Register now!