Lead Image © sdecoret, 123RF.com
Computational storage that supports storage operations
Smart Assistant
ScaleFlux competes with NVMe-based drives by offering not only store but compute functions, as well. However, relieving the load on the CPU and ensuring higher bandwidth and lower latency comes at a greater price and begs one question: Is it worth the effort?
Where Is the Bottleneck?
Every server has a bottleneck that limits its performance somewhere, but the exact whereabouts of this bottleneck tends to differ because the manufacturers of the individual components have been playing a cat-and-mouse game for years. New CPUs usually come with new chipsets that enable higher bandwidths for the connected devices and RAM, which often makes the storage devices the bottleneck. The storage device manufacturers then follow suit and launch faster devices so that the network suddenly becomes the performance limit. The network in particular has seen major innovations in recent years, including the now widely available 400Gb Ethernet, which has quickly passed the buck back to storage devices.
The situation can become particularly critical when components interact, especially if these components happen to be exposed to a heavy compute load (e.g., database nodes, servers with running Hadoop or Redis instances, or members of an Elasticsearch cluster). Several factors come together. In particular, individual steps such as compressing and indexing data or cleaning up data records that are no longer needed require serious bandwidth on the connected storage medium on the one hand and high compute power on the part of the CPU on the other.
In the worst case, this leads to a single system slowing down an entire setup, such as when the central database can no longer respond to incoming queries or cannot respond quickly enough. Neither users nor administrators like this one bit, because – especially on the end-user side – using a service in this scenario is a pain.
The problem is not new, which
...
Buy this article as PDF
(incl. VAT)
Buy ADMIN Magazine
US / Canada
UK / Australia
Related content
-
A buyer's guide to NVMe-based storage
An all-flash NVMe-based data storage solution can contribute to a lean, powerful, and future-proof data center. -
How to query sensors for helpful metrics
Discover the sensors that already exist on your systems, learn how to query their information, and add them to your metrics dashboard. -
Energy efficiency in the data center
Storage systems are one of the biggest factors in power consumption, so data storage can make a massive difference in operating costs. We look at how you can achieve savings through technologies such as flash, tiered storage, or even cloud-native container environments. -
Storage protocols for block, file, and object storage
The future of flexible, performant, and highly available storage. -
Tuning ZFS for Speed on Linux
The ZFS filesystem and volume manager simplifies data storage management and offers advanced features that allow it to perform in mission-critical or high-performance environments.