Introducing the New Standard for File in the Cloud

File data has experienced rapid growth in the data center. In fact, it often accounts for nearly 50 percent of the on-prem data footprint for an organization1. When it comes to the public cloud, adoption of file has been steady, but it is not as prevalent. This is a reflection of the state of the file services in the cloud today. As they become more mature and capable, more file-based workloads can be supported, and adoption will naturally accelerate.

This is why I’m excited to introduce as part of the Dell Technologies Cloud family OneFS for Google Cloud, a fully integrated and managed native cloud file service that combines the power and scale of OneFS with the economics and simplicity of Google Cloud. OneFS is the battle-hardened operating system of Dell EMC Isilon storage arrays, and the industry’s #1 scale-out NAS filesystem2.

The OneFS file service offers multi-protocol file access for NFS, SMB, and HDFS workloads. Capacity scales up to 50PB in a single namespace, with performance that scales along with it at a rate of 97 MB/s per TiB. Enterprise data management features include snapshots, native replication, Active Directory support, and high data durability and availability.

Organizations can now run high performance file workloads in the cloud to take advantage of Google Cloud’s elastic compute, GPU instances and analytics services – all without having to make any changes to their applications.

In addition, the OneFS file service is natively integrated with Google Cloud, making it simple and easy to use with predictable subscription-based pricing and guaranteed performance. Customers simply order it from the Google Cloud Marketplace, and once provisioned they can configure and manage their OneFS filesystems directly from the Google Cloud console. Customers receive a single monthly bill and support from Google while Dell Technologies experts manage the operations for you.

OneFS brings game-changing performance for file data in the public cloud

Based on third party performance testing with the IOzone benchmark, OneFS delivered sustainable read throughput of 200GB/s and write throughput of 120GB/s.

Now to put that in perspective, ESG compared these results to another NAS vendor offering file services in Google Cloud, and OneFS delivered: ​​

  • up to 46X higher maximum read throughput​3
  • up to 96X higher maximum write throughput​3
  • up to 500x higher maximum file system capacity3

Let’s take a closer look at the benchmark configuration and results.

Figure 1: IOzone Benchmark Configuration

ESG began testing with the goal of measuring maximum sequential read and write throughput, running the industry standard IOzone benchmark. A 512K block size was used emulate the data processing characteristics of large file workflows such as high-definition video post-production, seismic data analysis, IoT, and genomic processing. The benchmark ran on Google compute instances, each of which mounted a single 2PB file share over NFSv3, which was sized at a 2PB usable capacity.

The number of compute cores were scaled from 64 threads, doubling the thread count with each load step, up to 1024 threads where peak sustainable load was achieved, as shown in Figure 2. These I/O threads were hosted by 128 virtual machines at the peak, each having 8 CPUs (n1-standard-8 instances).

Figure 2: OneFS for Google Cloud Performance Scalability Benchmark Results

ESG validated that Dell Technologies Cloud OneFS for Google Cloud achieved a maximum read performance of 200 GB/s and maximum write performance of 120 GB/s against a 2PB storage volume1.

It is important to note that this is a scale-out filesystem, with linear scaling, which means if you want to double these performance numbers, double the size of the filesystem. OneFS can deliver massive throughput up to 945GB/s. ESG performed their benchmark runs with a 2PB configuration, and OneFS for Google Cloud scales up to 50PB. That’s the power of scale that we’re delivering!

You can now run your high-performance computing file workloads in the cloud – with an enterprise grade, scalable file service that can go the distance. The new standard for file data in the public cloud has been set. Imagine what that can do for accelerating your business.

Availability

OneFS for Google Cloud is available today. Customers in North America, Singapore and Sydney will be able to take advantage of OneFS for Google Cloud at launch, with additional global locations to be announced based on customer demand.

1Source: ESG, Performance Testing of Dell Technologies Cloud OneFS for Google Cloud, May 2020

2Source: IDC WW Quarterly Enterprise Storage Systems Tracker, 2019 Q4. Ranking by 4Q2019 vendor revenue

3Based on a May 2020 ESG Report commissioned by Dell EMC, “Performance Testing of Dell Technologies Cloud OneFS for Google Cloud”, estimate based on comparison of publicly available specifications and performance benchmarking results for a competing vendor’s NAS solution and Dell Technologies Cloud OneFS both on Google Cloud.  Actual results may vary. AD# G20000133 

About the Author: Joe CaraDonna

Joe CaraDonna is the CTO of Public Cloud and APEX Offerings at Dell Technologies. He is responsible for cloud strategy and technology innovation, driving development and execution of long-term technical vision and roadmap. Joe has over 25 years of experience in the technology industry, driving innovation ranging from enterprise storage systems, operating system technology, virtualization, software defined storage, and cloud solutions. Joe takes a customer-centric approach, seeking to understand customer goals and challenges to realize the technologies necessary to deliver impactful solutions to market.