Object Storage for Multi-Cloud Environments

Blue and white abstract wave-like brush stroke design

Successful multi-cloud storage strategies leverage architecture and tools capable of operating in a wide range of environments.

Public Cloud is an increasingly large field but starts with AWS, Azure, GCP, IBM, Alibaba, Tencent and government clouds. Your hybrid/multi-cloud storage software needs to run everywhere your application stack runs. Even companies that claim to run on a single cloud don’t - there are always other clouds. MinIO provides storage consistency across every public cloud provider, preventing the need to rewrite apps as you expand to new clouds.

Kubernetes is the primary software architecture for the modern private cloud. This includes all Kubernetes distributions, such as VMware (Tanzu), RedHat (OpenShift), Rancher/SUSE, HP (Ezmeral) and Rafay. Multi-cloud Kubernetes requires object storage that is software defined and cloud-native. The private cloud also includes more traditional bare-metal instances, but enterprise workloads are increasingly containerized and orchestrated.

The edge is about moving compute to where the data is produced. Once processed, data is moved to more centralized locations. Edge storage solutions must be lightweight, powerful, cloud-native and resilient to run in this multi-cloud architecture. It’s very difficult to do this well, which is why so few vendors discuss it, they don’t have a good answer - even Amazon.

Multi-Cloud Architecture with MinIO

Kubernetes-Native

Kubernetes-native design requires an operator service to provision and manage a multi-tenant object-storage-as-a-service infrastructure. Each of these tenants run in their own isolated namespace while sharing the underlying hardware resources. The operator pattern extends Kubernetes's familiar declarative API model with custom resource definitions (CRDs) to perform common operations like resource orchestration, non-disruptive upgrades, cluster expansion and to maintain high-availability.

MinIO is purpose-built to take full advantage of the Kubernetes architecture. Since the server binary is fast and lightweight, the MinIO Operator is able to densely co-locate several tenants without running out of resources. Gain multi-cloud prowess with portable Kubernetes-native storage that leverages the benefits of Kubernetes and the associated ecosystem.

Consistent

Hybrid/multi-cloud storage must be consistent across API compatibility, performance, security and compliance. It needs to perform consistently and independently from the underlying hardware. Any variation, even a tiny one, can break an application - creating massive operational burdens.

Because MinIO is so lightweight, we can roll out non-disruptive updates across public, private and edge in minutes, maintaining the same consistent experience. MinIO abstracts the underlying differences across these architectures including key management, identity management, access policies and hardware/OS differences.

Performant

Since object storage is utilized as both primary and secondary storage, it needs to deliver performance at scale. From mobile/web applications to AI/ML, data-heavy workloads require exceptional performance from the underlying object storage. Even data protection workloads require high-performance access for de-dupe and snapshots. No enterprise can afford a slow restore process. Traditionally, these workloads required bare-metal performance. Now it is possible to containerize all of these workloads - as demonstrated by the success of public cloud providers.

MinIO is the world’s fastest object store with READ/WRITE speeds of 325 GiB/s and 171 GiB/s on NVMe and 11 GiB/s and 9 GiB/s on HDD. At those speeds every workload is within reach of any multi-cloud architecture running on any infrastructur

Scalable

Many people think that scale simply refers to how big a system can get. What is lost in this thinking, however, is the importance of operational efficiency as the environment grows. A multi-cloud object storage solution must scale efficiently and transparently regardless of the underlying environment, and do so simply with minimal human interaction and maximum automation. This can only be accomplished by an API-driven platform built on top of a simple architecture.

MinIO’s relentless focus on simplicity means that large scale, multi-petabyte data infrastructure can be managed with minimal human resources. This is a function of APIs and automation, and creates an environment on which to create significantly scalable multi-cloud storage.

Software Defined

The only way to achieve success in the multi-cloud is with software defined storage. The reasons are simple. A hardware appliance does not run on a public cloud or on Kubernetes. A public cloud storage service offering is not designed to run on other public clouds, private clouds or Kubernetes platforms. Even if they did, bandwidth would cost more than the storage because they weren’t developed to replicate across networks. True, software-defined storage can run in the public cloud, private cloud and at the edge.

MinIO was born as software and is portable across a variety of operating systems and hardware architectures. Evidence can be found in our 2M+ IPs running across AWS, GCP and Azure.