Implementing vSphere Metro Storage Cluster using Hitachi Storage Cluster for VMware vSphere (2073278)
This article provides information about deploying a metro storage cluster across two data centers using Hitachi Virtual Storage Platform (VSP) or Hitachi Unified Storage VM (HUS VM). With vSphere 5.1, a storage virtualization device can be supported in a metro storage cluster configuration.
What is vSphere Metro Storage Cluster?
vSphere Metro Storage Cluster is a storage configuration for VMware vSphere environments. A product must be certified via the VMware vMSC certification process, after which it is recognized with a unique hardware compatibility list category. All supported storage devices are listed in the VMware Storage Compatibility Guide.
What is Hitachi Virtual Storage Platform?
Hitachi Virtual Storage Platform (VSP) is the first 3-D scaling storage platform designed for all data types. Its storage architecture flexibly adapts for performance, capacity, and multivendor storage.
- Scale Up — Meet increasing demands by dynamically adding processors, connectivity, and capacity in a single unit. Provide the highest performance for both open and mainframe environments.
- Scale Out — Meet multiple demands by dynamically combining multiple units into a single logical system with shared resources. Support increased demand in virtualized server environments. Ensure safe multitenancy and quality of service through partitioning of cache and ports.
- Scale Deep — Extend storage value by virtualizing new and existing external storage systems dynamically. Extend the advanced functions of Hitachi Virtual Storage Platform to multivendor storage. Offload less-demanding data to external tiers to save costs and to optimize the availability of tier-1 resources.
Two VSP storage systems can be configured in a stretched metro cluster configuration by leveraging built-in features such as Hitachi High Availability Manager and Hitachi TrueCopy® Remote Replication bundle. This stretched configuration can provide service to 2 data centers located within 300 kilometers of one another. Data volumes, including VMFS datastores, in this stretched configuration are highly available, and can be accessed by vSphere hosts on both sites simultaneously. In case of a site failure, the remaining data center VSP storage system continues to provide I/O access to the data volumes.
What is Hitachi Unified Storage VM (HUS VM)?
Hitachi Unified Storage VM is an entry-level enterprise storage platform. It combines storage virtualization services with unified block, file, and object data management. This versatile, scalable platform offers a storage virtualization system to provide central storage services to existing storage assets.
Unified management delivers end-to-end central storage management of all virtualized internal and external storage on Unified Storage VM. A unique, hardware-accelerated, object-based file system supports intelligent file tiering and migration, as well as virtual NAS functionality, without compromising performance or scalability.
The benefits of Unified Storage VM are:
- Enables the move to a new storage platform with less effort and cost when compared to the industry average
- Increases performance and lowers operating cost with automated data placement
- Supports scalable management for growing and complex storage environments while using fewer resources
- Achieves better power efficiency and with more storage capacity for more sustainable data centers
- Lowers operational risk and data loss exposure with data resilience solutions
- Consolidates management with end-to-end virtualization to prevent virtual server sprawl
Two HUS VM storage systems can be configured in a stretched metro cluster configuration by leveraging built-in features such as Hitachi High Availability Manager and Hitachi TrueCopy® Remote Replication bundle. This stretched configuration can provide service to 2 data centers located within 300 kilometers of one another. Data volumes, including VMFS datastores, in this stretched configuration are highly available, and can be accessed by vSphere hosts on both sites simultaneously. In case of a site failure, the remaining data center HUS VM storage system continues to provide I/O access to the data volumes.
What are Hitachi High Availability Manager and the Hitachi Availability Manager quorum disk?
Built on the way VSP and HUS VM manage virtualized devices, Hitachi High Availability Manager administers internal storage and externally attached heterogeneous storage with common and integrated management. It is used in conjunction with Hitachi TrueCopy storage system-based replication technology, which synchronizes data between the designated primary copy, or P-VOL, and the remote secondary copy, or S-VOL.
Hitachi Dynamic Link Manager (HDLM) is multipathing software that integrates with Hitachi High Availability Manager (HAM) to provide load balancing and path failover capabilities for vSphere hosts (HDLM SATP and HDLM PSP). HDLM will load-balance I/O between all available paths from P-VOL and keep all paths to S-VOL as standby paths.
A 47MB LUN is created on an external storage array such as Hitachi Unified Storage 150 (HUS 150) or other supported external 3rd-party storage array for use as a quorum disk. This LUN is presented to the Site 1 VSP/HUS VM and Site 2 VSP/HUS VM as externalized storage by virtue of VSP/HUS VM storage virtualization device capability. The quorum disk stores continually updated information about data consistency in Hitachi High Availability Manager for use during site failover operations. High Availability Manager uses the information in the event of a failure, to direct host operations to the secondary volume.
The following requirements must be satisfied to support this configuration:
- The round-trip latency between the Ethernet networks in the two sites must be less than 10 milliseconds (uniform host access). The IP network supports the VMware ESXi hosts and the VSP/HAM management interface.
- The round-trip latency for synchronous storage replication must be less than 5 milliseconds.
- The minimum throughput available between the two sites should be 622 Mbps, in order to support vMotion of virtual machines across ESXi hosts spread across both data centers.
- The ESXi hosts in both data centers must have a private network on the same IP subnet and broadcast domain.
- VMware vCenter must be accessible from all vSphere hosts on both sites.
- The same IP network on which the virtual machines reside must be accessible to ESXi hosts on both sites, so that clients accessing virtual machines running on ESXi hosts on both sites are able to function smoothly upon any VMware HA-triggered virtual machine restart event.
- The data storage locations, including the boot device used by the virtual machines, must be accessible from ESXi hosts in both data centers.
- The maximum number of vSphere hosts in the HA cluster must not exceed 32.
- Hitachi Dynamic Link Manager v7.6 or newer is required.
- Hitachi Virtual Storage Platform microcode v70.06 or newer is required.
- Hitachi HUS VM microcode v73.01 or newer is required
· Both sites must use the same array; either both sites should have a VSP, or both sites should have a HUS VM in order to support vMSC configurations.
- The Hitachi Storage Cluster for VMware vSphere solution only supports uniform host access, meaning that the vSphere hosts at each site can access the VSP/HUS VM P-VOLs provisioned from the opposite site.
For any additional requirements for Hitachi Storage Cluster, see the “Deploy VMware vSphere Metro Storage Cluster on Hitachi Virtual Storage Platform” reference architecture document.
A VMware vSphere Metro Storage Cluster architecture on Hitachi Virtual Storage Platform or Hitachi Unified Storage VM provides an ideal solution for maximizing availability and uptime by clustering physical data centers within metro distances. The metro storage cluster solution from Hitachi Data Systems consists of storage systems presenting replicated storage as a single LUN from different geographically distributed sites. This design enables high availability of services by allowing virtual machine migration between sites with no downtime.
A combination of Hitachi software and hardware provides the following key functions to a vSphere infrastructure:
- Host multipathing
- Internal and external storage provisioning
- Synchronous storage replication across metro cluster distances
- Storage failover
These functions work together with VMware vSphere vMotion, vSphere High Availability, and vSphere Distributed Resource Scheduler to build this solution for a VMware vSphere Metro Storage Cluster. The advanced functionalities found in Virtual Storage Platform fulfill the requirements of a virtual infrastructure and reduce the need for additional hardware that may be required in traditional metro storage cluster solutions.
This solution uses a uniform host access configuration. In a uniform host access configuration, a primary datastore is synchronously replicated to a read-only secondary datastore. ESXi hosts from different sites can access the storage devices on both sites, but see the two LUNs as a single datastore.
The following components create a VMware vSphere Metro Storage Cluster environment:
- vSphere 5.1 ESXi host servers — The physical hosts on both data centers running the virtual machines and managed by vCenter Server
- Hitachi Virtual Storage Platform — High-performance and highly scalable storage solutio
- Hitachi Unified Storage VM – Storage virtualization system designed to manage storage assets more efficiently
- Hitachi Unified Storage (HUS) or other supported 3rd-party storage systems — Midrange storage platform that provides reliable, flexible, scalable, and cost-effective modular storage, used by Hitachi High Availability Manager quorum disk
- Hitachi Dynamic Link Manager — Multipathing software that integrates with Hitachi High Availability Manager to provide load balancing and path failover capabilities for servers
- Hitachi TrueCopy® Remote Replication bundle — Synchronous storage replication between storage systems
- Hitachi High Availability Manager — Storage failover coordination; allows hosts to see a pair of replicated LUNs as a single datastore
- Fibre Channel switch — SAN connectivity to the datacenter storage network
- Network switch — LAN connectivity to the datacenter network
This image shows an overview of the VMware vSphere environment that has been tested for vMSC Certification: