QuantaStor for VMware Architecture Guide
You can order and configure the OSNexus QuantaStor shared storage solution for a VMware ESXi 5 environment. Use the following information along with the Advanced Single-Site VMware Reference Architecture cookbook to set up one of these storage options in your VMware environment.
Before you begin
Make sure that you have any necessary account permissions and device access. Only the account owner, or a user with the Manage Users classic infrastructure permission, can adjust the permissions.
Step 1: Ordering QuantaStor Shared Storage
Before you place an order for storage, you need to determine the specifications that meet your capacity, performance, and redundancy requirements. These specifications can include processor and chassis choice, QuantaStor license capacity, server RAM, type and number of data disk drives, type and number of cache disks, and networking configuration and other specifications. For more information about choosing the correct QuantaStor configuration in your environment, see QuantaStor Solution Design Guide for Virtualization.
Make sure that you understand the capacity and I/O requirements of your VMs before you place your order. While the QuantaStor server is expandable, it is important that you size your hardware initially to avoid delays in configuration and deployment.
Ordering QuantaStor
Complete the following steps to order a 24 TB usable QuantaStor hybrid system that is tuned for mid-range performance for VMware workloads:
- Log in to IBM Cloud® infrastructure customer portal and click Account > Place an Order.
- Select Bare Metal Servers, Monthly.
- Enter the following configuration options:
- Data Center: Location of the VLANs and ESXi hosts that were previously created
- Server: 36-bay chassis with Dual Processor Xeon
- RAM: 128 GB
- Operating System: OSNEXUS QuantaStor 5.x (48 TB)
- Hard disk drives:
- OS Disks: 2 x 960 GB SSD in RAID 1
- Data Disks: 24 x 2 TB SATA in Individual
- Log Disks: 2 x 960 GB SSD in Individual
- Cache Disks: 2 x 960 GB SSD in Individual
- Public Bandwidth: Private Network Only
- Uplink Port Speeds: 10 Gbps Redundant Private Network Uplinks
- Click Continue Your Order.
The storage server is configured with two network interfaces that are unbonded so that two different subnets can be used to load balance traffic to the storage array.
Finishing Configuration
You now have a QuantaStor appliance in your shopping cart. Assign the private VLAN, hostname, and domain to the device so it can be provisioned correctly.
- Assign the following VLANs and create hostnames for the devices: QuantaStor host – Backend VLAN: (1102 in the environment)
- Select your payment method, agree to the Terms and Conditions, and click Finalize Your Order.
Do not proceed to Step 3 until the server is provisioned and is accessible through VPN or virtual server.
Step 2: Enabling iSCSI Software Adapter for VMware Hosts
The iSCSI Software Adapter must be enabled on each management and capacity host and its iSCSI Qualified Name (IQN) collected before iSCSI volumes are mounted. Use the following steps to enable the iSCSI software adapter:
- Go to an ESXi management or capacity host and select Manage, Storage, Storage Adapters.
- Click the green plus sign (+) and add the iSCSI Software Adapter.
- Click the vmhba that corresponds to the iSCSI Software Adapter and record the iSCSI Name (Figure 1) in the Adapter Details section after it is enabled.
- Do steps 1 - 3 for each iSCSI Software Adapter on each ESXi host.
Step 3: Configuring QuantaStor
After the QuantaStor server is provisioned, you can set up networking, create pass-through (RAID0) units, build the storage pool, create iSCSI volumes, and finally assign those volumes to hosts.
For example, volume vmk3 has vmnic0 that connects to Portable Private Subnet A on the storage VLAN. Volume vmk4 has vmnic2 that connects to Portable Private Subnet B on the storage VLAN. The QuantaStor server also has two private network adapters, eth4, and eth6, that connect to the storage VLAN.
Configuring Networking
- Open a web browser and go to the QuantaStor IP address listed on the Devices page.
- Enter the Admin username and Password (found in the Passwords section on the Device Details page). Before you proceed, note the private network devices that are used by the QuantaStor server, such as eth4.
- Go to Storage System > Network Ports.
- Select the private adapter that is active (example: eth4) from the list of network adapters. Right-click and select Modify Network Port from the menu.
- Clear the iSCSI Enabled checkbox to disable iSCSI connections to this adapter and click OK.
- Select the private adapter that is not active, but is assigned to the private network (example eth6).
- Right-click on the eth6 adapter and select Modify Network Port from the menu.
- Select a Config Type of Static on the Modify Network Port screen.
- Enter a primary private IP address, subnet, and gateway for the adapter. Use an address from the Storage row if you are using the VLAN worksheet from the Advanced Single-Site VMware Reference Architecture cookbook.
- Clear the iSCSI Enabled checkbox to disable iSCSI connections to this adapter.
- Right-click the private adapter and select Enable Network Port to bring the adapter online after you configure it with an IP address.
- Click OK to enable the port upon verifying the IP address.
Opening a Support Ticket
You need to open a support ticket after you configure a second adapter with a primary private IP address. Opening the ticket helps make sure that the IP address that you used is not taken if another system is provisioned on the VLAN.
- Click Support > Add Ticket and enter the following information:
- Subject: Private network question
- Title: Reserve and assign a private IP address
- Associate Devices: 'Select the QuantaStor server'
- Details: Reserve and assign on VLAN. This IP address is used for the second adapter on the QuantaStor server.
Configuring QuantaStor
Now that the array can accept connections from both adapters, the adapters’ virtual interfaces that are on the Storage Path A and Storage Path B subnets must be assigned.
- Right-click the initial private adapter interface (eth4) and select Create Virtual Interface on the menu.
- Enter a portable private IP address and subnet for the adapter on the resulting screen, and make sure that iSCSI Enabled is checked.
- If you are using the VLAN worksheet, use an address from the Storage Path A row.
- Record the IP address that is used in the Notes section on the Portable IP address page.
- Select the initial private adapter interface (eth4) to bind the virtual interface and click OK.
- Right-click the other private adapter interface (eth6) and select Create Virtual Interface on the menu.
- Enter a portable private IP address and subnet for the adapter and make sure that iSCSI enabled is checked on the resulting window.
- If you are using the VLAN worksheet, use an address from the Storage Path B row.
- Record this IP address as used in the Notes section on the Portable IP address page.
- Select the other private adapter interface (eth6) to bind the virtual interface and click OK.
After the QuantaStor server is configured with IP addresses and virtual interfaces, configure the routing to make sure that the outgoing traffic uses the correct interface. Two NICs are on different subnets.
- SSH into the QuantaStor server with your root credentials and append the following lines to /etc/network/interfaces. Assuming eth4 and eth6 are the NICs on the private network:
- post-up ip route add 10.0.0.0/8 on dev eth4
- post-up ip route add 10.0.0.0/8 on dev eth6 table eth6
- post-up ip rule adds from table eth6
Configure pass-through (RAID0) Units
** Depending on provisioning, the physical disks might not be exposed to QuantaStor. You can check by clicking the Physical Disks section and looking at the list of available hard disk drives. If you do not see the correct number of drives, follow these steps:
- In the Hardware Controller menu, click Controllers & Enclosures > **Create pass-through Units.
- Verify host and controller and click OK.
- After the task completes, click Physical Disks and verify.
Creating a Storage Pool
Next, you must create a storage pool that is used to allocate volumes before you can create volumes or shares.
- Right-click Storage Pools and select Create Storage Pool.
- Enter the following information on the Create Storage Pool screen:
- Name: Enter the appropriate name for the storage pool. Example: StoragePool-01
- Pool Type: Default (zfs)
- I/O Profile: Virtualization
- Disks to use for the Storage Pool: check all the data disks (do not check SSDs).
- Click OK.
Creating iSCSI Storage Volumes
You need to create two storage volumes. One volume is used for management VMs on the management cluster and the other for VMs on the capacity cluster. Complete the following steps to create the iSCSI storage volumes:
-
Right-click Storage Volumes and select Create Storage Volume on the menu.
-
Enter the information for the storage volumes.
While your configuration might differ depending on workload and storage capacity, the example shows the values in Table 1 and Table 2 for each storage volume.
Field | Value |
---|---|
Name | Mgmt-LUN0 |
Storage Pool | [Storage Pool Name configured in the previous step] |
Size | 1 TB |
% Reserved | 0-100 |
Compression | Enabled |
Field | Value |
---|---|
Name | Capacity-LUN0 |
Storage Pool | [Storage Pool Name configured in the previous step] |
Size | 40 TB |
% Reserved | 0-100 |
Compression | Enabled |
Assigning Host Access to Volumes
You need to configure QuantaStor to allow access from the ESXi hosts through each host’s IQN after the volumes are set up.
- Go to the QuantaStor administration page and right-click the Hosts menu and select Add Host.
- Enter the following information on the Add Host screen:
- Hostname: Enter an appropriate hostname. The hostname does not have the fully qualified domain name (FQDN), but it must describe the host. Example: MyESXiHostName
- Operating System Type: VMware
- Initiator: iSCSI Qualified Name (IQN)
- iSCSI Qualified Name: The IQN for the respective host.
- Click OK.
Follow these steps for each host in an ESXi environment. After you add each host in the management and capacity clusters, follow these steps:
- Right-click the Host Groups menu and select Create Host Group.
- Enter `ManagementCluster in the Name field and select all the hosts that are in the management cluster.
- Click OK. A host group is created that we can assign to a particular volume.
Repeat this process for the capacity cluster.
- Click the Storage Volumes menu.
- Right-click the Mgmt-Lun0 volume and select Assign or Unassign Host Access.
- Confirm that Mgmt-Lun0 is an option in the menu and select the host group that you created in the previous step. This option allows each ESXi host in the management cluster to access the Mgmt-Lun0 volume. Do the same for Capacity-LUN0.
Step 4: Mounting Volumes on Management and Capacity Clusters
Log in to the vSphere web client and go to Hosts under the vCenter Inventory Lists.
Use the following steps to mount the volume on the ESXi hosts:
- Select a host and click Manage, Storage, > Storage Adapters.
- Select Targets > Dynamic Discovery > Add….
- Enter the IP address that is assigned to the QuantaStor storage device on Storage Path A on the Add Send Target Server screen.
- Leave 3260 as the Port and click OK.
- Click Dynamic Discovery > Add…. Repeat steps 4 and 5 for Storage Path B.
The ESXi host is ready to rescan the iSCSI Software Adapter to discover the Mgmt-Lun0 volume.
- Select the Rescan Storage Adapters icon (Figure 9) on the Storage Adapters screen.
- Leave the default option on the resulting screen and click OK.
- Click Actions, New data store after the volume is discovered and format it as VMFS-5.
- Confirm that the formatting is complete and click Storage Devices, Device Details, Edit Multipathing….
- Select Round Robin for the Path Selection Policy and click OK.
Now that the Mgmt-Lun0 volume is attached to a single host, you must go back to the other management hosts in the cluster and repeat the process to add the volume. You do not need to format the volume as it is already formatted with VMFS-5 and is displayed as such after discovery.
Step 5: Disabling Delayed ACK in vSphere ESXi hosts
The delayed ACK needs to be disabled after the storage LUNs are attached to the management and capacity hosts.
- Go to the vSphere environment and select Storage Adapters > iSCSI Software Adapter > Advanced Options.
- Click Edit and scroll all the way to the end of the Advanced Options screen.
- Clear the DelayedAck checkbox and click OK.
You can now return to the Advanced Single-Site VMware Reference Architecture cookbook and complete the environment setup.