IBM Cloud Docs
IBM Cloud networking and infrastructure

IBM Cloud networking and infrastructure

Physical structure

The physical infrastructure required to deploy a Red Hat® OpenShift® production instance onto a VMware Cloud Foundation for Classic - Automated cluster requires the following minimum specification.

VCF for Classic specification for Red Hat OpenShift
Item NFS deployment vSAN deployment
Number of servers 3 4
CPU 28 Cores 2.2 GHz 28 Cores 2.2 GHz
Memory (GB) 384 384
Storage 2,000 GB 2 IOPS/GB Management
2,000 GB 4 IOPS/GB Workload
4,000 GB 4 IOPS/GB
Min 960-GB SSD x2

In addition to the Red Hat OpenShift hardware requirements, you must create persistent volumes in the Red Hat OpenShift environment to store images from the container register or customer workloads.

Virtual structure

Physical structure
Physical structure

Within the VCF for Classic - Automated instance, the Red Hat OpenShift instance is deployed with a dedicated NSX® Edge Services Gateway (ESG) and Distributed Logical Router (DLR). The Red Hat OpenShift installation is loaded into the VXLAN subnet that is defined in the previous components.

The ESG is configured with a source NAT rule (SNAT) to allow outbound traffic, which enables internet connectivity to download the Red Hat OpenShift prerequisites and to connect to GitHub and Red Hat®. Alternatively, you can use a web-proxy for internet connectivity. The ESG is also configured to provide access to DNS and NTP services within the IBM Cloud® environment.

The ESG is also configured to use the load balancer capability, thus reducing the need for HAProxy nodes. The load balancers are configured for the apps wildcard DNS URL and the API / API-INT DNS Records. The apps DNS record load balancers to the worker nodes provisioned, while the api and api-int DNS records are load balanced against the control-plane nodes.

Red Hat OpenShift 4.1 installation on the VMware platform requires a capability to download their ignition files to install and configure the RHCOS bootstrap / control-plane and worker nodes. The ESG is configured to provide DHCP and DHCP relay services for the Red Hat OpenShift logical switch / VXLAN defined.

NSX Edge specifications

The first component that is configured within the VCF for Classic - Automated with Red Hat OpenShift is a pair of NSX Edge virtual machines. The NSX Edge virtual machines are configured as an active-passive pair of X-Large NSX Edge devices.

The Quad-Large NSX Edge was chosen and as part of the configuration process, the NSX Edge is connected to the IBM Cloud public and private VLAN.

NSX Edge specifications
Component Configuration
CPU 6 vCPU
RAM 8 GB
Disk 4.5 GB VMDK resident on shared storage with 4 GB swap

Because the NSX Edges are configured as active/passive in either the internal or dedicated deployment, vSphere® Distributed Resource Scheduler (DRS) anti-affinity rules must be created by the user to ensure that NSX Edges do not run on the same host as their respective peer appliance.

vSphere Distributed Resource Scheduler rules
Field Value
Name NSX Edge Red Hat OpenShift
Type Separate VMs
Members openshift-edge-0
openshift-edge-1

NSX Load Balancer specifications

Within the Red Hat OpenShift environment, two load balancers for accessing the control plane nodes and the worker nodes are required. The NSX Edge is enabled to use load balancing and is configured with application profiles that use a certificate for inbound connection from the source. The NSX Edge is also configured with load-balancing pools to point to the Red Hat OpenShift Primaries and Red Hat OpenShift Workers. Additionally, a virtual server is created with a virtual IP address (vIP) on the private interface with rules that connect the pools with vIP.

NSX load balancer specifications
Description Port number Algorithm Monitor Members Protocol IP subnet
Application load balancer 80 ROUND-ROBIN default_tcp_monitor Worker nodes TCP IBM Cloud 10.x
Application load balancer 443 ROUND-ROBIN default_tcp_monitor Worker nodes TCP IBM Cloud 10.x
API and API-INT load balancer 6443 ROUND-ROBIN default_tcp_monitor Bootstrap and primary nodes TCP IBM Cloud 10.x
API and API-INT load balancer 22623 ROUND-ROBIN default_tcp_monitor Bootstrap and primary nodes TCP IBM Cloud 10.x

Red Hat OpenShift specifications

The following tables show the specifications of the management node, control plane node, and worker node.

Management node specifications
Host description vCPU Memory (GB) Disk (GB) OS
Management0 2 8 50 Red Hat Enterprise Linux® 8.0
Control plane node specifications
Host description vCPU Memory (GB) Disk (GB) OS Hostname
Control-plane0 4 8 60 Red Hat Enterprise Linux CoreOS
Control-plane1 4 8 60 Red Hat Enterprise Linux CoreOS
Control-plane2 4 8 60 Red Hat Enterprise Linux CoreOS
Worker node specifications
Host description vCPU Memory (GB) Disk (GB) OS Hostname
Worker0 16 32 200 Red Hat Enterprise Linux CoreOS
Worker1 16 32 200 Red Hat Enterprise Linux CoreOS
Worker2 16 32 200 Red Hat Enterprise Linux CoreOS