Home > Workload Solutions > SAP > Guides > SAP HANA TDI Guides > Dell Validated Design for SAP HANA TDI with Dell Isilon All-Flash Scale-Out NAS > Preparing the SAP HANA nodes
Preparation of the SAP HANA nodes entails:
The configuration example in this guide assumes that the following basic installation and configuration operations are complete on the SAP HANA nodes:
Note: SAP HANA can be installed only on certified server hardware. A certified SAP HANA expert must perform the installation.
Prepare the /etc/hosts files
To achieve optimal performance, ensure that the SAP HANA mounts are evenly distributed across all available Isilon interface IPs in the /etc/hosts file. Because each Isilon node in a cluster provides two interfaces, each SAP HANA host’s storage partition (data and log directories) must mount with a different interface IP balance across the Isilon nodes. For more information, see Isilon network interfaces.
In the 2+1 SAP HANA system with SID HIB example, the mount points are in the /etc/fstab file on each of the SAP HANA clients, including any standby hosts. The following figure shows an example:
The operating system command mount –a mounts all the directories from the Isilon system and must be run on each SAP HANA client.
After all the file systems are mounted, you are ready to install the SAP HANA scale-out cluster.
Our example uses the hdblcm command-line tool to install the SAP HANA 2+1 scale-out cluster. For more information about this tool, see the SAP HANA Studio Installation and Upgrade Guide.
After the SAP HANA installation DVD ISO file is extracted on a shared software repository file system that is mounted on all hosts, run the following command from the extracted installation folder:
//software/SAP_HANA2_SPS03_r33_IM/51053381/DATA_UNITS/HDB_LCM_LINUX_X86_64/hdblm
SAP HANA Lifecycle Management - SAP HANA Database 2.00.033.00.1535711040
************************************************************
Scanning software locations...
Detected components:
SAP HANA Database (2.00.033.00.1535711040) in /SAPShare/software/SAP_HANA2_SP3/SAP_HANA1_SPS03_r33_IM/51053381/DATA_UNITS/HDB_SERVER_LINUX_X86_64/server
SAP HANA Database Client (2.3.119.1535661774) in /SAPShare/software/SAP_HANA2_SP3/SAP_HANA1_SPS03_r33_IM/51053381/DATA_UNITS/HDB_CLIENT_LINUX_X86_64/client
Choose an action
Index | Action | Description
-----------------------------------------------
1 | install | Install new system
2 | extract_components | Extract components
3 | Exit (do nothing) |
Enter selected action index [3]: 1
SAP HANA Database version '2.00.033.00.1535711040' will be installed.
Select additional components for installation:
Index | Components | Description
---------------------------------------------------------------------------------------------
1 | all | All components
2 | server | No additional components
3 | client | Install SAP HANA Database Client version 2.3.119.1535661774
4 | studio | Install SAP HANA Studio version 2.3.41.000000
5 | smartda | Install SAP HANA Smart Data Access version 2.00.3.000.0
6 | xs | Install SAP HANA XS Advanced Runtime version 1.0.88.12598
7 | afl | Install SAP HANA AFL (incl.PAL,BFL,OFL) version 2.00.033.0000.1535724035
8 | eml | Install SAP HANA EML AFL version 2.00.033.0000.1535724035
9 | epmmds | Install SAP HANA EPM-MDS version 2.00.033.0000.1535724035
Enter comma-separated list of the selected indices [3]:
Enter Installation Path [/hana/shared]:
Enter Local Host Name [r640-isi01]:
Do you want to add hosts to the system? (y/n) [n]: y
Enter comma-separated host names to add: r640-isi02,r640-isi03
Enter Root User Name [root]:
Collecting information from host 'r640-isi02'...
Collecting information from host 'r640-isi03'...
Information collected from host 'r640-isi03'.
Information collected from host 'r640-isi02'.
Select roles for host 'r640-isi02':
Index | Host Role | Description
-------------------------------------------------------------------
1 | worker | Database Worker
2 | standby | Database Standby
….
Enter comma-separated list of selected indices [1]: 1
Enter Host Failover Group for host 'r640-isi02' [default]:
Enter Storage Partition Number for host 'r640-isi02' [<<assign automatically>>]:
Enter Worker Group for host 'r640-isi02' [default]:
Select roles for host 'r640-isi03':
Index | Host Role | Description
-------------------------------------------------------------------
1 | worker | Database Worker
2 | standby | Database Standby
….
Enter comma-separated list of selected indices [1]: 2
Enter Host Failover Group for host 'r640-isi03' [default]:
Enter Worker Group for host 'r640-isi03' [default]:
Enter SAP HANA System ID: HIB
Enter Instance Number [00]:
Enter Local Host Worker Group [default]:
Index | System Usage | Description
-------------------------------------------------------------------------------
1 | production | System is used in a production environment
2 | test | System is used for testing, not production
3 | development | System is used for development, not production
4 | custom | System usage is neither production, test nor development
Select System Usage / Enter Index [4]:
Enter Location of Data Volumes [/hana/data/HIB]:
Enter Location of Log Volumes [/hana/log/HIB]:
Restrict maximum memory allocation? [n]:
Enter Certificate Host Name For Host 'r640-isi01' [r640-isi01]:
Enter Certificate Host Name For Host 'r640-isi02' [r640-isi02]:
Enter Certificate Host Name For Host 'r640-isi03' [r640-isi03]:
Enter System Administrator (hibadm) Password:
Confirm System Administrator (hibadm) Password:
Enter System Administrator Home Directory [/usr/sap/HIB/home]:
Enter System Administrator Login Shell [/bin/sh]:
Enter System Administrator User ID [1001]:
Enter System Database User (SYSTEM) Password:
Confirm System Database User (SYSTEM) Password:
Restart system after machine reboot? [n]:
……..
Do you want to continue? (y/n): y
Installing components...
Installing SAP HANA Database...
Preparing package …..
Creating System...
Extracting software...
Installing package
Starting SAP HANA Database system...
All server processes started on host 'r640-isi01' (worker).
Importing delivery units...
Adding 2 additional hosts in parallel
Adding host 'r640-isi03'...
Adding host 'r640-isi02'...
r640-isi02: Adding host 'r640-isi02' to instance '00'...
r640-isi03: Adding host 'r640-isi03' to instance '00'...
r640-isi02: Starting SAP HANA Database...
r640-isi03: Starting SAP HANA Database...
r640-isi03: All server processes started on host 'r640-isi03' (standby).
r640-isi02: All server processes started on host 'r640-isi02' (worker).
Installing Resident hdblcm...
Installing SAP HANA Database Client...
….
Registering SAP HANA Database Components on Local Host...
Regenerating SSL certificates...
Deploying SAP Host Agent configurations...
Updating SAP HANA Database Instance Integration on Remote Hosts...
Updating SAP HANA Database instance integration on host 'r640-isi02'...
Updating SAP HANA Database instance integration on host 'r640-isi03'...
Creating Component List...
SAP HANA Database System installed
Log file written to '/var/tmp/hdb_HIB_hdblcm_install_2018-11-06_21.03.03/hdblcm.log' on host 'r640-isi01'.
Optimizing file I/O after the SAP HANA installation
The base layer of SAP HANA provides two file I/O interfaces:
Configure the SAP HANA file I/O layer with configuration parameters to optimize file I/Os for a specific storage array and file system. The NFSv3 file system is used with Dell Isilon F800 storage systems for the SAP HANA persistence.
After the SAP HANA persistence is installed on the Isilon directories, set the following file I/O layer parameters for optimal I/O processing:
After the initial SAP HANA installation is complete, set the parameters by running the SAP HANA hdbparam command as <sid>adm in the Linux shell:
su - <sid>adm
hdbparam –p # lists current parameter setting
hdbparam –-paramset fileio [DATA].max_parallel_io_requests=256
hdbparam –-paramset fileio [LOG].max_parallel_io_requests=256
hdbparam –-paramset fileio [DATA].async_read_submit=on
hdbparam –-paramset fileio [LOG].async_read_submit=on
hdbparam –-paramset fileio [DATA].async_write_submit_blocks=all
hdbparam –-paramset fileio [LOG].async_write_submit_blocks=all
hdbparam –-paramset fileio [DATA].num_submit_queues=8
hdbparam –-paramset fileio [LOG].num_submit_queues=8
hdbparam –-paramset fileio [DATA].num_completion_queues=4
hdbparam –-paramset fileio [LOG].num_completion_queues=4
SAP HANA 2.0
Starting from SAP HANA 2.0, the hdbparam command-line tool was deprecated. Instead, the parameters are defined in global.ini > [fileio].
Using the SQL console in SAP HANA Studio, use the following commands to set the parameters max_parallel_io_requests=256, num_submit_queues=8 and num_completion_queues=4 in the global.ini file:
ALTER SYSTEM ALTER CONFIGURATION ('global.ini', 'SYSTEM') SET ('fileio','max_parallel_io_requests[DATA]') = '256';
ALTER SYSTEM ALTER CONFIGURATION ('global.ini', 'SYSTEM') SET ('fileio','max_parallel_io_requests[LOG]') = '256'
ALTER SYSTEM ALTER CONFIGURATION ('global.ini', 'SYSTEM') SET ('fileio','num_submit_queues[DATA]') = '8';
ALTER SYSTEM ALTER CONFIGURATION ('global.ini', 'SYSTEM') SET ('fileio','num_submit_queues[LOG]') = '8';
ALTER SYSTEM ALTER CONFIGURATION ('global.ini', 'SYSTEM') SET ('fileio','num_completion_queues[DATA]') = '4';
ALTER SYSTEM ALTER CONFIGURATION ('global.ini', 'SYSTEM') SET ('fileio','num_completion_queues[LOG]') = '4' WITH RECONFIGURE
The following figure shows the fileio section of global.ini after the parameters are set:
Both async_read_submit=on and async_write_submit_blocks=all are set by default during installation. For more information, see SAP Note 2399079—Elimination of hdbparam in SAP HANA 2 (access requires an SAP username and password).
Note: The instructions that are provided in this guide for tuning file I/O parameters are based on SAP HANA 1.0 and SAP HANA 2.0 SPS03. See the latest SAP HANA documentation for any updates.