Deploy the ARTESCA Operating System¶
This page outlines the step-by-step process to install and configure the ARTESCA Operating System (OS) on your servers.
The ARTESCA OS is based on the Rocky Linux distribution and is required for ARTESCA installation. It is maintained as part of ARTESCA deployment and upgrade.
Important
Using a Rocky Linux, or any other OS distribution is not supported, and will fail.
Do not tune, or reconfigure ARTESCA OS except as recommended by Scality.
Do not install any software except as recommended by Scality.
Tip
If you are based in the Asia-Pacific region, you may want to use this link to download the ARTESCA OS package.
To guarantee the best performance and compatibility, install the OS according to the following workflow:
Read the Prerequisites to ensure your server is ready for the OS installation.
Proceed with the Operating System Installation.
Perform the Readiness Checks to ensure the new server is set up correctly.
Continue the ARTESCA deployment with the Next Step.
Prerequisites¶
Hostname¶
Important
To avoid DNS issues you must use flat hostnames
such as storage001 and avoid compound hostnames such s001.storage.
Hostnames of servers must conform to the RFC 1123 and RFC 952 requirements.
It means they must contain only lowercase alphanumeric characters, '-',
and start and end with an alphanumeric character. They must also not be longer than 52 characters.
If your naming scheme does not allow these requirements, you will be able to use alternate names for nodes, when generating the installer configuration.
Additional Drive Formatting¶
During installation, partitioning will run automatically for the target operating system drive. DATA disks, HDDs, and SSDs used for ARTESCA data and metadata are handled directly by the ARTESCA installer at a later stage.
Service disks are set under RAID 1 during the hardware preparation. Refer to ARTESCA Service Drives for more information.
Required Information for Installation¶
Before starting OS installation, gather the following information:
IP address/netmask for control and workload plane interfaces
Default network route
DNS server(s)
Target server hostname
Local timeserver(s)
System timezone
An
artesca-osaccount credentials
Operating System Installation¶
For virtual machines, you need to follow the Virtual Machine Node Preparation section to create the virtual machine with the ARTESCA OS.
Proceed to the standard ARTESCA OS installation using the ARTESCA OS ISO (if you are based in the Asia-Pacific region, you may want to use this link instead).
Boot the server from the installation media, the following screen appears:
Select Install ARTESCA OS.
Press Enter to start the installation.
OS Disk Partitioning¶
Important
If you are using Optimized Boot Drives (BOSS, NS204i, etc.), ensure they are configured using hardware RAID 1 before initiating the installation, if applicable (refer to Hardware Node Preparation / Storage). If not, we recommend letting the installation handle the partitioning as described below.
During the boot, disks are automatically detected and partitioned. If the disk topology does not match the expected one (for example, 1 or 2 disks of 480GB), the installation will ask you which disk(s) to use for the OS installation.
Warning
In rare cases, the detection fails to find suitable disks for the OS installation or the installation fails due to pre-existing partitions on the disks that cannot be wiped automatically.
In these cases, follow Manual OS Partitioning Recovery.
Installation Summary¶
Once disk partitioning is completed, the installation summary page appears. You need to configure the following options before starting the installation:
Time and date are configured with the right NTP Servers.
Network and host management have bond interfaces for workload plane and control plane.
Keyboard layout should be set according to your site policy.
System users are pre-provisioned.
Note
Partitioning is already done, so you have to leave it as is, even if warnings appear.
Network Interfaces¶
Network interfaces must be configured using the Anaconda GUI following this procedure (depending on your network environment).
Note
In either single or dual network configurations —provided it is supported by your router/switch—, there are no restrictions on the number of VLAN tags on an interface.
Define the Host Name and click Apply. Ensure it actually updates the Current host name.
Important
To avoid DNS issues you must use flat hostnames such as
storage001and avoid compound hostnames suchs001.storage.
Click the + button.
Select the Bond device and click Add.
Set the bond information and click Save.
Note
The 802.3ad (LACP) is the recommended mode but it needs some configuration on your switches. In case you cannot apply those, use the Active backup mode.
Add the bonding slaves by clicking Add, keep the Ethernet connection type, and click Create….
Set the slave information and click Save.
Repeat the two previous steps to add the other bonding slaves.
Ensure you have the list of slaves as expected, then go to IPv4 Settings.
Set the IPv4 address information.
Set Ignore for IPv6 and click Save.
Ensure the interfaces are properly set up and click Done.
Warning
If you are using 802.3ad (LACP) to have proper aggregation, after the OS installation, you will need to change the bond options using the following commands.
[artesca-os@bootstrap ~]$
sudo nmcli con mod bond-artesca bond.options mode=802.3ad,miimon=100,lacp_rate=1,xmit_hash_policy=layer3+4
sudo nmcli con up bond-artesca
Define the Host Name and click Apply. Ensure it actually updates the Current host name.
Important
To avoid DNS issues you must use flat hostnames such as
storage001and avoid compound hostnames suchs001.storage.
Click the + button.
Select the Bond device and click Add.
Set the bond information and click Save.
Note
The 802.3ad (LACP) is the recommended mode but it needs some configuration on your switches. In case you cannot apply those, use the Active backup mode.
Add the bonding slaves by clicking Add, keep the Ethernet connection type, and click Create….
Set the slave information and click Save.
Repeat the two previous steps to add the other bonding slaves.
Ensure you have the list of slaves as expected, then go to IPv4 Settings.
Set Disabled for IPv4 on this bonding interface and click Save.
Set Ignore for IPv6 and click Save.
Click the + button to add the VLAN interface.
Select VLAN and click Add.
Set the VLAN information and click Save..
Set the IPv4 address information and click Save..
Important
To avoid DNS issues, do not set any
search domains.
Set Ignore for IPv6 and click Save.
Ensure the interface are properly set up and click Done.
Warning
If you are using 802.3ad (LACP) to have proper aggregation, after the OS installation, you will need to change the bond options using the following commands.
[artesca-os@bootstrap ~]$
sudo nmcli con mod bond-artesca bond.options mode=802.3ad,miimon=100,lacp_rate=1,xmit_hash_policy=layer3+4
sudo nmcli con up bond-artesca
Define the Host Name and click Apply. Ensure it actually updates the Current host name.
Important
To avoid DNS issues you must use flat hostnames such as
storage001and avoid compound hostnames suchs001.storage.
Click the + button.
Select the Bond device and click Add.
Set the bond information and click Save.
Note
The 802.3ad (LACP) is the recommended mode but it needs some configuration on your switches. In case you cannot apply those, use the Active backup mode.
Add the bonding slaves by clicking Add, keep the Ethernet connection type, and click Create….
Set the slave information and click Save.
Repeat the two previous steps to add the other bonding slaves.
Ensure you have the list of slaves as expected, then go to IPv4 Settings.
Set the IPv4 address information.
Note
You cannot have 2 gateways. Ensure to put the gateway only on the interface that needs it.
Either you set it here or on the Control Plane one.
Important
To avoid DNS issues, do not set any
search domains.
Set Ignore for IPv6 and click Save.
Click the + button to add the second bonding interface.
Select the Bond device and click Add.
Set the bond information and click Save.
Note
The 802.3ad (LACP) is the recommended mode but it needs some configuration on your switches. In case you cannot apply those, use the Active backup mode.
Add the bonding slaves by clicking Add, keep the Ethernet connection type, and click Create….
Set the slave information and click Save.
Repeat the two previous steps to add the other bonding slaves.
Ensure you have the list of slaves as expected, then go to IPv4 Settings.
Set the IPv4 address information.
Note
You cannot have 2 gateways. Ensure to put the gateway only on the interface that needs it.
Either you set it here or on the Workload Plane one.
Important
To avoid DNS issues, do not set any
search domains.
Set Ignore for IPv6 and click Save.
Ensure the interfaces are properly set up and click Done.
Warning
If you are using 802.3ad (LACP) to have proper aggregation, after the OS installation, you will need to change the bond options using the following commands.
[artesca-os@bootstrap ~]$
sudo nmcli con mod bond-artesca-wp bond.options mode=802.3ad,miimon=100,lacp_rate=1,xmit_hash_policy=layer3+4
sudo nmcli con up bond-artesca-wp
sudo nmcli con mod bond-artesca-cp bond.options mode=802.3ad,miimon=100,lacp_rate=1,xmit_hash_policy=layer3+4
sudo nmcli con up bond-artesca-cp
Define the Host Name and click Apply. Ensure it actually updates the Current host name.
Important
To avoid DNS issues you must use flat hostnames such as
storage001and avoid compound hostnames suchs001.storage.
Click the + button.
Select the Bond device and click Add.
Set the bond information and click Save.
Note
The 802.3ad (LACP) is the recommended mode but it needs some configuration on your switches. In case you cannot apply those, use the Active backup mode.
Add the bonding slaves by clicking Add, keep the Ethernet connection type, and click Create….
Set the slave information and click Save.
Repeat the two previous steps to add the other bonding slaves.
Ensure you have the list of slaves as expected, then go to IPv4 Settings.
Set Disabled for IPv4 on this bonding interface and click Save.
Set Ignore for IPv6 and click Save.
Click the + button to add the VLAN interface.
Select VLAN and click Add.
Set the VLAN information and click Save..
Set the IPv4 address information and click Save..
Note
You cannot have 2 gateways. Ensure to put the gateway only on the interface that needs it.
Either you set it here or on the Control Plane one.
Important
To avoid DNS issues, do not set any
search domains.
Set Ignore for IPv6 and click Save.
Click the + button to add the second VLAN interface.
Select VLAN and click Add.
Set the VLAN information and click Save..
Set the IPv4 address information and click Save..
Note
You cannot have 2 gateways. Ensure to put the gateway only on the interface that needs it.
Either you set it here or on the Workload Plane one.
Important
To avoid DNS issues, do not set any
search domains.
Set Ignore for IPv6 and click Save.
Ensure the interface are properly set up and click Done.
Warning
If you are using 802.3ad (LACP) to have proper aggregation, after the OS installation, you will need to change the bond options using the following commands.
[artesca-os@bootstrap ~]$
sudo nmcli con mod bond-artesca bond.options mode=802.3ad,miimon=100,lacp_rate=1,xmit_hash_policy=layer3+4
sudo nmcli con up bond-artesca
Time and Date - NTP Settings¶
Important
Best practice is to have at least three NTP servers (3 lines beginning with server). Or be synchronized with a pool of multiple NTP servers. Refer to Change NTP Configuration for more detailed information.
By clicking TIME & DATE, you are redirected to the following page:
Configure the settings as follows:
Using the Region and City fields, adapt the timezone configuration according to your site policy.
Note
If case of doubt, ask your IT department for the proper timezone.
Click the settings button next to the Network Time switch to access the NTP servers list.
Add the NTP servers you want to use by writing their addresses and clicking the + button.
Remove the servers you do not want to use by unchecking the box in the Use column.
Ensure to have at least one NTP server with the green flag in the Working column.
Note
If none of the servers are working, check the network configuration or contact your IT department.
Click OK to save the settings.
Toggle the Network Time switch to ON to start synchronizing the time with the NTP servers.
Note
If the Network Time switch returns to the off position, check the network configuration.
Click Done to leave the TIME & DATE page.
Launch OS Installation¶
Secure ARTESCA OS and Root Credentials¶
The ARTESCA OS provides two users with a respective default and insecure password:
An
artesca-osuser with the default passwordscality.A
rootuser with the default passwordscalityadmin.
Warning
To ensure the security of your ARTESCA OS, you must log in with these users at least once to update the password.
Refer to Change Password for more information on how to change your passwords.
Once ARTESCA is installed, you cannot SSH as the root user. To log in as the
root user, connect directly to the server (physically or using an IPMI console).
You must use the root user only on Scality support requests.
Readiness Checks¶
Disk Partitions¶
Check for current detected disk partitions and volumes using the
lsblk command:
Show the command
$
lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 480G 0 disk
├─sda1 8:1 0 1G 0 part /boot
├─sda2 8:2 0 201M 0 part /boot/efi
└─sda3 8:3 0 478.8G 0 part
├─vgos-root 253:0 0 128.8G 0 lvm /
├─vgos-var_lib_containerd 253:1 0 100G 0 lvm /var/lib/containerd
└─vgos-var_log 253:2 0 200G 0 lvm /var/log
├─vgos-srv_scality_releases 253:3 0 50G 0 lvm /srv/scality/releases
Show the command
$
lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 480G 0 disk
├─sda1 8:1 0 1G 0 part
| └─md127 9:127 0 1023M 0 raid1 /boot
├─sda2 8:2 0 1G 0 part
| └─md125 9:125 0 201M 0 raid1 /boot/efi
└─sda3 8:3 0 478.8G 0 part
└─md126 9:126 0 478.8G 0 raid1
├─vgos-root 253:0 0 128.8G 0 lvm /
├─vgos-var_lib_containerd 253:1 0 100G 0 lvm /var/lib/containerd
├─vgos-var_log 253:2 0 200G 0 lvm /var/log
└─vgos-srv_scality_releases 253:3 0 50G 0 lvm /srv/scality/releases
sdb 8:16 0 480G 0 disk
├─sdb1 8:17 0 1G 0 part
| └─md127 9:127 0 1023M 0 raid1 /boot
├─sdb2 8:18 0 1G 0 part
| └─md125 9:125 0 201M 0 raid1 /boot/efi
└─sdb3 8:19 0 478.8G 0 part
└─md126 9:126 0 478.8G 0 raid1
├─vgos-root 253:0 0 128.8G 0 lvm /
├─vgos-var_lib_containerd 253:1 0 100G 0 lvm /var/lib/containerd
├─vgos-var_log 253:2 0 200G 0 lvm /var/log
└─vgos-srv_scality_releases 253:3 0 50G 0 lvm /srv/scality/releases
This command lists OS partitions and volumes. Wipe existing partitions on any additional data drives before proceeding.
Network Bondings¶
Once the network interface is configured, use the following command to list the bonding interfaces for the workload and control planes, as well as their sub-interfaces.
Show the command
$ip a1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: enp1s0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc fq_codel master bond-artesca-cp state UP group default qlen 1000 link/ether 52:54:00:6d:3d:2a brd ff:ff:ff:ff:ff:ff 3: enp7s0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc fq_codel master bond-artesca-cp state UP group default qlen 1000 link/ether 52:54:00:6d:3d:2a brd ff:ff:ff:ff:ff:ff 4: enp8s0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc fq_codel master bond-artesca-wp state UP group default qlen 1000 link/ether 52:54:00:58:a7:b0 brd ff:ff:ff:ff:ff:ff 5: enp9s0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc fq_codel master bond-artesca-wp state UP group default qlen 1000 link/ether 52:54:00:58:a7:b0 brd ff:ff:ff:ff:ff:ff 7: bond-artesca-cp: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000 link/ether 52:54:00:6d:3d:2a brd ff:ff:ff:ff:ff:ff inet 192.168.123.39/24 brd 192.168.123.255 scope global static noprefixroute bond-artesca-cp 8: bond-artesca-wp: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000 link/ether 52:54:00:58:a7:b0 brd ff:ff:ff:ff:ff:ff inet 192.168.122.71/24 brd 192.168.122.255 scope global static noprefixroute bond-artesca-wpCheck that the bonding interfaces are up and running. The output of the following command must show the bonding mode, the status of the bonding and slaves interfaces, and the matching speed and duplex of the slaves interfaces. You can also check the status of
bond-artesca-cp.Show the command
$cat /proc/net/bonding/bond-artesca-wpEthernet Channel Bonding Driver: v3.7.1 (April 27, 2011) Bonding Mode: IEEE 802.3ad Dynamic link aggregation Transmit Hash Policy: layer3+4 (1) MII Status: up <--------- Status of the bond MII Polling Interval (ms): 100 Up Delay (ms): 0 Down Delay (ms): 0 Peer Notification Delay (ms): 0 802.3ad info LACP active: on LACP rate: fast Min links: 0 Aggregator selection policy (ad_select): stable System priority: 65535 System MAC address: 50:7c:6f:3c:18:5a Active Aggregator Info: Aggregator ID: 1 Number of ports: 1 Actor Key: 9 Partner Key: 1 Partner Mac Address: 00:00:00:00:00:00 Slave Interface: enp7s0 <--------- Slave interface MII Status: up <--------- Status of the slave Speed: 25000 Mbps <--------- Speed of the slave (must match the other slave) Duplex: full <--------- Duplex of the slave (must match the other slave) Link Failure Count: 0 Permanent HW addr: 50:7c:6f:3c:18:5a Slave queue ID: 0 Aggregator ID: 1 Actor Churn State: none Partner Churn State: churned Actor Churned Count: 0 Partner Churned Count: 1 details actor lacp pdu: system priority: 65535 system mac address: 50:7c:6f:3c:18:5a port key: 9 port priority: 255 port number: 1 port state: 79 details partner lacp pdu: system priority: 65535 system mac address: 00:00:00:00:00:00 oper key: 1 port priority: 255 port number: 1 port state: 1 Slave Interface: enp8s0 <--------- Slave interface MII Status: up <--------- Status of the slave Speed: 25000 Mbps <--------- Speed of the slave (must match the other slave) Duplex: full <--------- Duplex of the slave (must match the other slave) Link Failure Count: 0 Permanent HW addr: 50:7c:6f:3c:18:5b Slave queue ID: 0 Aggregator ID: 2 Actor Churn State: churned Partner Churn State: churned Actor Churned Count: 1 Partner Churned Count: 1 details actor lacp pdu: system priority: 65535 system mac address: 50:7c:6f:3c:18:5a port key: 9 port priority: 255 port number: 2 port state: 71 details partner lacp pdu: system priority: 65535 system mac address: 00:00:00:00:00:00 oper key: 1 port priority: 255 port number: 1 port state: 1
Warning
If you are using 802.3ad (LACP) for proper aggregation, after the OS installation you must change the bond options. Select the tab that aligns with your network configuration, and execute the commands.
[artesca-os@bootstrap ~]$
sudo nmcli con mod bond-artesca bond.options mode=802.3ad,miimon=100,lacp_rate=1,xmit_hash_policy=layer3+4
sudo nmcli con up bond-artesca
[artesca-os@bootstrap ~]$
sudo nmcli con mod bond-artesca bond.options mode=802.3ad,miimon=100,lacp_rate=1,xmit_hash_policy=layer3+4
sudo nmcli con up bond-artesca
[artesca-os@bootstrap ~]$
sudo nmcli con mod bond-artesca-wp bond.options mode=802.3ad,miimon=100,lacp_rate=1,xmit_hash_policy=layer3+4
sudo nmcli con up bond-artesca-wp
sudo nmcli con mod bond-artesca-cp bond.options mode=802.3ad,miimon=100,lacp_rate=1,xmit_hash_policy=layer3+4
sudo nmcli con up bond-artesca-cp
[artesca-os@bootstrap ~]$
sudo nmcli con mod bond-artesca bond.options mode=802.3ad,miimon=100,lacp_rate=1,xmit_hash_policy=layer3+4
sudo nmcli con up bond-artesca
Service Disk Preparation¶
Identify the device path for each wanted disk.
Some ARTESCA components require persistent storage. This storage is provided in a single LVM physical volume, which must be pointing at a RAID 1 array for durability.
Important
The service disk must be configured as a SW RAID1 array following the instructions below.
Software RAID Array Creation¶
Important
You must follow these steps on each ARTESCA server.
Fill the devices to use for the RAID array. Replace with your actual device.
$MDDISK1=/dev/nvme0n1 MDDISK2=/dev/nvme1n1
Ensure to stop the
/dev/md/artescaRAID array.$sudo test -e /dev/md/artesca && sudo mdadm --stop /dev/md/artesca
Wipe the devices to remove any existing partition table.
In general, the command below is sufficient. If your devices have different paths, ensure to replace them in the command.
$sudo wipefs -fa $MDDISK1 $MDDISK2
Initialize the RAID 1 array.
$sudo mdadm --create --verbose /dev/md/artesca \ --level=1 --raid-devices=2 --metadata=1.2 \ $MDDISK1 $MDDISK2
mdadm: size set to 104791040K mdadm: array /dev/md/artesca started.
Check the array creation and progress.
$cat /proc/mdstatPersonalities : [raid1] md127 : active raid1 nvme1n1[1] nvme0n1[0] 104791040 blocks super 1.2 [2/2] [UU] [=====>...............] resync = 26.8% (28111552/104791040) finish=27.1min speed=46998K/sec unused devices: <none>
Fill the devices to use for the RAID array. Replace with your actual device.
$MDDISK1=/dev/nvme0n1 MDDISK2=/dev/nvme1n1 MDDISK3=/dev/nvme2n1 MDDISK4=/dev/nvme3n1
Ensure to stop the
/dev/md/artescaRAID array.$sudo test -e /dev/md/artesca && sudo mdadm --stop /dev/md/artesca
Wipe the devices to remove any existing partition table.
In general, the command below is sufficient. If your devices have different paths, ensure to replace them in the command.
$sudo wipefs -fa $MDDISK1 $MDDISK2 $MDDISK3 $MDDISK4
Initialize the RAID 10 array.
$sudo mdadm --create --verbose /dev/md/artesca \ --level=10 --raid-devices=4 --metadata=1.2 \ $MDDISK1 $MDDISK2 $MDDISK3 $MDDISK4
mdadm: size set to 104791040K mdadm: array /dev/md/artesca started.
Check the array creation and progress.
$cat /proc/mdstatPersonalities : [raid10] md127 : active raid10 nvme3n1[3] nvme2n1[2] nvme1n1[1] nvme0n1[0] 104791040 blocks super 1.2 [4/4] [UUUU] [=====>...............] resync = 26.8% (28111552/104791040) finish=27.1min speed=46998K/sec unused devices: <none>
Tips
After creation, MD RAID (MD - Multiple Device device driver, for the RAID - Redundant Array of Independent Disk) synchronizes the whole disk according to the specified RAID configuration. The synchronization can be sped up by increasing the value of the speed_limit_max parameter as follows:
$
cat /proc/sys/dev/raid/speed_limit_max > ./speed_limit.bkp && \
echo 10000000 | sudo tee /proc/sys/dev/raid/speed_limit_max
To reduce the impact on CPU usage during runtime, switch the speed limit back to its original value once the initial synchronization has been completed:
$
cat ./speed_limit.bkp | sudo tee /proc/sys/dev/raid/speed_limit_max && \
rm -f ./speed_limit.bkp
Data Disks Preparation¶
Prepare all the data disks depending on your hardware configuration.
Detect the RAID controller used on your machine.
[artesca-os@<NODE_NAME> ~]$
lspci | grep -i -e 'raid' -e 'adaptec'
# Example output for Adaptec Smart:
5c:00.0 Serial Attached SCSI controller: Adaptec Smart Storage PQI SAS (rev 01)
# Example output for MegaRAID (SAS-3):
0d:00.0 RAID bus controller: Broadcom / LSI MegaRAID SAS-3 3108 [Invader] (rev 02)
# Example output for MegaRAID (SAS40xx):
10:00.0 RAID bus controller: Broadcom / LSI Fusion-MPT 24GSAS/PCIe SAS40xx (rev 01)
Note
Dell servers also have MegaRAID controller. However, the management tool is different. Use the Dell RAID controller procedure.
Retrieve the RAID controller index (
CONTROLLER_INDEX, depending on specific hardware, will usually be0or1).[artesca-os@<NODE_NAME> ~]$sudo ssacli ctrl all show
HPE Smart Array P816i-a SR Gen10 in Slot 0 (Embedded) (sn: PWXLA0CRHF10J9) # Note: CONTROLLER_INDEX is the value after "Slot" in the output.
Set the
CONTROLLER_INDEXvariable.Replace
<CONTROLLER_INDEX>placeholder with the value ofCtlcolumn in the output from the previous step.[artesca-os@<NODE_NAME> ~]$export CONTROLLER_INDEX=<CONTROLLER_INDEX>
Disable the background surface scan.
The surface scan generates a high I/O load at the RAID controller level, which degrades ARTESCA performances. Disable it on every RAID controller of the node.
Optionally, check the available modes and the current setting of the controller.
[artesca-os@<NODE_NAME> ~]$sudo ssacli ctrl slot=$CONTROLLER_INDEX modify surfacescanmode=?
Available options are: disable high idle (current, default, surfacescandelay=3)
[artesca-os@<NODE_NAME> ~]$sudo ssacli ctrl slot=$CONTROLLER_INDEX modify surfacescanmode=disable
Confirm the data disks are listed (in the
Unassignedsection).[artesca-os@<NODE_NAME> ~]$sudo ssacli ctrl slot=$CONTROLLER_INDEX pd all show
[...] Unassigned physicaldrive 1I:1:1 (port 1I:box 1:bay 1, SAS HDD, 8 TB, OK) physicaldrive 1I:1:2 (port 1I:box 1:bay 2, SAS HDD, 8 TB, OK) physicaldrive 1I:1:3 (port 1I:box 1:bay 3, SAS HDD, 8 TB, OK) physicaldrive 1I:1:4 (port 1I:box 1:bay 4, SAS HDD, 8 TB, OK) physicaldrive 1I:2:1 (port 1I:box 2:bay 1, SAS HDD, 8 TB, OK) physicaldrive 1I:2:2 (port 1I:box 2:bay 2, SAS HDD, 8 TB, OK) physicaldrive 1I:2:3 (port 1I:box 2:bay 3, SAS HDD, 8 TB, OK) physicaldrive 1I:2:4 (port 1I:box 2:bay 4, SAS HDD, 8 TB, OK) physicaldrive 1I:3:1 (port 1I:box 3:bay 1, SAS HDD, 8 TB, OK) physicaldrive 1I:3:2 (port 1I:box 3:bay 2, SAS HDD, 8 TB, OK) physicaldrive 1I:3:3 (port 1I:box 3:bay 3, SAS HDD, 8 TB, OK) physicaldrive 1I:3:4 (port 1I:box 3:bay 4, SAS HDD, 8 TB, OK) # Note: The lines we are looking for are the ones below "Unassigned". # We need to take note of DRIVE_ID value: the set of # values separated by colons (":"). (e.g. 1I:1:1)For each data disk, create a RAID 0 logical drive.
Replace
<DRIVE_ID>placeholder with the value from the previous step.[artesca-os@<NODE_NAME> ~]$sudo ssacli ctrl slot=$CONTROLLER_INDEX create type=ld drives=<DRIVE_ID> raid=0
Ensure all data drive are correctly set-up.
[artesca-os@<NODE_NAME> ~]$sudo ssacli ctrl slot=$CONTROLLER_INDEX ld all show status
logicaldrive 1 (8 TB, RAID 0): OK logicaldrive 2 (8 TB, RAID 0): OK logicaldrive 3 (8 TB, RAID 0): OK logicaldrive 4 (8 TB, RAID 0): OK logicaldrive 5 (8 TB, RAID 0): OK logicaldrive 6 (8 TB, RAID 0): OK logicaldrive 7 (8 TB, RAID 0): OK logicaldrive 8 (8 TB, RAID 0): OK logicaldrive 9 (8 TB, RAID 0): OK logicaldrive 10 (8 TB, RAID 0): OK logicaldrive 11 (8 TB, RAID 0): OK logicaldrive 12 (8 TB, RAID 0): OK
Retrieve the RAID controller index (
CONTROLLER_INDEX, depending on specific hardware, will usually be0or1).[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/storcli/storcli64 show
-------------------------------------------------------------------- Ctl Model Ports PDs DGs DNOpt VDs VNOpt BBU sPR DS EHS ASOs Hlth -------------------------------------------------------------------- 0 SAS3916 16 12 12 0 12 0 N/A On 1&2 Y 4 Opt --------------------------------------------------------------------
Set the
CONTROLLER_INDEXvariable.Replace
<CONTROLLER_INDEX>placeholder with the value ofCtlcolumn in the output from the previous step.[artesca-os@<NODE_NAME> ~]$export CONTROLLER_INDEX=<CONTROLLER_INDEX>
Disable the Patrol Read operation.
Patrol Read generates a high I/O load at the RAID controller level, which degrades ARTESCA performances. Disable it on every RAID controller of the node.
Optionally, check the current Patrol Read settings of the controller.
[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/storcli/storcli64 /c$CONTROLLER_INDEX show patrolread
[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/storcli/storcli64 /c$CONTROLLER_INDEX stop patrolread sudo /opt/MegaRAID/storcli/storcli64 /c$CONTROLLER_INDEX set prrate=1 sudo /opt/MegaRAID/storcli/storcli64 /c$CONTROLLER_INDEX set patrolread=off sudo /opt/MegaRAID/storcli/storcli64 /c$CONTROLLER_INDEX set patrolread includessds=off
Note
The
stop patrolreadcommand returns an error when no Patrol Read operation is currently running. This error can safely be ignored.Confirm the data disks are listed (with
UGoodstatus, Unconfigured Good).[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/storcli/storcli64 /c$CONTROLLER_INDEX /eall /sall show
----------------------------------------------------------------------------- EID:Slt DID State DG Size Intf Med SED PI SeSz Model Sp Type ----------------------------------------------------------------------------- 252:1 8 UGood - 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:2 7 UGood - 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:3 6 UGood - 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:4 1 UGood - 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:5 4 UGood - 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:6 5 UGood - 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:7 2 UGood - 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:8 12 UGood - 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:9 10 UGood - 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:10 3 UGood - 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:11 9 UGood - 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:12 11 UGood - 14.551 TB SAS HDD N N 512B MG08SCA16TE U - ----------------------------------------------------------------------------- # Note: The lines we are looking for are the ones with "UGood" in the "State" column. # We need to take note of two values: # - ENCLOSURE_DEVICE_ID: The value of "EID" column. (252 in this example output) # - SLOT_NUMBER: The value of "Slt" column. (from 1 to 12 in this example output)
For each data disk, create a RAID 0 logical drive.
Replace
<ENCLOSURE_DEVICE_ID>and<SLOT_NUMBER>placeholders with the value from the previous step.[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/storcli/storcli64 /c$CONTROLLER_INDEX add vd raid0 drives=<ENCLOSURE_DEVICE_ID>:<SLOT_NUMBER> wb nora direct
Ensure all data drives are correctly set-up with right cache type.
The drives should be listed with the
NRWBDcache type.[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/storcli/storcli64 /c$CONTROLLER_INDEX /vall show
--------------------------------------------------------------- DG/VD TYPE State Access Consist Cache Cac sCC Size Name --------------------------------------------------------------- 11/227 RAID0 Optl RW Yes NRWBD - ON 14.551 TB 10/229 RAID0 Optl RW Yes NRWBD - ON 14.551 TB 9/230 RAID0 Optl RW Yes NRWBD - ON 14.551 TB 8/231 RAID0 Optl RW Yes NRWBD - ON 14.551 TB 7/232 RAID0 Optl RW Yes NRWBD - ON 14.551 TB 6/233 RAID0 Optl RW Yes NRWBD - ON 14.551 TB 5/234 RAID0 Optl RW Yes NRWBD - ON 14.551 TB 4/235 RAID0 Optl RW Yes NRWBD - ON 14.551 TB 3/236 RAID0 Optl RW Yes NRWBD - ON 14.551 TB 2/237 RAID0 Optl RW Yes NRWBD - ON 14.551 TB 1/238 RAID0 Optl RW Yes NRWBD - ON 14.551 TB 0/239 RAID0 Optl RW Yes NRWBD - ON 14.551 TB ---------------------------------------------------------------
All data drive should be used by a DG (drive group) and be Onln.
[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/storcli/storcli64 /c$CONTROLLER_INDEX /eall /sall show
----------------------------------------------------------------------------- EID:Slt DID State DG Size Intf Med SED PI SeSz Model Sp Type ----------------------------------------------------------------------------- 252:1 8 Onln 0 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:2 7 Onln 1 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:3 6 Onln 2 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:4 1 Onln 3 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:5 4 Onln 4 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:6 5 Onln 5 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:7 2 Onln 6 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:8 12 Onln 7 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:9 10 Onln 8 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:10 3 Onln 9 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:11 9 Onln 10 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:12 11 Onln 11 14.551 TB SAS HDD N N 512B MG08SCA16TE U - -----------------------------------------------------------------------------
Retrieve the RAID controller index (
CONTROLLER_INDEX, depending on specific hardware, will usually be0or1).[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/storcli/storcli64 show
-------------------------------------------------------------------- Ctl Model Ports PDs DGs DNOpt VDs VNOpt BBU sPR DS EHS ASOs Hlth -------------------------------------------------------------------- 0 SAS3916 16 12 12 0 12 0 N/A On 1&2 Y 4 Opt --------------------------------------------------------------------
Set the
CONTROLLER_INDEXvariable.Replace
<CONTROLLER_INDEX>placeholder with the value ofCtlcolumn in the output from the previous step.[artesca-os@<NODE_NAME> ~]$export CONTROLLER_INDEX=<CONTROLLER_INDEX>
Disable the Patrol Read operation.
Patrol Read generates a high I/O load at the RAID controller level, which degrades ARTESCA performances. Disable it on every RAID controller of the node.
Optionally, check the current Patrol Read settings of the controller.
[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/storcli/storcli64 /c$CONTROLLER_INDEX show patrolread
[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/storcli/storcli64 /c$CONTROLLER_INDEX stop patrolread sudo /opt/MegaRAID/storcli/storcli64 /c$CONTROLLER_INDEX set prrate=1 sudo /opt/MegaRAID/storcli/storcli64 /c$CONTROLLER_INDEX set patrolread=off sudo /opt/MegaRAID/storcli/storcli64 /c$CONTROLLER_INDEX set patrolread includessds=off
Note
The
stop patrolreadcommand returns an error when no Patrol Read operation is currently running. This error can safely be ignored.Confirm the data disks are listed (with
UGoodstatus, Unconfigured Good).[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/storcli/storcli64 /c$CONTROLLER_INDEX /eall /sall show
----------------------------------------------------------------------------- EID:Slt DID State DG Size Intf Med SED PI SeSz Model Sp Type ----------------------------------------------------------------------------- 252:1 8 UGood - 14.551 TB SAS SSD N N 512B MG08SCA16TE U - 252:2 7 UGood - 14.551 TB SAS SSD N N 512B MG08SCA16TE U - 252:3 6 UGood - 14.551 TB SAS SSD N N 512B MG08SCA16TE U - 252:4 1 UGood - 14.551 TB SAS SSD N N 512B MG08SCA16TE U - 252:5 4 UGood - 14.551 TB SAS SSD N N 512B MG08SCA16TE U - 252:6 5 UGood - 14.551 TB SAS SSD N N 512B MG08SCA16TE U - 252:7 2 UGood - 14.551 TB SAS SSD N N 512B MG08SCA16TE U - 252:8 12 UGood - 14.551 TB SAS SSD N N 512B MG08SCA16TE U - 252:9 10 UGood - 14.551 TB SAS SSD N N 512B MG08SCA16TE U - 252:10 3 UGood - 14.551 TB SAS SSD N N 512B MG08SCA16TE U - 252:11 9 UGood - 14.551 TB SAS SSD N N 512B MG08SCA16TE U - 252:12 11 UGood - 14.551 TB SAS SSD N N 512B MG08SCA16TE U - ----------------------------------------------------------------------------- # Note: The lines we are looking for are the ones with "UGood" in the "State" column. # We need to take note of two values: # - ENCLOSURE_DEVICE_ID: The value of "EID" column. (252 in this example output) # - SLOT_NUMBER: The value of "Slt" column. (from 1 to 12 in this example output)
For each data disk, set the drive in JBOD mode
Replace
<ENCLOSURE_DEVICE_ID>and<SLOT_NUMBER>placeholders with the value from the previous step.[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/storcli/storcli64 /c$CONTROLLER_INDEX /e<ENCLOSURE_DEVICE_ID> /s<SLOT_NUMBER> set jbod
Ensure all SSD data drive are correctly set-up in JBOD and Onln.
[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/storcli/storcli64 /c$CONTROLLER_INDEX /eall /sall show
----------------------------------------------------------------------------- EID:Slt DID State DG Size Intf Med SED PI SeSz Model Sp Type ----------------------------------------------------------------------------- 252:1 8 Onln - 14.551 TB SAS SSD N N 512B MG08SCA16TE U JBOD 252:2 7 Onln - 14.551 TB SAS SSD N N 512B MG08SCA16TE U JBOD 252:3 6 Onln - 14.551 TB SAS SSD N N 512B MG08SCA16TE U JBOD 252:4 1 Onln - 14.551 TB SAS SSD N N 512B MG08SCA16TE U JBOD 252:5 4 Onln - 14.551 TB SAS SSD N N 512B MG08SCA16TE U JBOD 252:6 5 Onln - 14.551 TB SAS SSD N N 512B MG08SCA16TE U JBOD 252:7 2 Onln - 14.551 TB SAS SSD N N 512B MG08SCA16TE U JBOD 252:8 12 Onln - 14.551 TB SAS SSD N N 512B MG08SCA16TE U JBOD 252:9 10 Onln - 14.551 TB SAS SSD N N 512B MG08SCA16TE U JBOD 252:10 3 Onln - 14.551 TB SAS SSD N N 512B MG08SCA16TE U JBOD 252:11 9 Onln - 14.551 TB SAS SSD N N 512B MG08SCA16TE U JBOD 252:12 11 Onln - 14.551 TB SAS SSD N N 512B MG08SCA16TE U JBOD -----------------------------------------------------------------------------
Retrieve the RAID controller index (
CONTROLLER_INDEX, depending on specific hardware, will usually be0or1).[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/storcli2/storcli2 show
----------------------------------------------------------------------------------------- Ctrl Product Name SASAddress Personality Status PD(s) VD(s) VNOpt EPack ----------------------------------------------------------------------------------------- 0 SAS3916 Adapter 0XXXXXXX RAID Optimal 12 12 0 Optimal -----------------------------------------------------------------------------------------
Set the
CONTROLLER_INDEXvariable.Replace
<CONTROLLER_INDEX>placeholder with the value ofCtlcolumn in the output from the previous step.[artesca-os@<NODE_NAME> ~]$export CONTROLLER_INDEX=<CONTROLLER_INDEX>
Disable the Patrol Read operation.
Patrol Read generates a high I/O load at the RAID controller level, which degrades ARTESCA performances. Disable it on every RAID controller of the node.
Optionally, check the current Patrol Read settings of the controller.
[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/storcli2/storcli2 /c$CONTROLLER_INDEX show patrolread
[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/storcli2/storcli2 /c$CONTROLLER_INDEX stop patrolread sudo /opt/MegaRAID/storcli2/storcli2 /c$CONTROLLER_INDEX set prrate=1 sudo /opt/MegaRAID/storcli2/storcli2 /c$CONTROLLER_INDEX set patrolread=off sudo /opt/MegaRAID/storcli2/storcli2 /c$CONTROLLER_INDEX set patrolread includessds=off
Note
The
stop patrolreadcommand returns an error when no Patrol Read operation is currently running. This error can safely be ignored.Confirm the data disks are listed (with
UGoodstatus, Unconfigured Good).[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/storcli2/storcli2 /c$CONTROLLER_INDEX /eall /sall show
----------------------------------------------------------------------------------------------------- EID:Slt PID State Status DG Size Intf Med SED_Type SeSz Model Sp LU/NS Count Alt-EID ----------------------------------------------------------------------------------------------------- 288:0 275 UConf Online - 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:1 276 UConf Online - 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:2 277 UConf Online - 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:3 278 UConf Online - 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:4 279 UConf Online - 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:5 280 UConf Online - 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:6 281 UConf Online - 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:7 282 UConf Online - 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:8 283 UConf Online - 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:9 284 UConf Online - 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:10 285 UConf Online - 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:11 286 UConf Online - 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - ----------------------------------------------------------------------------------------------------- # Note: The lines we are looking for are the ones with "UConf" in the "State" column. # We need to take note of two values: # - ENCLOSURE_DEVICE_ID: The value of "EID" column. (288 in this example output) # - SLOT_NUMBER: The value of "Slt" column. (from 0 to 11 in this example output)
For each data disk, create a RAID 0 logical drive.
Replace
<ENCLOSURE_DEVICE_ID>and<SLOT_NUMBER>placeholders with the value from the previous step.[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/storcli2/storcli2 /c$CONTROLLER_INDEX add vd raid0 drives=<ENCLOSURE_DEVICE_ID>:<SLOT_NUMBER> wb nora
Ensure all data drives are correctly set-up with right cache type.
The drives should be listed with the
NR,WBcache type.[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/storcli2/storcli2 /c$CONTROLLER_INDEX /vall show
------------------------------------------------------------------ DG/VD TYPE State Access CurrentCache DefaultCache Size Name ------------------------------------------------------------------ 0/1 RAID0 Optl RW NR,WB NR,WB 7.276 TiB 1/2 RAID0 Optl RW NR,WB NR,WB 7.276 TiB 2/3 RAID0 Optl RW NR,WB NR,WB 7.276 TiB 3/4 RAID0 Optl RW NR,WB NR,WB 7.276 TiB 4/5 RAID0 Optl RW NR,WB NR,WB 7.276 TiB 5/6 RAID0 Optl RW NR,WB NR,WB 7.276 TiB 6/7 RAID0 Optl RW NR,WB NR,WB 7.276 TiB 7/8 RAID0 Optl RW NR,WB NR,WB 7.276 TiB 8/9 RAID0 Optl RW NR,WB NR,WB 7.276 TiB 9/10 RAID0 Optl RW NR,WB NR,WB 7.276 TiB 10/11 RAID0 Optl RW NR,WB NR,WB 7.276 TiB 11/12 RAID0 Optl RW NR,WB NR,WB 7.276 TiB ------------------------------------------------------------------
All data drive should be used by a DG (drive group) and be Online.
[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/storcli2/storcli2 /c$CONTROLLER_INDEX /eall /sall show
----------------------------------------------------------------------------------------------------- EID:Slt PID State Status DG Size Intf Med SED_Type SeSz Model Sp LU/NS Count Alt-EID ----------------------------------------------------------------------------------------------------- 288:0 275 Conf Online 0 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:1 276 Conf Online 1 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:2 277 Conf Online 2 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:3 278 Conf Online 3 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:4 279 Conf Online 4 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:5 280 Conf Online 5 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:6 281 Conf Online 6 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:7 282 Conf Online 7 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:8 283 Conf Online 8 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:9 284 Conf Online 9 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:10 285 Conf Online 10 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:11 286 Conf Online 11 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - -----------------------------------------------------------------------------------------------------
Retrieve the RAID controller index (
CONTROLLER_INDEX, depending on specific hardware, will usually be0or1).[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/storcli2/storcli2 show
----------------------------------------------------------------------------------------- Ctrl Product Name SASAddress Personality Status PD(s) VD(s) VNOpt EPack ----------------------------------------------------------------------------------------- 0 SAS3916 Adapter 0XXXXXXX RAID Optimal 12 12 0 Optimal -----------------------------------------------------------------------------------------
Set the
CONTROLLER_INDEXvariable.Replace
<CONTROLLER_INDEX>placeholder with the value ofCtlcolumn in the output from the previous step.[artesca-os@<NODE_NAME> ~]$export CONTROLLER_INDEX=<CONTROLLER_INDEX>
Disable the Patrol Read operation.
Patrol Read generates a high I/O load at the RAID controller level, which degrades ARTESCA performances. Disable it on every RAID controller of the node.
Optionally, check the current Patrol Read settings of the controller.
[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/storcli2/storcli2 /c$CONTROLLER_INDEX show patrolread
[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/storcli2/storcli2 /c$CONTROLLER_INDEX stop patrolread sudo /opt/MegaRAID/storcli2/storcli2 /c$CONTROLLER_INDEX set prrate=1 sudo /opt/MegaRAID/storcli2/storcli2 /c$CONTROLLER_INDEX set patrolread=off sudo /opt/MegaRAID/storcli2/storcli2 /c$CONTROLLER_INDEX set patrolread includessds=off
Note
The
stop patrolreadcommand returns an error when no Patrol Read operation is currently running. This error can safely be ignored.Confirm the data disks are listed (with
UGoodstatus, Unconfigured Good).[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/storcli2/storcli2 /c$CONTROLLER_INDEX /eall /sall show
----------------------------------------------------------------------------------------------------- EID:Slt PID State Status DG Size Intf Med SED_Type SeSz Model Sp LU/NS Count Alt-EID ----------------------------------------------------------------------------------------------------- 288:0 275 UConf Online - 7.276 TiB SAS SSD - 512B ST8000NM024B U 1 - 288:1 276 UConf Online - 7.276 TiB SAS SSD - 512B ST8000NM024B U 1 - 288:2 277 UConf Online - 7.276 TiB SAS SSD - 512B ST8000NM024B U 1 - 288:3 278 UConf Online - 7.276 TiB SAS SSD - 512B ST8000NM024B U 1 - 288:4 279 UConf Online - 7.276 TiB SAS SSD - 512B ST8000NM024B U 1 - 288:5 280 UConf Online - 7.276 TiB SAS SSD - 512B ST8000NM024B U 1 - 288:6 281 UConf Online - 7.276 TiB SAS SSD - 512B ST8000NM024B U 1 - 288:7 282 UConf Online - 7.276 TiB SAS SSD - 512B ST8000NM024B U 1 - 288:8 283 UConf Online - 7.276 TiB SAS SSD - 512B ST8000NM024B U 1 - 288:9 284 UConf Online - 7.276 TiB SAS SSD - 512B ST8000NM024B U 1 - 288:10 285 UConf Online - 7.276 TiB SAS SSD - 512B ST8000NM024B U 1 - 288:11 286 UConf Online - 7.276 TiB SAS SSD - 512B ST8000NM024B U 1 - ----------------------------------------------------------------------------------------------------- # Note: The lines we are looking for are the ones with "UConf" in the "State" column. # We need to take note of two values: # - ENCLOSURE_DEVICE_ID: The value of "EID" column. (288 in this example output) # - SLOT_NUMBER: The value of "Slt" column. (from 0 to 11 in this example output)
For each data disk, set the drive in JBOD mode
Replace
<ENCLOSURE_DEVICE_ID>and<SLOT_NUMBER>placeholders with the value from the previous step.[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/storcli2/storcli2 /c$CONTROLLER_INDEX /e<ENCLOSURE_DEVICE_ID> /s<SLOT_NUMBER> set jbod
Ensure all SSD data drive are correctly set-up in JBOD and Online.
[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/storcli2/storcli2 /c$CONTROLLER_INDEX /eall /sall show
----------------------------------------------------------------------------------------------------- EID:Slt PID State Status DG Size Intf Med SED_Type SeSz Model Sp LU/NS Count Alt-EID ----------------------------------------------------------------------------------------------------- 288:0 275 Conf Online - 7.276 TiB SAS SSD JBOD 512B ST8000NM024B U 1 - 288:1 276 Conf Online - 7.276 TiB SAS SSD JBOD 512B ST8000NM024B U 1 - 288:2 277 Conf Online - 7.276 TiB SAS SSD JBOD 512B ST8000NM024B U 1 - 288:3 278 Conf Online - 7.276 TiB SAS SSD JBOD 512B ST8000NM024B U 1 - 288:4 279 Conf Online - 7.276 TiB SAS SSD JBOD 512B ST8000NM024B U 1 - 288:5 280 Conf Online - 7.276 TiB SAS SSD JBOD 512B ST8000NM024B U 1 - 288:6 281 Conf Online - 7.276 TiB SAS SSD JBOD 512B ST8000NM024B U 1 - 288:7 282 Conf Online - 7.276 TiB SAS SSD JBOD 512B ST8000NM024B U 1 - 288:8 283 Conf Online - 7.276 TiB SAS SSD JBOD 512B ST8000NM024B U 1 - 288:9 284 Conf Online - 7.276 TiB SAS SSD JBOD 512B ST8000NM024B U 1 - 288:10 285 Conf Online - 7.276 TiB SAS SSD JBOD 512B ST8000NM024B U 1 - 288:11 286 Conf Online - 7.276 TiB SAS SSD JBOD 512B ST8000NM024B U 1 - -----------------------------------------------------------------------------------------------------
Retrieve the RAID controller index (
CONTROLLER_INDEX, depending on specific hardware, will usually be0or1).[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/perccli/perccli64 show
-------------------------------------------------------------------- Ctl Model Ports PDs DGs DNOpt VDs VNOpt BBU sPR DS EHS ASOs Hlth -------------------------------------------------------------------- 0 PERC H730 16 12 12 0 12 0 N/A On 1&2 Y 4 Opt --------------------------------------------------------------------
Set the
CONTROLLER_INDEXvariable.Replace
<CONTROLLER_INDEX>placeholder with the value ofCtlcolumn in the output from the previous step.[artesca-os@<NODE_NAME> ~]$export CONTROLLER_INDEX=<CONTROLLER_INDEX>
Disable the Patrol Read operation.
Patrol Read generates a high I/O load at the RAID controller level, which degrades ARTESCA performances. Disable it on every RAID controller of the node.
Optionally, check the current Patrol Read settings of the controller.
[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/perccli/perccli64 /c$CONTROLLER_INDEX show patrolread
[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/perccli/perccli64 /c$CONTROLLER_INDEX stop patrolread sudo /opt/MegaRAID/perccli/perccli64 /c$CONTROLLER_INDEX set prrate=1 sudo /opt/MegaRAID/perccli/perccli64 /c$CONTROLLER_INDEX set patrolread=off sudo /opt/MegaRAID/perccli/perccli64 /c$CONTROLLER_INDEX set patrolread includessds=off
Note
The
stop patrolreadcommand returns an error when no Patrol Read operation is currently running. This error can safely be ignored.Confirm the data disks are listed (with
UGoodstatus, Unconfigured Good).[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/perccli/perccli64 /c$CONTROLLER_INDEX /eall /sall show
----------------------------------------------------------------------------- EID:Slt DID State DG Size Intf Med SED PI SeSz Model Sp Type ----------------------------------------------------------------------------- 252:1 8 UGood - 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:2 7 UGood - 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:3 6 UGood - 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:4 1 UGood - 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:5 4 UGood - 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:6 5 UGood - 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:7 2 UGood - 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:8 12 UGood - 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:9 10 UGood - 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:10 3 UGood - 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:11 9 UGood - 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:12 11 UGood - 14.551 TB SAS HDD N N 512B MG08SCA16TE U - ----------------------------------------------------------------------------- # Note: The lines we are looking for are the ones with "UGood" in the "State" column. # We need to take note of two values: # - ENCLOSURE_DEVICE_ID: The value of "EID" column. (252 in this example output) # - SLOT_NUMBER: The value of "Slt" column. (from 1 to 12 in this example output)
For each data disk, create a RAID 0 logical drive.
Replace
<ENCLOSURE_DEVICE_ID>and<SLOT_NUMBER>placeholders with the value from the previous step.[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/perccli/perccli64 /c$CONTROLLER_INDEX add vd raid0 drives=<ENCLOSURE_DEVICE_ID>:<SLOT_NUMBER> wb nora direct
Ensure all data drives are correctly set-up with right cache type.
The drives should be listed with the
NRWBDcache type.[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/perccli/perccli64 /c$CONTROLLER_INDEX /vall show
--------------------------------------------------------------- DG/VD TYPE State Access Consist Cache Cac sCC Size Name --------------------------------------------------------------- 11/227 RAID0 Optl RW Yes NRWBD - ON 14.551 TB 10/229 RAID0 Optl RW Yes NRWBD - ON 14.551 TB 9/230 RAID0 Optl RW Yes NRWBD - ON 14.551 TB 8/231 RAID0 Optl RW Yes NRWBD - ON 14.551 TB 7/232 RAID0 Optl RW Yes NRWBD - ON 14.551 TB 6/233 RAID0 Optl RW Yes NRWBD - ON 14.551 TB 5/234 RAID0 Optl RW Yes NRWBD - ON 14.551 TB 4/235 RAID0 Optl RW Yes NRWBD - ON 14.551 TB 3/236 RAID0 Optl RW Yes NRWBD - ON 14.551 TB 2/237 RAID0 Optl RW Yes NRWBD - ON 14.551 TB 1/238 RAID0 Optl RW Yes NRWBD - ON 14.551 TB 0/239 RAID0 Optl RW Yes NRWBD - ON 14.551 TB ---------------------------------------------------------------
All data drive should be used by a DG (drive group) and be Onln.
[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/perccli/perccli64 /c$CONTROLLER_INDEX /eall /sall show
----------------------------------------------------------------------------- EID:Slt DID State DG Size Intf Med SED PI SeSz Model Sp Type ----------------------------------------------------------------------------- 252:1 8 Onln 0 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:2 7 Onln 1 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:3 6 Onln 2 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:4 1 Onln 3 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:5 4 Onln 4 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:6 5 Onln 5 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:7 2 Onln 6 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:8 12 Onln 7 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:9 10 Onln 8 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:10 3 Onln 9 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:11 9 Onln 10 14.551 TB SAS HDD N N 512B MG08SCA16TE U - 252:12 11 Onln 11 14.551 TB SAS HDD N N 512B MG08SCA16TE U - -----------------------------------------------------------------------------
Retrieve the RAID controller index (
CONTROLLER_INDEX, depending on specific hardware, will usually be0or1).[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/perccli/perccli64 show
-------------------------------------------------------------------- Ctl Model Ports PDs DGs DNOpt VDs VNOpt BBU sPR DS EHS ASOs Hlth -------------------------------------------------------------------- 0 PERC H730 16 12 12 0 12 0 N/A On 1&2 Y 4 Opt --------------------------------------------------------------------
Set the
CONTROLLER_INDEXvariable.Replace
<CONTROLLER_INDEX>placeholder with the value ofCtlcolumn in the output from the previous step.[artesca-os@<NODE_NAME> ~]$export CONTROLLER_INDEX=<CONTROLLER_INDEX>
Disable the Patrol Read operation.
Patrol Read generates a high I/O load at the RAID controller level, which degrades ARTESCA performances. Disable it on every RAID controller of the node.
Optionally, check the current Patrol Read settings of the controller.
[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/perccli/perccli64 /c$CONTROLLER_INDEX show patrolread
[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/perccli/perccli64 /c$CONTROLLER_INDEX stop patrolread sudo /opt/MegaRAID/perccli/perccli64 /c$CONTROLLER_INDEX set prrate=1 sudo /opt/MegaRAID/perccli/perccli64 /c$CONTROLLER_INDEX set patrolread=off sudo /opt/MegaRAID/perccli/perccli64 /c$CONTROLLER_INDEX set patrolread includessds=off
Note
The
stop patrolreadcommand returns an error when no Patrol Read operation is currently running. This error can safely be ignored.Confirm the data disks are listed (with
UGoodstatus, Unconfigured Good).[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/perccli/perccli64 /c$CONTROLLER_INDEX /eall /sall show
----------------------------------------------------------------------------- EID:Slt DID State DG Size Intf Med SED PI SeSz Model Sp Type ----------------------------------------------------------------------------- 252:1 8 UGood - 14.551 TB SAS SSD N N 512B MG08SCA16TE U - 252:2 7 UGood - 14.551 TB SAS SSD N N 512B MG08SCA16TE U - 252:3 6 UGood - 14.551 TB SAS SSD N N 512B MG08SCA16TE U - 252:4 1 UGood - 14.551 TB SAS SSD N N 512B MG08SCA16TE U - 252:5 4 UGood - 14.551 TB SAS SSD N N 512B MG08SCA16TE U - 252:6 5 UGood - 14.551 TB SAS SSD N N 512B MG08SCA16TE U - 252:7 2 UGood - 14.551 TB SAS SSD N N 512B MG08SCA16TE U - 252:8 12 UGood - 14.551 TB SAS SSD N N 512B MG08SCA16TE U - 252:9 10 UGood - 14.551 TB SAS SSD N N 512B MG08SCA16TE U - 252:10 3 UGood - 14.551 TB SAS SSD N N 512B MG08SCA16TE U - 252:11 9 UGood - 14.551 TB SAS SSD N N 512B MG08SCA16TE U - 252:12 11 UGood - 14.551 TB SAS SSD N N 512B MG08SCA16TE U - ----------------------------------------------------------------------------- # Note: The lines we are looking for are the ones with "UGood" in the "State" column. # We need to take note of two values: # - ENCLOSURE_DEVICE_ID: The value of "EID" column. (252 in this example output) # - SLOT_NUMBER: The value of "Slt" column. (from 1 to 12 in this example output)
For each data disk, set the drive in JBOD mode
Replace
<ENCLOSURE_DEVICE_ID>and<SLOT_NUMBER>placeholders with the value from the previous step.[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/perccli/perccli64 /c$CONTROLLER_INDEX /e<ENCLOSURE_DEVICE_ID> /s<SLOT_NUMBER> set jbod
Ensure all SSD data drive are correctly set-up in JBOD and Onln.
[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/perccli/perccli64 /c$CONTROLLER_INDEX /eall /sall show
----------------------------------------------------------------------------- EID:Slt DID State DG Size Intf Med SED PI SeSz Model Sp Type ----------------------------------------------------------------------------- 252:1 8 Onln - 14.551 TB SAS SSD N N 512B MG08SCA16TE U JBOD 252:2 7 Onln - 14.551 TB SAS SSD N N 512B MG08SCA16TE U JBOD 252:3 6 Onln - 14.551 TB SAS SSD N N 512B MG08SCA16TE U JBOD 252:4 1 Onln - 14.551 TB SAS SSD N N 512B MG08SCA16TE U JBOD 252:5 4 Onln - 14.551 TB SAS SSD N N 512B MG08SCA16TE U JBOD 252:6 5 Onln - 14.551 TB SAS SSD N N 512B MG08SCA16TE U JBOD 252:7 2 Onln - 14.551 TB SAS SSD N N 512B MG08SCA16TE U JBOD 252:8 12 Onln - 14.551 TB SAS SSD N N 512B MG08SCA16TE U JBOD 252:9 10 Onln - 14.551 TB SAS SSD N N 512B MG08SCA16TE U JBOD 252:10 3 Onln - 14.551 TB SAS SSD N N 512B MG08SCA16TE U JBOD 252:11 9 Onln - 14.551 TB SAS SSD N N 512B MG08SCA16TE U JBOD 252:12 11 Onln - 14.551 TB SAS SSD N N 512B MG08SCA16TE U JBOD -----------------------------------------------------------------------------
Retrieve the RAID controller index (
CONTROLLER_INDEX, depending on specific hardware, will usually be0or1).[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/perccli2/perccli2 show
----------------------------------------------------------------------------------------- Ctrl Product Name SASAddress Personality Status PD(s) VD(s) VNOpt EPack ----------------------------------------------------------------------------------------- 0 PERC H965i Adapter 0XXXXXXXX RAID Optimal 12 12 0 Optimal -----------------------------------------------------------------------------------------
Set the
CONTROLLER_INDEXvariable.Replace
<CONTROLLER_INDEX>placeholder with the value ofCtlcolumn in the output from the previous step.[artesca-os@<NODE_NAME> ~]$export CONTROLLER_INDEX=<CONTROLLER_INDEX>
Disable the Patrol Read operation.
Patrol Read generates a high I/O load at the RAID controller level, which degrades ARTESCA performances. Disable it on every RAID controller of the node.
Optionally, check the current Patrol Read settings of the controller.
[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/perccli2/perccli2 /c$CONTROLLER_INDEX show patrolread
[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/perccli2/perccli2 /c$CONTROLLER_INDEX stop patrolread sudo /opt/MegaRAID/perccli2/perccli2 /c$CONTROLLER_INDEX set prrate=1 sudo /opt/MegaRAID/perccli2/perccli2 /c$CONTROLLER_INDEX set patrolread=off sudo /opt/MegaRAID/perccli2/perccli2 /c$CONTROLLER_INDEX set patrolread includessds=off
Note
The
stop patrolreadcommand returns an error when no Patrol Read operation is currently running. This error can safely be ignored.Confirm the data disks are listed (with
UGoodstatus, Unconfigured Good).[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/perccli2/perccli2 /c$CONTROLLER_INDEX /eall /sall show
----------------------------------------------------------------------------------------------------- EID:Slt PID State Status DG Size Intf Med SED_Type SeSz Model Sp LU/NS Count Alt-EID ----------------------------------------------------------------------------------------------------- 288:0 275 UConf Online - 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:1 276 UConf Online - 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:2 277 UConf Online - 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:3 278 UConf Online - 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:4 279 UConf Online - 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:5 280 UConf Online - 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:6 281 UConf Online - 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:7 282 UConf Online - 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:8 283 UConf Online - 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:9 284 UConf Online - 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:10 285 UConf Online - 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:11 286 UConf Online - 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - ----------------------------------------------------------------------------------------------------- # Note: The lines we are looking for are the ones with "UConf" in the "State" column. # We need to take note of two values: # - ENCLOSURE_DEVICE_ID: The value of "EID" column. (288 in this example output) # - SLOT_NUMBER: The value of "Slt" column. (from 0 to 11 in this example output)
For each data disk, create a RAID 0 logical drive.
Replace
<ENCLOSURE_DEVICE_ID>and<SLOT_NUMBER>placeholders with the value from the previous step.[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/perccli2/perccli2 /c$CONTROLLER_INDEX add vd raid0 drives=<ENCLOSURE_DEVICE_ID>:<SLOT_NUMBER> wb nora
Ensure all data drives are correctly set-up with right cache type.
The drives should be listed with the
NR,WBcache type.[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/perccli2/perccli2 /c$CONTROLLER_INDEX /vall show
------------------------------------------------------------------ DG/VD TYPE State Access CurrentCache DefaultCache Size Name ------------------------------------------------------------------ 0/1 RAID0 Optl RW NR,WB NR,WB 7.276 TiB 1/2 RAID0 Optl RW NR,WB NR,WB 7.276 TiB 2/3 RAID0 Optl RW NR,WB NR,WB 7.276 TiB 3/4 RAID0 Optl RW NR,WB NR,WB 7.276 TiB 4/5 RAID0 Optl RW NR,WB NR,WB 7.276 TiB 5/6 RAID0 Optl RW NR,WB NR,WB 7.276 TiB 6/7 RAID0 Optl RW NR,WB NR,WB 7.276 TiB 7/8 RAID0 Optl RW NR,WB NR,WB 7.276 TiB 8/9 RAID0 Optl RW NR,WB NR,WB 7.276 TiB 9/10 RAID0 Optl RW NR,WB NR,WB 7.276 TiB 10/11 RAID0 Optl RW NR,WB NR,WB 7.276 TiB 11/12 RAID0 Optl RW NR,WB NR,WB 7.276 TiB ------------------------------------------------------------------
All data drive should be used by a DG (drive group) and be Online.
[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/perccli2/perccli2 /c$CONTROLLER_INDEX /eall /sall show
----------------------------------------------------------------------------------------------------- EID:Slt PID State Status DG Size Intf Med SED_Type SeSz Model Sp LU/NS Count Alt-EID ----------------------------------------------------------------------------------------------------- 288:0 275 Conf Online 0 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:1 276 Conf Online 1 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:2 277 Conf Online 2 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:3 278 Conf Online 3 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:4 279 Conf Online 4 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:5 280 Conf Online 5 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:6 281 Conf Online 6 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:7 282 Conf Online 7 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:8 283 Conf Online 8 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:9 284 Conf Online 9 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:10 285 Conf Online 10 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - 288:11 286 Conf Online 11 7.276 TiB SAS HDD - 512B ST8000NM024B U 1 - -----------------------------------------------------------------------------------------------------
Retrieve the RAID controller index (
CONTROLLER_INDEX, depending on specific hardware, will usually be0or1).[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/perccli2/perccli2 show
----------------------------------------------------------------------------------------- Ctrl Product Name SASAddress Personality Status PD(s) VD(s) VNOpt EPack ----------------------------------------------------------------------------------------- 0 PERC H965i Adapter 0XXXXXXXX RAID Optimal 12 12 0 Optimal -----------------------------------------------------------------------------------------
Set the
CONTROLLER_INDEXvariable.Replace
<CONTROLLER_INDEX>placeholder with the value ofCtlcolumn in the output from the previous step.[artesca-os@<NODE_NAME> ~]$export CONTROLLER_INDEX=<CONTROLLER_INDEX>
Disable the Patrol Read operation.
Patrol Read generates a high I/O load at the RAID controller level, which degrades ARTESCA performances. Disable it on every RAID controller of the node.
Optionally, check the current Patrol Read settings of the controller.
[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/perccli2/perccli2 /c$CONTROLLER_INDEX show patrolread
[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/perccli2/perccli2 /c$CONTROLLER_INDEX stop patrolread sudo /opt/MegaRAID/perccli2/perccli2 /c$CONTROLLER_INDEX set prrate=1 sudo /opt/MegaRAID/perccli2/perccli2 /c$CONTROLLER_INDEX set patrolread=off sudo /opt/MegaRAID/perccli2/perccli2 /c$CONTROLLER_INDEX set patrolread includessds=off
Note
The
stop patrolreadcommand returns an error when no Patrol Read operation is currently running. This error can safely be ignored.Confirm the data disks are listed (with
UGoodstatus, Unconfigured Good).[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/perccli2/perccli2 /c$CONTROLLER_INDEX /eall /sall show
----------------------------------------------------------------------------------------------------- EID:Slt PID State Status DG Size Intf Med SED_Type SeSz Model Sp LU/NS Count Alt-EID ----------------------------------------------------------------------------------------------------- 288:0 275 UConf Online - 7.276 TiB SAS SSD - 512B ST8000NM024B U 1 - 288:1 276 UConf Online - 7.276 TiB SAS SSD - 512B ST8000NM024B U 1 - 288:2 277 UConf Online - 7.276 TiB SAS SSD - 512B ST8000NM024B U 1 - 288:3 278 UConf Online - 7.276 TiB SAS SSD - 512B ST8000NM024B U 1 - 288:4 279 UConf Online - 7.276 TiB SAS SSD - 512B ST8000NM024B U 1 - 288:5 280 UConf Online - 7.276 TiB SAS SSD - 512B ST8000NM024B U 1 - 288:6 281 UConf Online - 7.276 TiB SAS SSD - 512B ST8000NM024B U 1 - 288:7 282 UConf Online - 7.276 TiB SAS SSD - 512B ST8000NM024B U 1 - 288:8 283 UConf Online - 7.276 TiB SAS SSD - 512B ST8000NM024B U 1 - 288:9 284 UConf Online - 7.276 TiB SAS SSD - 512B ST8000NM024B U 1 - 288:10 285 UConf Online - 7.276 TiB SAS SSD - 512B ST8000NM024B U 1 - 288:11 286 UConf Online - 7.276 TiB SAS SSD - 512B ST8000NM024B U 1 - ----------------------------------------------------------------------------------------------------- # Note: The lines we are looking for are the ones with "UConf" in the "State" column. # We need to take note of two values: # - ENCLOSURE_DEVICE_ID: The value of "EID" column. (288 in this example output) # - SLOT_NUMBER: The value of "Slt" column. (from 0 to 11 in this example output)
For each data disk, set the drive in JBOD mode
Replace
<ENCLOSURE_DEVICE_ID>and<SLOT_NUMBER>placeholders with the value from the previous step.[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/perccli2/perccli2 /c$CONTROLLER_INDEX /e<ENCLOSURE_DEVICE_ID> /s<SLOT_NUMBER> set jbod
Ensure all SSD data drive are correctly set-up in JBOD and Online.
[artesca-os@<NODE_NAME> ~]$sudo /opt/MegaRAID/perccli2/perccli2 /c$CONTROLLER_INDEX /eall /sall show
----------------------------------------------------------------------------------------------------- EID:Slt PID State Status DG Size Intf Med SED_Type SeSz Model Sp LU/NS Count Alt-EID ----------------------------------------------------------------------------------------------------- 288:0 275 Conf Online - 7.276 TiB SAS SSD JBOD 512B ST8000NM024B U 1 - 288:1 276 Conf Online - 7.276 TiB SAS SSD JBOD 512B ST8000NM024B U 1 - 288:2 277 Conf Online - 7.276 TiB SAS SSD JBOD 512B ST8000NM024B U 1 - 288:3 278 Conf Online - 7.276 TiB SAS SSD JBOD 512B ST8000NM024B U 1 - 288:4 279 Conf Online - 7.276 TiB SAS SSD JBOD 512B ST8000NM024B U 1 - 288:5 280 Conf Online - 7.276 TiB SAS SSD JBOD 512B ST8000NM024B U 1 - 288:6 281 Conf Online - 7.276 TiB SAS SSD JBOD 512B ST8000NM024B U 1 - 288:7 282 Conf Online - 7.276 TiB SAS SSD JBOD 512B ST8000NM024B U 1 - 288:8 283 Conf Online - 7.276 TiB SAS SSD JBOD 512B ST8000NM024B U 1 - 288:9 284 Conf Online - 7.276 TiB SAS SSD JBOD 512B ST8000NM024B U 1 - 288:10 285 Conf Online - 7.276 TiB SAS SSD JBOD 512B ST8000NM024B U 1 - 288:11 286 Conf Online - 7.276 TiB SAS SSD JBOD 512B ST8000NM024B U 1 - -----------------------------------------------------------------------------------------------------
SSH Configuration¶
When deploying a multi-node cluster, each machine must be accessible using SSH from the Bootstrap node (the node used to run the Installer). SSH access must rely on an authorized passwordless SSH key as password-based SSH access is not supported.
When generating the configuration file, the Installer needs a valid SSH key, which needs to be authorized on other machines.
Tip
You can also manually configure SSH access using an already existing SSH key, but
ensure the private key used is stored under the /etc/metalk8s/pki/
directory.
Follow this procedure to generate a new SSH key that will be used by the ARTESCA Installer.
Prepare the MetalK8s PKI directory.
[artesca-os@bootstrap ~]$sudo mkdir -p /etc/metalk8s/pki
Generate the passwordless SSH key.
[artesca-os@bootstrap ~]$sudo ssh-keygen -t rsa -b 4096 -N '' -f /etc/metalk8s/pki/salt-bootstrap
Warning
Although the key name is not critical, it is the default one used during the installer configuration generation.
Upload the public key to other machines.
[artesca-os@bootstrap ~]$ssh-copy-id -f -i /etc/metalk8s/pki/salt-bootstrap.pub artesca-os@<node_ip>
This command adds the contents of the local
/etc/metalk8s/pki/salt-bootstrap.pubpublic key to the/home/artesca-os/.ssh/authorized_keysfile on the remote machine. Repeat this step for each machine in the cluster.
Next Step¶
You have deployed the ARTESCA Operating System. You can now proceed with Deploy the ARTESCA Software Components.

