How to replace the USB boot drive in X5-2L/6L in High Capacity configuration in Exadata.

Image version 12.1.2.3.3.161208 ,High Capacity configuration

1,Turn on the locate indicator light ‘on’ for easier identification of the server being repaired. Login to the CellCli:
CellCli> alter cell led on
2,Verify DISK_REPAIR_TIME attribute value
SQL> select dg.name,a.value from v$asm_attribute a, v$asm_diskgroup dg where a.name = 'disk_repair_time' and a.group_number = dg.group_number;
3,Check if ASM will be OK if the grid disks go OFFLINE.
# cellcli -e list griddisk attributes name,asmmodestatus,asmdeactivationoutcome
If one or more disks return asmdeactivationoutcome='No', then wait for some time Once all disks return asmdeactivationoutcome='Yes', proceed to the next step.
4, Run cellcli command to Inactivate all grid disks on the cell that needs to be powered down for maintenance. (this could take up to 10 minutes or longer)
# cellcli
...sample ...
CellCLI> ALTER GRIDDISK ALL INACTIVE
GridDisk D ATA_CD_00_hostname  successfully altered GridDisk RECO_CD_02_dmorlx8cel01 successfully altered ...repeated for all griddisks...
5,Execute the command below and the output should show asmmodestatus='UNUSED' or 'OFFLINE' and asmdeactivationoutcome=Yes for all griddisks once the disks are offline and inactive in ASM.
CellCLI> list griddisk attributes name,status,asmmodestatus,asmdeactivationoutcome
DATA_CD_00_hostname  inactive OFFLINE Yes RECO_CD_02_hostname inactive OFFLINE Yes ...repeated for all griddisks...
6,Once all disks are offline and inactive, the customer may shutdown the Cell using the following command:
# shutdown -hP now
============Field Engineer to replace USB drive=======
1. Remove and replace the USB thumb drive from the internal USB port.Make a note of which slot the USB drive is inserted into ,there are two USB slots.

On Exadata Storage Server based on a Oracle Server X5-2L, the internal USB ports are located near the

handle on the Rear I/O daughter board located between PCIe slots 3 and 4.

2. Replace the server’s top cover and re-attach the AC power cords. ILOM will take up to 2 minutes to boot.
3. Slide the server back into the rack.
4. After ILOM has booted, power on the server by pressing the power button, and then connect to the server’s console.
==========================================================
From the ILOM CLI:
→ start /SP/console
5. From the console and monitor the system booting. The server should boot from the primary hard disk. This will be mentioned in the Exadata splash screen.
6. After the Storage Server is booted, login as ‘root’ user.
7. Run the following to copy the recovery image and configuration data to the new USB stick:
# cd /opt/oracle.SupportTools
# ./make_cellboot_usb -verbose -force
8. Set the next boot to forcibly stop at the BIOS setup menu:
# ipmitool chassis bootdev bios
9. Reboot the server with the following command:
# shutdown -r now
10. Monitor the system booting again. The system should go automatically into the BIOS Setup screen.
11. Once the BIOS Setup screen is displayed on the console, use the arrow keys to navigate to the Boot screen .Check the "Legacy Boot Option Priority" list . Set the "USB:USBIN0:ORACLE SSM PMAP" to be the first boot device , followed by “PCI RAID Adapter” followed by the onboard network PXE devices. Press “Esc” to exit the ‘Boot Order Device Priority’ screen
12. Navigate to the Exit screen and select “Save Changes and Exit”
13. The server will boot . This time it should load the Exadata splash screen (grub) from the USB stick and indicate as such.