Sunday, 10 April 2011

Hardware RAID configuration in T3-1 Oracle server

Today I got a chance to configure Hardware RAID in T3-1 oracle server.
T3-1 servers are recently launched Chip Multithread servers (CMT) from oracle which provides a good platform for virtualization applications especially for LDOMS(Unfortunate that i havent tried yet),Containers..
The method of configuring Hardware Raid is simple.The thing is that we will get confused after following steps suggested from Oracle.I have made it simpler.Its mentioned below.Seems Interesting.

Login to the server,you will find 2 harddisk in the server(By default).

1)root@PSBL223 # format
Searching for disks...done




AVAILABLE DISK SELECTIONS:
       0. c0t5000CCA0151C7EB4d0 <SUN300G cyl 46873 alt 2 hd 20 sec 625>
          /scsi_vhci/disk@g5000cca0151c7eb4
       1. c0t5000CCA0151C7F80d0 <SUN300G cyl 46873 alt 2 hd 20 sec 625>
          /scsi_vhci/disk@g5000cca0151c7f80
Specify disk (enter its number): ^C
-----------------------------------------------------------
Now poweroff server to go to SC prompt.What i did was, i gave a tip connection from another solaris server and worked from a remote location.

2)#init 5
-----------------------------------------------------------
Start the SP console. 
Note: Before starting the console please check in which all slots are the HDD's are  inserted in.When I got the server 2 HDD's were there, in which 1 HDD was in the 0th slot and other one in 3rd slot.What i did was i took out the HDD from 3rd slot and inserted it in 1st slot

3)-->start /SYS

Are you sure you want to start /SYS (y/n)? y
Starting /SYS
 /SYS
      Targets: 
           MB 
           MB_ENV 
           USBBD  
           DVD  
           PS0 
           PS1 
           SASBP 
           PDB 
           CONNBD 
           FANBD 
           INTSW 
           PWRBS 
           VPS 
           T_AMB 
           OK 
           LOCATE  
           SERVICE 
           PS_FAULT 
           TEMP_FAULT 
           FAN_FAULT 

    Properties:
           type = Host System 
           ipmi_name = /SYS 
           keyswitch_state = Normal 
           product_name = SPARC T3-1 
           product_part_number = 4745525-4 
           product_serial_number = 1052BDR5A3 
           product_manufacturer = Oracle Corporation 
          fault_state = OK 
          clear_fault_action = (none) 
          power_state = On 

    Commands: 
         cd 
         reset 
         set 
         show 
         start 
         stop
 
----------------------------------------------------------------
Now you can go to the console from SP conssole

4)-> start /HOST/console

Are you sure you want to start /HOST/console (y/n)? y


Serial console started.  To stop, type #.

----------------------------------------------------------------

Check for all the devices connected in server using below command and you will find the below output

5){0} ok show-devs
/pci-performance-counters@400
/niu@480
/pci@400
/cpu@7f
/cpu@7e
/cpu@7d
/cpu@7c
/cpu@7b
/cpu@7a
/cpu@79
/cpu@78
/cpu@77
/cpu@76
/cpu@75
/cpu@74
/cpu@73
/cpu@72
/cpu@71
/cpu@70
/cpu@6f
/cpu@6e
/cpu@6d
[7m More [<space>,<cr>,q,n,p,c] ? [m
                               
/cpu@6c
/cpu@6b
/cpu@6a
/cpu@69
/cpu@68
/cpu@67
/cpu@66
/cpu@65
/cpu@64
/cpu@63
/cpu@62
/cpu@61
/cpu@60
/cpu@5f
/cpu@5e
/cpu@5d
/cpu@5c
/cpu@5b
/cpu@5a
/cpu@59
/cpu@58
/cpu@57
/cpu@56
[7m More [<space>,<cr>,q,n,p,c] ? [m
                               
/cpu@55
/cpu@54
/cpu@53
/cpu@52
/cpu@51
/cpu@50
/cpu@4f
/cpu@4e
/cpu@4d
/cpu@4c
/cpu@4b
/cpu@4a
/cpu@49
/cpu@48
/cpu@47
/cpu@46
/cpu@45
/cpu@44
/cpu@43
/cpu@42
/cpu@41
/cpu@40
/cpu@3f
[7m More [<space>,<cr>,q,n,p,c] ? [m
                               
/cpu@3e
/cpu@3d
/cpu@3c
/cpu@3b
/cpu@3a
/cpu@39
/cpu@38
/cpu@37
/cpu@36
/cpu@35
/cpu@34
/cpu@33
/cpu@32
/cpu@31
/cpu@30
/cpu@2f
/cpu@2e
/cpu@2d
/cpu@2c
/cpu@2b
/cpu@2a
/cpu@29
/cpu@28
[7m More [<space>,<cr>,q,n,p,c] ? [m
                               
/cpu@27
/cpu@26
/cpu@25
/cpu@24
/cpu@23
/cpu@22
/cpu@21
/cpu@20
/cpu@1f
/cpu@1e
/cpu@1d
/cpu@1c
/cpu@1b
/cpu@1a
/cpu@19
/cpu@18
/cpu@17
/cpu@16
/cpu@15
/cpu@14
/cpu@13
/cpu@12
/cpu@11
[7m More [<space>,<cr>,q,n,p,c] ? [m
                               
/cpu@10
/cpu@f
/cpu@e
/cpu@d
/cpu@c
/cpu@b
/cpu@a
/cpu@9
/cpu@8
/cpu@7
/cpu@6
/cpu@5
/cpu@4
/cpu@3
/cpu@2
/cpu@1
/cpu@0
/virtual-devices@100
/iscsi-hba
/virtual-memory
/memory@m0,20000000
/aliases
/options
[7m More [<space>,<cr>,q,n,p,c] ? [m
                               
/openprom
/chosen
/packages
/pci@400/pci@2
/pci@400/pci@1
/pci@400/pci@2/pci@0
/pci@400/pci@2/pci@0/pci@f
/pci@400/pci@2/pci@0/pci@c
/pci@400/pci@2/pci@0/pci@a
/pci@400/pci@2/pci@0/pci@8
/pci@400/pci@2/pci@0/pci@7
/pci@400/pci@2/pci@0/pci@6
/pci@400/pci@2/pci@0/pci@4
/pci@400/pci@2/pci@0/pci@0
/pci@400/pci@2/pci@0/pci@f/pci@0
/pci@400/pci@2/pci@0/pci@f/pci@0/usb@0,2
[7m More [<space>,<cr>,q,n,p,c] ? [m
                               
/pci@400/pci@2/pci@0/pci@f/pci@0/usb@0,1
/pci@400/pci@2/pci@0/pci@f/pci@0/usb@0
/pci@400/pci@2/pci@0/pci@f/pci@0/usb@0,2/hub@4
/pci@400/pci@2/pci@0/pci@f/pci@0/usb@0,2/hub@2
/pci@400/pci@2/pci@0/pci@f/pci@0/usb@0,2/hub@2/device@4
/pci@400/pci@2/pci@0/pci@f/pci@0/usb@0,2/hub@2/hub@3
/pci@400/pci@2/pci@0/pci@f/pci@0/usb@0,2/hub@2/device@4/mouse@1
/pci@400/pci@2/pci@0/pci@f/pci@0/usb@0,2/hub@2/device@4/keyboard@0
/pci@400/pci@2/pci@0/pci@f/pci@0/usb@0,2/hub@2/hub@3/storage@2
/pci@400/pci@2/pci@0/pci@f/pci@0/usb@0,2/hub@2/hub@3/storage@2/disk
/pci@400/pci@2/pci@0/pci@7/network@0,1
/pci@400/pci@2/pci@0/pci@7/network@0
/pci@400/pci@2/pci@0/pci@6/network@0,1
/pci@400/pci@2/pci@0/pci@6/network@0
/pci@400/pci@2/pci@0/pci@4/scsi@0
/pci@400/pci@2/pci@0/pci@4/scsi@0/disk
/pci@400/pci@2/pci@0/pci@4/scsi@0/tape
/pci@400/pci@2/pci@0/pci@0/pci@0
/pci@400/pci@2/pci@0/pci@0/pci@0/display@0
/pci@400/pci@1/pci@0
/pci@400/pci@1/pci@0/pci@8
/pci@400/pci@1/pci@0/pci@6
/pci@400/pci@1/pci@0/pci@4
[7m More [<space>,<cr>,q,n,p,c] ? [m
                               
/pci@400/pci@1/pci@0/pci@0
/pci@400/pci@1/pci@0/pci@4/scsi@0
/pci@400/pci@1/pci@0/pci@4/scsi@0/disk
/pci@400/pci@1/pci@0/pci@4/scsi@0/tape
/virtual-devices@100/channel-devices@200
/virtual-devices@100/console@1
/virtual-devices@100/random-number-generator@e
/virtual-devices@100/ncp@6
/virtual-devices@100/n2cp@7
/virtual-devices@100/tpm@f
/virtual-devices@100/flashprom@0
/virtual-devices@100/channel-devices@200/virtual-domain-service@0
/virtual-devices@100/channel-devices@200/virtual-channel-client@2
/virtual-devices@100/channel-devices@200/virtual-channel-client@1
/virtual-devices@100/channel-devices@200/virtual-channel@3
/virtual-devices@100/channel-devices@200/virtual-channel@0
/iscsi-hba/disk
/openprom/client-services
/packages/obp-tftp
/packages/kbd-translator
/packages/SUNW,asr
/packages/dropins
/packages/terminal-emulator
[7m More [<space>,<cr>,q,n,p,c] ? [m
                               
/packages/disk-label
/packages/deblocker
/packages/SUNW,builtin-drivers
{0} ok    
{0} ok  


----------------------------------------------------------------------------
Run probe-scsi-all command and check its showing all targets present in the server
Here you can find 2 targets Target 9 and Target a,though only Target 9 is working..we need to select new SCSI device.

6){0} ok probe-scsi-all
/pci@400/pci@2/pci@0/pci@f/pci@0/usb@0,2/hub@2/hub@3/storage@2
  Unit 0   Removable Read Only device       AMI     Virtual CDROM   1.00

/pci@400/pci@2/pci@0/pci@4/scsi@0

FCode Version 1.00.54 , MPT Version 2.00, Firmware Version 5.00.17.00

Target 9 
  Unit 0   Disk   HITACHI  H103030SCSUN300G A2A8    585937500 Blocks, 300 GB
  SASDeviceName 5000cca0151c7f80  SASAddress 5000cca0151c7f81  PhyNum 0 
Target a 
  Unit 0   Removable Read Only device      TEAC    DV-W28SS-R      1.0C                                                            
  SATA device  PhyNum 6 

/pci@400/pci@1/pci@0/pci@4/scsi@0

FCode Version 1.00.54 , MPT Version 2.00, Firmware Version 5.00.17.00

Target 9 
  Unit 0   Disk   HITACHI  H103030SCSUN300G A2A8    585937500 Blocks, 300 GB
  SASDeviceName 5000cca0151c7eb4  SASAddress 5000cca0151c7eb5  PhyNum 0 

-------------------------------------------------------------------------------------------

Now if you give you show-children we can clearly see only one target.

7){0} ok select /pci@400/pci@1/pci@0/pci@4/scsi@0  (or select scsi0)

   {0} ok show-children

FCode Version 1.00.54 , MPT Version 2.00, Firmware Version 5.00.17.00

Target 9 
  Unit 0   Disk   HITACHI  H103030SCSUN300G A2A8    585937500 Blocks, 300 GB
  SASDeviceName 5000cca0151c7eb4  SASAddress 5000cca0151c7eb5  PhyNum 0 


-----------------------------------------------------------------
Now select the other scsi1 in which we have inserted the 2nd Hdd. The 2 devices needed to be selected i have marked in red colour in show-devs OBP command

8){0} ok select /pci@400/pci@2/pci@0/pci@4/scsi@0

{0} ok show-children

FCode Version 1.00.54, MPT Version 2.00, Firmware Version 5.00.17.00

Target 9
  Unit 0   Disk   HITACHI  H103030SCSUN300G A2A8    585937500 Blocks, 300 GB
  SASDeviceName 5000cca0151c7eb4  SASAddress 5000cca0151c7eb5  PhyNum 0
Target a
  Unit 0   Disk   HITACHI  H103030SCSUN300G A2A8    585937500 Blocks, 300 GB
  SASDeviceName 5000cca0151c7f80  SASAddress 5000cca0151c7f81  PhyNum 1


-----------------------------------------------------------------

Now you can create a RAID using following command with volume size and a volume name.

9){0} ok 9 a create-raid1-volume
Target 9 size is 583983104 Blocks, 298 GB
Target a size is 583983104 Blocks, 298 GB
The volume can be any size from 1 MB to 285148 MB
What size do you want?  [285148]
Volume size will be 583983104 Blocks, 298 GB
Enter a volume name:  [0 to 15 characters] v0
Volume has been created
 
-----------------------------------------------------------------------------

Check for if its showing volumes properly

10){0} ok show-volumes
Volume 0 Target 389  Type RAID1 (Mirroring)
  Name v0  WWID 04b8a3893433dc55
  Optimal  Enabled  Background Init In Progress
  2 Members                                         583983104 Blocks, 298 GB
  Disk 0
    Primary  Optimal
    Target 9      HITACHI  H103030SCSUN300G A2A8
  Disk 1
    Secondary  Optimal
    Target a      HITACHI  H103030SCSUN300G A2A8
-------------------------------------------------------------
After starting the server please verify the format output that it will show only one disk as Raid formation of 2 disk.
11)# format
Searching for disks...done

c0t34B8A3893433DC55d0: configured with capacity of 277.99GB


AVAILABLE DISK SELECTIONS:
       0. c0t34B8A3893433DC55d0 <LSI-LogicalVolume-3000 cyl 65533 alt 2 hd 64 sec 139>
          /pci@400/pci@1/pci@0/pci@4/scsi@0/iport@v0/disk@w34b8a3893433dc55,0
Specify disk (enter its number): 0
selecting c0t34B8A3893433DC55d0
[disk formatted]
Disk not labeled.  Label it now? n
Thus Hardware RAID is configured..In case of any doubts please ask your questions  in my blog..

No comments:

Post a Comment