Friday 29 April 2011

DYNAMIC RECONFIGURATION IN E20k

Today I learnt a very interesting thing,that i got a chance for Dynamic Reconfiguration in E20k.For these many days i have heard about board replacement in E20k Oracle Solaris Enterprise Server.I was a bit worried as our soul of production was running on this box, more than that a single board of E20k costs Rs.60-70lakh.In case if any error happens...god its end of story.and now i don't know how i did that...

In our E20k box we have about 5 domains running with siebel Database taking 5 boards and 2 IO.All the domains are configured in Sun Cluster.I was asked to take a board from Siebel (SB6) and add it to another domain running SAP database.The board to be replaced was with 32 Gb

In this scenario:
C domain is Siebel 
D domain is SAP.

Before Starting the activity i made a copy of all important outputs like df -h, ifconfig -a, /etc/vfstab, /etc/system, /etc/hosts, metadb, metastat, metaset -a, metainit 'metaset', scstat -g, scstat -q, scstat -i, scstat, scdidadm -L,scdidadm -l, scconf -pv, dfshares, prtconf -pvv, prtdiag -v format and almost all the outputs neccessary. 

Below i have mentioned everything in a step by step method:

1)first  i logged into domain siebel and checked the memory size with a 3rd party tool 'TOP'

root@PSBLD008 # top
 [H [Jlast pid: 22624;  load averages:  3.27,  3.32,  3.06 [1;149H04:12:07
693 processes: 685 sleeping, 2 zombie, 2 stopped, 4 on cpu
CPU states:     % idle,     % user,     % kernel,     % iowait,     % swap
Memory: 96G real, 75G free, 15G swap in use, 102G swap free

   PID USERNAME LWP PRI NICE  SIZE   RES STATE    TIME    CPU COMMAND
  5648 dbmonito  46   0    2   12G 8296M cpu/130  64:13  1.73% oracle
 19285 dbmonito   1   0    2   12G 8382M cpu/96  19:54  1.33% oracle
 19283 dbmonito   1   0    2   12G 8382M cpu/133  19:10  1.22% oracle
 19281 dbmonito  11  35    2   12G 8384M sleep    1:32  0.66% oracle
 19279 dbmonito  11  35    2   12G 8382M sleep    1:14  0.57% oracle
 23560 oracle     1  60    0   12G 8279M sleep  109:17  0.41% oracle
 16271 oracle     1  60    0   12G 8281M sleep   51:05  0.21% oracle
 21497 oracle     1  22    0   12G 8276M sleep  344:45  0.16% oracle
 23987 oracle     1  60    0   12G 8283M sleep   34:20  0.13% oracle
 22925 oracle     1  40    0   12G 8276M sleep  341:59  0.08% oracle
 20787 oracle     1  43    0   12G 8277M sleep  257:22  0.07% oracle
 22624 root       1   3    0 3472K 2432K cpu/160   0:00  0.06% top
 18093 oracle     1  41    0   12G 8277M sleep  258:14  0.05% oracle
  1651 oracle     1  40    0   12G 8278M sleep  193:11  0.04% oracle
 22222 oracle     1  42    0   12G 8287M sleep    0:07  0.04% oracle
(you can check this using command prtdiag -v |grep -i memory, or any other command to check memory)
we can notice that total memory is 96 Gb.
-------------------------------------------------------
2)login to the console of E20k.the console is called SMS.and here u need to 'su' to sms-svc user to do sms operations,which is a user by default in console.
And check for all the platforms 
root@T-Sky-20K-2-sc1 #su - sms-svc
T-Sky-20K-2-sc1:sms-svc:1>
T-Sky-20K-2-sc1:sms-svc:1>bash
bash-2.05$ showboards
Retrieving board information. Please wait.
........
Location    Pwr    Type of Board   Board Status  Test Status   Domain
--------    ---    -------------   ------------  -----------   ------
SB0          -     Empty Slot      Assigned          -         A
SB1         On     V3CPU           Active        Passed        A
SB2         On     V3CPU           Active        Passed        B
SB3         On     V3CPU           Active        Passed        C
SB4         On     V3CPU           Active        Passed        C
SB5         On     V3CPU           Active        Passed        C
SB6         On     V3CPU           Active        Passed        C
SB7         On     V3CPU           Active        Passed        D
SB8         On     V3CPU           Active        Passed        E
SB9          -     Empty Slot      Available         -         Isolated
SB10         -     Empty Slot      Available         -         Isolated
SB11         -     Empty Slot      Available         -         Isolated
SB12         -     Empty Slot      Available         -         Isolated
SB13         -     Empty Slot      Available         -         Isolated
SB14         -     Empty Slot      Available         -         Isolated
SB15         -     Empty Slot      Available         -         Isolated
SB16         -     Empty Slot      Available         -         Isolated
SB17         -     Empty Slot      Available         -         Isolated
IO0         On     HPCI+           Active        Passed        A
IO1         On     HPCI+           Active        Passed        A
IO2         On     HPCI+           Active        Passed        B
IO3         On     HPCI+           Active        Passed        B
IO4         On     HPCI+           Active        Passed        C
IO5         On     HPCI+           Active        Passed        C
IO6         On     HPCI+           Assigned      Failed        D
IO7         On     HPCI+           Active        Passed        D
IO8         On     HPCI+           Active        Passed        E
IO9          -     Empty Slot      Available         -         Isolated
IO10         -     Empty Slot      Available         -         Isolated
IO11         -     Empty Slot      Available         -         Isolated
IO12         -     Empty Slot      Available         -         Isolated
IO13         -     Empty Slot      Available         -         Isolated
IO14         -     Empty Slot      Available         -         Isolated
IO15         -     Empty Slot      Available         -         Isolated
IO16         -     Empty Slot      Available         -         Isolated
IO17         -     Empty Slot      Available         -         Isolated
bash-2.05$ showplatform

PLATFORM:
=========
Platform Type: Sun Fire E20K

CSN:
====
Chassis Serial Number: 0609AK20BA

COD:
====
Chassis HostID: 5014936D87943
Proc RTUs installed: 0
PROC Headroom Quantity: 0
Proc RTUs reserved for domain A: 0
Proc RTUs reserved for domain B: 0
Proc RTUs reserved for domain C: 0
Proc RTUs reserved for domain D: 0
Proc RTUs reserved for domain E: 0
Proc RTUs reserved for domain F: 0
Proc RTUs reserved for domain G: 0
Proc RTUs reserved for domain H: 0
Proc RTUs reserved for domain I: 0
Proc RTUs reserved for domain J: 0
Proc RTUs reserved for domain K: 0
Proc RTUs reserved for domain L: 0
Proc RTUs reserved for domain M: 0
Proc RTUs reserved for domain N: 0
Proc RTUs reserved for domain O: 0
Proc RTUs reserved for domain P: 0
Proc RTUs reserved for domain Q: 0
Proc RTUs reserved for domain R: 0


Available Component List for Domains:
=====================================
Available Component List for domain A:
 No System boards
 No IO boards

Available Component List for domain B:
 No System boards
 No IO boards

Available Component List for domain C:
 No System boards
 No IO boards

Available Component List for domain D:
 No System boards
 No IO boards

Available Component List for domain E:
 No System boards
 No IO boards

Available Component List for domain F:
 No System boards
 No IO boards

Available Component List for domain G:
 No System boards
 No IO boards

Available Component List for domain H:
 No System boards
 No IO boards

Available Component List for domain I:
 No System boards
 No IO boards

Available Component List for domain J:
 No System boards
 No IO boards

Available Component List for domain K:
 No System boards
 No IO boards

Available Component List for domain L:
 No System boards
 No IO boards

Available Component List for domain M:
 No System boards
 No IO boards

Available Component List for domain N:
 No System boards
 No IO boards

Available Component List for domain O:
 No System boards
 No IO boards

Available Component List for domain P:
 No System boards
 No IO boards

Available Component List for domain Q:
 No System boards
 No IO boards

Available Component List for domain R:
 No System boards
 No IO boards


Domain Ethernet Addresses:
==========================
Domain ID   Domain Tag        Ethernet Address
A           -                 0:0:be:a9:fc:24
B           -                 0:0:be:a9:fc:25
C           -                 0:0:be:a9:fc:26
D           -                 0:0:be:a9:fc:27
E           -                 0:0:be:a9:fc:28
F           -                 0:0:be:a9:fc:29
G           -                 0:0:be:a9:fc:2a
H           -                 0:0:be:a9:fc:2b
I           -                 0:0:be:a9:fc:2c
J           -                 0:0:be:a9:fc:2d
K           -                 0:0:be:a9:fc:2e
L           -                 0:0:be:a9:fc:2f
M           -                 0:0:be:a9:fc:30
N           -                 0:0:be:a9:fc:31
O           -                 0:0:be:a9:fc:32
P           -                 0:0:be:a9:fc:33
Q           -                 0:0:be:a9:fc:34
R           -                 0:0:be:a9:fc:35


Domain configurations:
======================
Domain ID   Domain Tag        Solaris Nodename       Domain Status
A           -                 PKEND021               Running Solaris
B           -                 PKENA019               Running Solaris
C           -                 PSBLD008               Running Solaris
D           -                 -                      Powered Off
E           -                 PEAID015               Running Solaris
F           -                 -                      Powered Off
G           -                 -                      Powered Off
H           -                 -                      Powered Off
I           -                 -                      Powered Off
J           -                 -                      Powered Off
K           -                 -                      Powered Off
L           -                 -                      Powered Off
M           -                 -                      Powered Off
N           -                 -                      Powered Off
O           -                 -                      Powered Off
P           -                 -                      Powered Off
Q           -                 -                      Powered Off
R           -                 -                      Powered Off
----------------------------------------------------------------------------------
Check whicha all are the boads for domain C(Siebel) present.
3)bash-2.05$ showboards -d C
Retrieving board information. Please wait.
......
Location    Pwr    Type of Board   Board Status  Test Status   Domain
--------    ---    -------------   ------------  -----------   ------
SB3         On     V3CPU           Active        Passed        C
SB4         On     V3CPU           Active        Passed        C
SB5         On     V3CPU           Active        Passed        C
SB6         On     V3CPU           Active        Passed        C
SB7         On     V3CPU           Active        Passed        C
SB9          -     Empty Slot      Available         -         Isolated
SB10         -     Empty Slot      Available         -         Isolated
SB11         -     Empty Slot      Available         -         Isolated
SB12         -     Empty Slot      Available         -         Isolated
SB13         -     Empty Slot      Available         -         Isolated
SB14         -     Empty Slot      Available         -         Isolated
SB15         -     Empty Slot      Available         -         Isolated
SB16         -     Empty Slot      Available         -         Isolated
SB17         -     Empty Slot      Available         -         Isolated
IO4         On     HPCI+           Active        Passed        C
IO5         On     HPCI+           Active        Passed        C
IO9          -     Empty Slot      Available         -         Isolated
IO10         -     Empty Slot      Available         -         Isolated
IO11         -     Empty Slot      Available         -         Isolated
IO12         -     Empty Slot      Available         -         Isolated
IO13         -     Empty Slot      Available         -         Isolated
IO14         -     Empty Slot      Available         -         Isolated
IO15         -     Empty Slot      Available         -         Isolated
IO16         -     Empty Slot      Available         -         Isolated
IO17         -     Empty Slot      Available         -         Isolated
we can see that Domain C is using Boards SB3,SB4,SB5,SB6,SB7 with IO4 and IO5.
we want to reconfigure SB6 to Domain D.
--------------------------------------------------------------------------
Login to the domain C and check for the boards configured.Also check which is permanant board
4)bash-2.05$ console -d C
root@PSBLD008 # cfgadm -alv |grep -i permanent
SB5::memory                    connected    configured   ok         base address 0x20000000000, 16777216 KBytes total, 14916912 KBytes permanent
root@PSBLD008 # cfgadm -l -s "select=class(sbd)"
Ap_Id                          Type         Receptacle   Occupant     Condition
IO4                            HPCI+        connected    configured   ok
IO5                            HPCI+        connected    configured   ok
SB3                            V3CPU        connected    configured   ok
SB4                            V3CPU        connected    configured   ok
SB5                            V3CPU        connected    configured   ok
SB6                            V3CPU        connected    configured   ok
SB7                            V3CPU        connected    configured   ok
--------------------------------------------------------------------
now we will unconfigure the 6th board SB6 and check with top command whether the memory has changed or not.
5)root@PSBLD008 #cfgadm -v -c unconfigure SB6

request delete capacity (8 cpus)
request delete capacity (4194304 pages)
request delete capacity SB6 done
request offline SUNW_cpu/cpu192
request offline SUNW_cpu/cpu196
request offline SUNW_cpu/cpu193
request offline SUNW_cpu/cpu197
request offline SUNW_cpu/cpu194
request offline SUNW_cpu/cpu198
request offline SUNW_cpu/cpu195
request offline SUNW_cpu/cpu199
request offline SUNW_cpu/cpu192 done
request offline SUNW_cpu/cpu196 done
request offline SUNW_cpu/cpu193 done
request offline SUNW_cpu/cpu197 done
request offline SUNW_cpu/cpu194 done
request offline SUNW_cpu/cpu198 done
request offline SUNW_cpu/cpu195 done
request offline SUNW_cpu/cpu199 done
unconfigure SB6

Apr 27 00:20:13 PSBLD008 dr: OS unconfigure dr@0:SB6::cpu0
Apr 27 00:20:24 PSBLD008 dr: OS unconfigure dr@0:SB6::cpu1
Apr 27 00:20:45 PSBLD008 dr: OS unconfigure dr@0:SB6::cpu2
Apr 27 00:20:57 PSBLD008 dr: OS unconfigure dr@0:SB6::cpu3
Apr 27 00:21:18 PSBLD008 dr: OS unconfigure dr@0:SB6::memory
unconfigure SB6 done
notify remove SUNW_cpu/cpu192
notify remove SUNW_cpu/cpu196
notify remove SUNW_cpu/cpu193
notify remove SUNW_cpu/cpu197
notify remove SUNW_cpu/cpu194
notify remove SUNW_cpu/cpu198
notify remove SUNW_cpu/cpu195
notify remove SUNW_cpu/cpu199
notify remove SUNW_cpu/cpu192 done
notify remove SUNW_cpu/cpu196 done
notify remove SUNW_cpu/cpu193 done
notify remove SUNW_cpu/cpu197 done
notify remove SUNW_cpu/cpu194 done
notify remove SUNW_cpu/cpu198 done
notify remove SUNW_cpu/cpu195 done
notify remove SUNW_cpu/cpu199 done
notify capacity change (8 cpus)
notify capacity change (4194304 pages)
notify capacity change SB6 done
you have mail
root@PSBLD008 #
root@PSBLD008 # top
 [H [Jlast pid: 20303;  load averages:  6.22,  6.37,  5.07 [1;149H00:26:34
1023 processes:1015 sleeping, 3 zombie, 2 stopped, 3 on cpu
CPU states:     % idle,     % user,     % kernel,     % iowait,     % swap
Memory: 64G real, 43G free, 16G swap in use, 72G swap free

   PID USERNAME LWP PRI NICE  SIZE   RES STATE    TIME    CPU COMMAND
 17385 dbmonito  11   0    2   12G 8271M sleep    7:37  2.34% oracle
 18962 oracle     1   0    0   12G 8261M cpu/224   4:50  2.30% oracle
 17391 dbmonito  11   0    2   12G 8308M sleep    6:17  1.55% oracle
 17389 dbmonito  11   0    2   12G 8305M sleep    6:15  1.54% oracle
 17130 oracle     1   0    0   12G 8258M sleep    3:52  1.08% oracle
 15334 oracle     1  60    0   12G 8258M sleep    6:29  0.98% oracle
 17383 dbmonito  11  15    2   12G 8309M sleep    1:35  0.46% oracle
 21602 oracle     1  46    0   12G 8258M cpu/161 304:05  0.23% oracle
  2823 oracle     1  30    0   12G 8258M sleep    0:48  0.14% oracle
 22925 oracle     1  40    0   12G 8256M sleep  331:53  0.13% oracle
 21497 oracle     1  40    0   12G 8256M sleep  334:40  0.12% oracle
 15185 oracle    11  60    0   12G 8262M sleep    0:49  0.10% oracle
 20303 root       1   0    0 3728K 2688K cpu/128   0:00  0.09% top
  3508 oracle    20  53    0   12G 8247M sleep  124.9H  0.09% oracle
 20639 oracle     1  45    0   12G 8260M sleep    0:13  0.09% oracle
--------------------------------------------------------------------------
Login to console and again check for board status
6)
bash-2.05$ showboards -d C
Retrieving board information. Please wait.
.............
Location    Pwr    Type of Board   Board Status  Test Status   Domain
--------    ---    -------------   ------------  -----------   ------
SB3         On     V3CPU           Active        Passed        C
SB4         On     V3CPU           Active        Passed        C
SB5         On     V3CPU           Active        Passed        C
SB6         On     V3CPU           Active        Passed        C
SB7         On     V3CPU           Active        Passed        C
SB9          -     Empty Slot      Available         -         Isolated
SB10         -     Empty Slot      Available         -         Isolated
SB11         -     Empty Slot      Available         -         Isolated
SB12         -     Empty Slot      Available         -         Isolated
SB13         -     Empty Slot      Available         -         Isolated
SB14         -     Empty Slot      Available         -         Isolated
SB15         -     Empty Slot      Available         -         Isolated
SB16         -     Empty Slot      Available         -         Isolated
SB17         -     Empty Slot      Available         -         Isolated
IO4         On     HPCI+           Active        Passed        C
IO5         On     HPCI+           Active        Passed        C
IO9          -     Empty Slot      Available         -         Isolated
IO10         -     Empty Slot      Available         -         Isolated
IO11         -     Empty Slot      Available         -         Isolated
IO12         -     Empty Slot      Available         -         Isolated
IO13         -     Empty Slot      Available         -         Isolated
IO14         -     Empty Slot      Available         -         Isolated
IO15         -     Empty Slot      Available         -         Isolated
IO16         -     Empty Slot      Available         -         Isolated
IO17         -     Empty Slot      Available         -         Isolated

again we will find the board as active and still configured so we need to disconnect and delete this board.
------------------------------------------------------------
Login again to domain C to disconnect the board
7)console -d C
Trying to connect...
Connected to Domain Server.
Your console is in exclusive mode now.

|-----------------------------------------------------------------|
| This system is for the use of authorized users only.            |
| Individuals using this computer system without authority, or in |
| excess of their authority, are subject to having all of their   |
| activities on this system monitored and recorded by system      |
| personnel.                                                      |
|                                                                 |
| In the course of monitoring individuals improperly using this   |
| system, or in the course of system maintenance, the activities  |
| of authorized users may also be monitored.                      |
|                                                                 |
| Anyone using this system expressly consents to such monitoring  |
| and is advised that if such monitoring reveals possible         |
| evidence of criminal activity, system personnel may provide the |
| evidence of such monitoring to law enforcement officials.       |
|-----------------------------------------------------------------|

PSBLD008 console login: root
Password: 
Last login: Tue Apr 26 23:38:33 from 10.1.41.57
Apr 27 00:28:08 PSBLD008 login: ROOT LOGIN /dev/console
Sun Microsystems Inc.   SunOS 5.9       Generic May 2002

WARNING:Only Tata Sky authorized users are permitted to use this System. 
This System is under constant surveillance and monitoring.  Any security 
violation shall lead to disciplinary action as per the Tata Sky IT User
Policies and Guidelines.  

SunOS PSBLD008 5.9 Generic_118558-21 sun4u sparc SUNW,Sun-Fire-15000

************************System Serial Number & Model********************

                            0609AK20BA

Memory size: 98304 Megabytes, (20 CPU, US-IV+ , dual core , total logical  40 )

***********************************************************************
You have new mail.
Sourcing //.profile-EIS.....
root@PSBLD008 # 
root@PSBLD008 # bash

root@PSBLD008 # cfgadm -v -c disconnect SB6
disconnect SB6
disconnect SB6 done
poweroff SB6
poweroff SB6 done
unassign SB6 skipped
root@PSBLD008 #
------------------------------------------------------------
login to console and delete the board and if you give the showboard against C and D domain, you can see the difference.Instead of adding and deleting we can do this using command 'moveboard'(moveboard -d D configure SB6).But i am describing it in a step-by-step method
8)bash-2.05$ deleteboard SB6
SB6 successfully unassigned.

bash-2.05$ showboards -d C
Retrieving board information. Please wait.
............
Location    Pwr    Type of Board   Board Status  Test Status   Domain
--------    ---    -------------   ------------  -----------   ------
SB3         On     V3CPU           Active        Passed        C
SB4         On     V3CPU           Active        Passed        C
SB5         On     V3CPU           Active        Passed        C
SB6         Off    V3CPU           Available     Unknown       Isolated
SB7         On     V3CPU           Active        Passed        C
SB9          -     Empty Slot      Available         -         Isolated
SB10         -     Empty Slot      Available         -         Isolated
SB11         -     Empty Slot      Available         -         Isolated
SB12         -     Empty Slot      Available         -         Isolated
SB13         -     Empty Slot      Available         -         Isolated
SB14         -     Empty Slot      Available         -         Isolated
SB15         -     Empty Slot      Available         -         Isolated
SB16         -     Empty Slot      Available         -         Isolated
SB17         -     Empty Slot      Available         -         Isolated
IO4         On     HPCI+           Active        Passed        C
IO5         On     HPCI+           Active        Passed        C
IO9          -     Empty Slot      Available         -         Isolated
IO10         -     Empty Slot      Available         -         Isolated
IO11         -     Empty Slot      Available         -         Isolated
IO12         -     Empty Slot      Available         -         Isolated
IO13         -     Empty Slot      Available         -         Isolated
IO14         -     Empty Slot      Available         -         Isolated
IO15         -     Empty Slot      Available         -         Isolated
IO16         -     Empty Slot      Available         -         Isolated
IO17         -     Empty Slot      Available         -         Isolated

bash-2.05$ addboard -d D SB6
Domain: D is not running. You can only "configure" a component into a running domain. Would you like to "assign" the component(s) to domain D instead (yes/no)? yes^?^? no bash-2.05$ showboards -d D Retrieving board information. Please wait. ...... Location Pwr Type of Board Board Status Test Status Domain -------- --- ------------- ------------ ----------- ------ SB6 Off V3CPU Available Unknown Isolated SB9 - Empty Slot Available - Isolated SB10 - Empty Slot Available - Isolated SB11 - Empty Slot Available - Isolated SB12 - Empty Slot Available - Isolated SB13 - Empty Slot Available - Isolated SB14 - Empty Slot Available - Isolated SB15 - Empty Slot Available - Isolated SB16 - Empty Slot Available - Isolated SB17 - Empty Slot Available - Isolated IO6 Off HPCI+ Assigned Unknown D IO7 Off HPCI+ Assigned Unknown D IO9 - Empty Slot Available - Isolated IO10 - Empty Slot Available - Isolated IO11 - Empty Slot Available - Isolated IO12 - Empty Slot Available - Isolated IO13 - Empty Slot Available - Isolated IO14 - Empty Slot Available - Isolated IO15 - Empty Slot Available - Isolated IO16 - Empty Slot Available - Isolated IO17 - Empty Slot Available - Isolated
(Don't get confused because my Domain D was already powered off).
-----------------------------------------------------------------------------------
Check for the platform again.
9)bash-2.05$ showplatform

PLATFORM:
=========
Platform Type: Sun Fire E20K

CSN:
====
Chassis Serial Number: 0609AK20BA

COD:
====
Chassis HostID: 5014936D87943
Proc RTUs installed: 0
PROC Headroom Quantity: 0
Proc RTUs reserved for domain A: 0
Proc RTUs reserved for domain B: 0
Proc RTUs reserved for domain C: 0
Proc RTUs reserved for domain D: 0
Proc RTUs reserved for domain E: 0
Proc RTUs reserved for domain F: 0
Proc RTUs reserved for domain G: 0
Proc RTUs reserved for domain H: 0
Proc RTUs reserved for domain I: 0
Proc RTUs reserved for domain J: 0
Proc RTUs reserved for domain K: 0
Proc RTUs reserved for domain L: 0
Proc RTUs reserved for domain M: 0
Proc RTUs reserved for domain N: 0
Proc RTUs reserved for domain O: 0
Proc RTUs reserved for domain P: 0
Proc RTUs reserved for domain Q: 0
Proc RTUs reserved for domain R: 0


Available Component List for Domains:
=====================================
Available Component List for domain A:
 No System boards
 No IO boards

Available Component List for domain B:
 No System boards
 No IO boards

Available Component List for domain C:
 No System boards
 No IO boards

Available Component List for domain D:
 No System boards
 No IO boards

Available Component List for domain E:
 No System boards
 No IO boards

Available Component List for domain F:
 No System boards
 No IO boards

Available Component List for domain G:
 No System boards
 No IO boards

Available Component List for domain H:
 No System boards
 No IO boards

Available Component List for domain I:
 No System boards
 No IO boards

Available Component List for domain J:
 No System boards
 No IO boards

Available Component List for domain K:
 No System boards
 No IO boards

Available Component List for domain L:
 No System boards
 No IO boards

Available Component List for domain M:
 No System boards
 No IO boards

Available Component List for domain N:
 No System boards
 No IO boards

Available Component List for domain O:
 No System boards
 No IO boards

Available Component List for domain P:
 No System boards
 No IO boards

Available Component List for domain Q:
 No System boards
 No IO boards

Available Component List for domain R:
 No System boards
 No IO boards


Domain Ethernet Addresses:
==========================
Domain ID   Domain Tag        Ethernet Address
A           -                 0:0:be:a9:fc:24
B           -                 0:0:be:a9:fc:25
C           -                 0:0:be:a9:fc:26
D           -                 0:0:be:a9:fc:27
E           -                 0:0:be:a9:fc:28
F           -                 0:0:be:a9:fc:29
G           -                 0:0:be:a9:fc:2a
H           -                 0:0:be:a9:fc:2b
I           -                 0:0:be:a9:fc:2c
J           -                 0:0:be:a9:fc:2d
K           -                 0:0:be:a9:fc:2e
L           -                 0:0:be:a9:fc:2f
M           -                 0:0:be:a9:fc:30
N           -                 0:0:be:a9:fc:31
O           -                 0:0:be:a9:fc:32
P           -                 0:0:be:a9:fc:33
Q           -                 0:0:be:a9:fc:34
R           -                 0:0:be:a9:fc:35


Domain configurations:
======================
Domain ID   Domain Tag        Solaris Nodename       Domain Status
A           -                 PKEND021               Running Solaris
B           -                 PKENA019               Running Solaris
C           -                 PSBLD008               Running Solaris
D           -                 -                      Powered Off
E           -                 PEAID015               Running Solaris
F           -                 -                      Powered Off
G           -                 -                      Powered Off
H           -                 -                      Powered Off
I           -                 -                      Powered Off
J           -                 -                      Powered Off
K           -                 -                      Powered Off
L           -                 -                      Powered Off
M           -                 -                      Powered Off
N           -                 -                      Powered Off
O           -                 -                      Powered Off
P           -                 -                      Powered Off
Q           -                 -                      Powered Off
R           -                 -                      Powered Off
----------------------------------------------------------------------
Thus the board is removed from one domain.Now our activity is to add the board in new domain.
and after that check for all the boards in D domain.
10)bash-2.05$ addboard -d D SB6

Domain: D is not running. You can only "configure" a component into
a running domain. Would you like to "assign" the component(s) to
domain D instead (yes/no)? yes
SB6 assigned to domain: D
bash-2.05$showboards -d D
Retrieving board information. Please wait.
.........
Location    Pwr    Type of Board   Board Status  Test Status   Domain
--------    ---    -------------   ------------  -----------   ------
SB6         Off    V3CPU           Assigned      Unknown       D
SB9          -     Empty Slot      Available         -         Isolated
SB10         -     Empty Slot      Available         -         Isolated
SB11         -     Empty Slot      Available         -         Isolated
SB12         -     Empty Slot      Available         -         Isolated
SB13         -     Empty Slot      Available         -         Isolated
SB14         -     Empty Slot      Available         -         Isolated
SB15         -     Empty Slot      Available         -         Isolated
SB16         -     Empty Slot      Available         -         Isolated
SB17         -     Empty Slot      Available         -         Isolated
IO6         Off    HPCI+           Assigned      Unknown       D
IO7         Off    HPCI+           Assigned      Unknown       D
IO9          -     Empty Slot      Available         -         Isolated
IO10         -     Empty Slot      Available         -         Isolated
IO11         -     Empty Slot      Available         -         Isolated
IO12         -     Empty Slot      Available         -         Isolated
IO13         -     Empty Slot      Available         -         Isolated
IO14         -     Empty Slot      Available         -         Isolated
IO15         -     Empty Slot      Available         -         Isolated
IO16         -     Empty Slot      Available         -         Isolated
IO17         -     Empty Slot      Available         -         Isolated

----------------------------------------------------------------------------------
Now we have to turn on the keyswitch.Sometimes if the domain is down,it will automatically turn on the domain.
11)bash-2.05$ showkeyswitch -d D
Virtual key switch position: OFF
bash-2.05$ setkeyswitch -d D -l 32 on

Powering on: CSB at CS1
 Already powered on: CSB at CS1
Powering on: CSB at CS0
 Already powered on: CSB at CS0
Powering on: EXB at EX6
Powering on: HPCI+ at IO6
Powering on: V3CPU at SB6
Waiting on exclusive access to EXB(s): 00080.
Powering on: EXB at EX7
 Already powered on: EXB at EX7
Powering on: HPCI+ at IO7

Significant contents of .postrc (platform)
        /etc/opt/SUNWSMS/SMS1.6/config/platform/.postrc:
# ident "@(#)postrc     1.1     01/04/02 SMI"

Reading domain blacklist file /etc/opt/SUNWSMS/config/D/blacklist ...
# ident "@(#)blacklist  1.1     01/04/02 SMI"
Reading platform blacklist file /etc/opt/SUNWSMS/config/platform/blacklist ...
# ident "@(#)blacklist  1.1     01/04/02 SMI"
SEEPROM probe took 0 seconds.
Reading Component Health Status (CHS) information ...
stage lport_reset: Assert reset to IOC ports in -Q mode...
stage_lport_reset(): Not -Q mode; Skipping Stage lport_reset
stage bus_probe: Check in-use bus configurations...
stage asic_probe: ASIC probe and JTAG/CBus integrity test...
FAIL Slot IO7: Shares an expander with an unthrottled USIV+ board which is active in another domain.
There is no FRU service action indicated for this failure.
stage brd_rev_eval: Board Revision Evaluation and Compliance...
stage cpu_probe: CPU Module probe...
stage cdc_probe: CDC DIMM probe...
stage mem_probe: Memory dimm probe...
stage adapter_probe: I/O adapter probe...
stage cp_shorts: Centerplane Shorts...
stage lbist: Logic BIST...
stage ibist: Interconnect BIST...
stage field_ict: Field Interconnect Tests...
stage mbist1: Internal memory BIST...
stage mbist2: External memory BIST...
stage domain_sync: Domain sync test...
stage cbus_bbsram: Console Bus test of bootbus sram...
stage sc_interrupt: DARB to SC interrupt...
stage cdc_clear: CDC DIMM clear...
stage cpu_lpost: Test all L1 CPU boards...
Performing ASIC config with bus config a/d/r = 333...
        Slot0 in domain: 00040
        Slot1 in domain: 00040
            EXBs in use: 001BF
sgcpu.flash file: Version 5.20.0 Build 15.1 I/F 12 is newest supported
Fprom SB6/F0: Version 5.20.0 Build 15.1 I/F 12 is newest supported
Fprom SB6/F1: Version 5.20.0 Build 15.1 I/F 12 is newest supported
stage nmb_cpu_lpost: Non-Mem Board Proc tests...
Performing ASIC config with bus config a/d/r = 333...
        Slot0 in domain: 00040
        Slot1 in domain: 00040
            EXBs in use: 001BF
stage_cpu_lpost(): No NMB Boards in config. Skipping Stage nmb_cpu_lpost.
Acquiring licenses for all good processors...
stage wib_lpost: Wildcat interface board tests...
stage_wib_lpost(): No good Wcis; Skipping Stage wib_lpost
stage pci_lpost: Test all L1 I/O boards...
Performing ASIC config with bus config a/d/r = 333...
        Slot0 in domain: 00040
        Slot1 in domain: 00040
            EXBs in use: 001BF
pcilpost.elf Version 5.20.0 Build 15.1 I/F 12 is newest supported
stage exp_lpost: Domain-level board and system tests...
explpost.elf Version 5.20.0 Build 15.1 I/F 12 is newest supported
stage cpu_lpost_II: CPU L1 domain/system tests...
sgcpu.flash file: Version 5.20.0 Build 15.1 I/F 12 is newest supported
Fprom SB6/F0: Version 5.20.0 Build 15.1 I/F 12 is newest supported
Fprom SB6/F1: Version 5.20.0 Build 15.1 I/F 12 is newest supported
stage pci_lpost_Q: Init all L1 I/O boards under -Q...
stage cpu_lpost_II_Q: CPU L1 domain/system init under -Q...
stage final_config: Final configuration...
Creating CPU SRAM handoff structures...
Creating GDCD IOSRAM handoff structures in Slot IO6...
Writing domain information to PCD...

Key to resource status value codes:
?=Unknown       p=Present       c=Crunched      _=Undefined     m=Missing     
i=Misconfig     o=FailedOBP     f=Failed        b=Blacklisted   r=Redlisted   
x=NotInDomain   u=G,unconfig    P=Passed        ==G,lockstep    l=NoLicense   
e=EmptyCasstt 

CPU_Brds:  PortCore
            3 2 1 0  Mem P/B: 3/1 3/0  2/1 2/0  1/1 1/0  0/1 0/0
Slot  Gen  10101010        /L: 10  10   10  10   10  10   10  10     CDC
SB06:  P   PPPPPPPP            PP  PP   PP  PP   PP  PP   PP  PP      P

I/O_Brds:         IOC  P1/Bus/Adapt   IOC  P0/Bus/Adapt
Slot  Gen  Type   P1   B1/10 B0/10    P0   B1/eb10 B0/10  (e=ENet, b=BBC)
IO06:  P   hsPCI+  P    p _p  p _p     P    p PP_e  p _p        

Configured in 333 with 4 procs, 32.000 GBytes, 3 IO adapters.
Interconnect frequency is 149.987 MHz, Measured.
Golden sram is on Slot IO6.
POST (level=32, verbose=20) execution time 9:47
Thus the board is replaced and reconfigured to new domain in live.

No comments:

Post a Comment