EXADATA升级—从11.2.3.1.0到11.2.3.3.0–(5)升级Bundle Patch 23和交换机

升级Bundle Patch 23

1.下载最新的OPatch,p6880880_112000_Linux-x86-64.zip,解压并检查OPatch是否是最新的版本。

[oracle@gxx2db01 bp23]$ unzip p6880880_112000_Linux-x86-64.zip -d /u01/app/11.2.0.3/grid/
[oracle@gxx2db01 bp23]$ $ORACLE_HOME/OPatch/opatch version 
2.配置OCM文件

% $ORACLE_HOME/OPatch/ocm/bin/emocmrsp
3.验证Oracle Inventory

% $ORACLE_HOME/OPatch/opatch lsinventory -detail -oh $ORACLE_HOME
4.解压BP23

% cd /u01/app/oracle/patches
% unzip p18835772_112030_Linux-x86-64.zip
% cd /u01/app/oracle/patches/18835772
# chown -R oracle:oinstall /u01/app/oracle/patches/18835772
5.进行冲突检测

For Grid Infrastructure Home, as home user:

% $ORACLE_HOME/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /18835772/18707883
% $ORACLE_HOME/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /18835772/18906063
For Database home, as home user:

% $ORACLE_HOME/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /18835772/18707883
% $ORACLE_HOME/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /18835772/18906063/custom/server/18906063
6.检查SystemSpace,这里主要是ORACLE_HOME是否有足够空间。

For Grid Infrastructure Home, as home user:

% $ORACLE_HOME/OPatch/opatch prereq CheckSystemSpace -phBaseDir /18835772/18707883
% $ORACLE_HOME/OPatch/opatch prereq CheckSystemSpace -phBaseDir /18835772/18906063
For Database home, as home user:

% $ORACLE_HOME/OPatch/opatch prereq CheckSystemSpace -phBaseDir /18835772/18707883
% $ORACLE_HOME/OPatch/opatch prereq CheckSystemSpace -phBaseDir /18835772/18906063/custom/server/18906063
7.使用auto的方式打patch

# opatch auto /u01/app/oracle/patches/18835772
8.执行脚本

% SQL> sqlplus / as sysdba
% SQL> @rdbms/admin/catbundle.sql exa apply

升级InfiniBand交换机

最后一个步骤是升级InfiniBand交换机,交换机的软件安装介质也是在cells里面自带的。使用和cells一样的升级命令和方式。不过需要注意的一点是,交换机的网卡信息要和交换机主机下的/etc/hosts所配置的内容相同,如果不同,升级过程中会失败。如下所示:

[FAIL     ] Mismatch between address in ifcfg-eth[0,1] and /etc/hosts in gxx2sw-ib3. ACTION: Correct entry in /etc/sysconfig/network-scripts/ifcfg-eth0 /etc/sysconfig/network-scripts/ifcfg-eth1 or /etc/hosts

此时需要我们登陆到InfiniBand交换机的主机上,通过ifconfig –a和more /etc/hosts两个命令去查找,修改好自己的/etc/hosts文件后再次运行预检测命令就能够成功通过检测了。

[root@gxx2db01 patch_11.2.3.3.0.131014.1]# ./patchmgr -ibswitches -upgrade -ibswitch_precheck

2014-09-07 14:10:25 +0800 1 of 1 :SUCCESS: DO: Initiate pre-upgrade validation check on InfiniBand switch(es).
 ----- InfiniBand switch update process started Sun Sep  7 14:10:25 CST 2014 -----
[NOTE     ] Log file at /var/log/cellos/upgradeIBSwitch.log

[INFO     ] List of InfiniBand switches for upgrade: ( gxx2sw-ib3 gxx2sw-ib2 )
[PROMPT   ] Use the default password for all switches? (y/n) [n]: y
[PROMPT   ] Updating only 2 switch(es). Are you sure you want to continue? (y/n) [n]: y
[SUCCESS  ] Verifying Network connectivity to gxx2sw-ib3
[SUCCESS  ] Verifying Network connectivity to gxx2sw-ib2
[SUCCESS  ] Validating verify-topology output
[INFO     ] Master Subnet Manager is set to gxx2sw-ib2 in all Switches

[INFO     ] ---------- Starting with IBSwitch gxx2sw-ib2
[SUCCESS  ] gxx2sw-ib2 is at 1.3.3-2. Meets minimal patching level 1.3.3-2
[SUCCESS  ] Verifying that /tmp has 120M in gxx2sw-ib2, found 249M
[SUCCESS  ] Verifying that / has 80M in gxx2sw-ib2, found 200M
[SUCCESS  ] Verifying that gxx2sw-ib2 has 120M free memory, found 408M
[SUCCESS  ] Verifying host details in /etc/hosts and /etc/sysconfig/network-scripts/ifcfg-eth0 /etc/sysconfig/network-scripts/ifcfg-eth1 for gxx2sw-ib2
[SUCCESS  ] Verifying that gxx2sw-ib2 has at least 1 NTP Server, found 1
[INFO     ] Manually validate the following entries Date:(YYYY-MM-DD) 2014-09-07 Time:(HH:MM:SS) 20:12:34
[SUCCESS  ] Pre-update validation on gxx2sw-ib2

[INFO     ] ---------- Starting with InfiniBand Switch gxx2sw-ib3
[SUCCESS  ] gxx2sw-ib3 is at 1.3.3-2. Meets minimal patching level 1.3.3-2
[SUCCESS  ] Verifying that /tmp has 120M in gxx2sw-ib3, found 249M
[SUCCESS  ] Verifying that / has 80M in gxx2sw-ib3, found 200M
[SUCCESS  ] Verifying that gxx2sw-ib3 has 120M free memory, found 410M
[SUCCESS  ] Verifying host details in /etc/hosts and /etc/sysconfig/network-scripts/ifcfg-eth0 /etc/sysconfig/network-scripts/ifcfg-eth1 for gxx2sw-ib3
[SUCCESS  ] Verifying that gxx2sw-ib3 has at least 1 NTP Server, found 1
[INFO     ] Manually validate the following entries Date:(YYYY-MM-DD) 2014-09-07 Time:(HH:MM:SS) 20:17:29
[SUCCESS  ] Pre-update validation on gxx2sw-ib3
[SUCCESS  ] Overall status

 ----- InfiniBand switch update process ended Sun Sep  7 14:11:07 CST 2014 -----
2014-09-07 14:11:07 +0800 1 of 1 :SUCCESS: DONE: Initiate pre-upgrade validation check on InfiniBand switch(es).

检测完成之后,就可以正式进行升级了,如下所示,是一个升级的输出。

[root@gxx2db01 patch_11.2.3.3.0.131014.1]# ./patchmgr -ibswitches -upgrade

2014-09-07 14:11:34 +0800 1 of 1 :SUCCESS: DO: Initiate upgrade of InfiniBand switches to 2.1.3-4. Expect up to 15 minutes for each switch
 ----- InfiniBand switch update process started Sun Sep  7 14:11:35 CST 2014 -----
[NOTE     ] Log file at /var/log/cellos/upgradeIBSwitch.log

[INFO     ] List of InfiniBand switches for upgrade: ( gxx2sw-ib3 gxx2sw-ib2 )
[PROMPT   ] Use the default password for all switches? (y/n) [n]: y
[PROMPT   ] Updating only 2 switch(es). Are you sure you want to continue? (y/n) [n]: y
[SUCCESS  ] Verifying Network connectivity to gxx2sw-ib3
[SUCCESS  ] Verifying Network connectivity to gxx2sw-ib2
[SUCCESS  ] Validating verify-topology output
[INFO     ] Proceeding with upgrade of InfiniBand switches to version 2.1.3_4
[INFO     ] Master Subnet Manager is set to gxx2sw-ib2 in all Switches

[INFO     ] ---------- Starting with IBSwitch gxx2sw-ib2
[SUCCESS  ] Disable Subnet Manager on gxx2sw-ib2
[SUCCESS  ] Copy firmware packages to gxx2sw-ib2
[SUCCESS  ] gxx2sw-ib2 is at 1.3.3-2. Meets minimal patching level 1.3.3-2
[SUCCESS  ] Verifying that /tmp has 120M in gxx2sw-ib2, found 139M
[SUCCESS  ] Verifying that / has 80M in gxx2sw-ib2, found 200M
[SUCCESS  ] Verifying that gxx2sw-ib2 has 120M free memory, found 299M
[SUCCESS  ] Verifying host details in /etc/hosts and /etc/sysconfig/network-scripts/ifcfg-eth0 /etc/sysconfig/network-scripts/ifcfg-eth1 for gxx2sw-ib2
[SUCCESS  ] Verifying that gxx2sw-ib2 has at least 1 NTP Server, found 1
[INFO     ] Manually validate the following entries Date:(YYYY-MM-DD) 2014-09-07 Time:(HH:MM:SS) 20:14:12
[SUCCESS  ] Pre-update validation on gxx2sw-ib2
[INFO     ] Starting upgrade on gxx2sw-ib2 to 2.1.3_4. Please give upto 10 mins for the process to complete. DO NOT INTERRUPT or HIT CTRL+C during the upgrade
[SUCCESS  ] Load firmware 2.1.3_4 onto gxx2sw-ib2
[SUCCESS  ] Disable Subnet Manager on gxx2sw-ib2
[SUCCESS  ] Verify that /conf/configvalid is set to 1 on gxx2sw-ib2
[SUCCESS  ] Set SMPriority to 5 on gxx2sw-ib2
[INFO     ] Rebooting gxx2sw-ib2. Wait for 240 secs before continuing
[SUCCESS  ] Reboot gxx2sw-ib2
[SUCCESS  ] Restart Subnet Manager on gxx2sw-ib2
[INFO     ] Starting post-update validation on gxx2sw-ib2
[SUCCESS  ] Inifiniband switch gxx2sw-ib2 is at target patching level
[SUCCESS  ] Verifying host details in /etc/hosts and /etc/sysconfig/network-scripts/ifcfg-eth0 /etc/sysconfig/network-scripts/ifcfg-eth1 for gxx2sw-ib2
[SUCCESS  ] Verifying that gxx2sw-ib2 has at least 1 NTP Server, found 1
[INFO     ] Manually validate the following entries Date:(YYYY-MM-DD) 2014-09-07 Time:(HH:MM:SS) 12:27:27
[SUCCESS  ] Firmware verification on InfiniBand switch gxx2sw-ib2
[INFO     ] Post-check validation on IBSwitch gxx2sw-ib2
[SUCCESS  ] Update switch gxx2sw-ib2 to 2.1.3_4

[INFO     ] ---------- Starting with InfiniBand Switch gxx2sw-ib3
[SUCCESS  ] Disable Subnet Manager on gxx2sw-ib3
[SUCCESS  ] Copy firmware packages to gxx2sw-ib3
[SUCCESS  ] gxx2sw-ib3 is at 1.3.3-2. Meets minimal patching level 1.3.3-2
[SUCCESS  ] Verifying that /tmp has 120M in gxx2sw-ib3, found 139M
[SUCCESS  ] Verifying that / has 80M in gxx2sw-ib3, found 200M
[SUCCESS  ] Verifying that gxx2sw-ib3 has 120M free memory, found 300M
[SUCCESS  ] Verifying host details in /etc/hosts and /etc/sysconfig/network-scripts/ifcfg-eth0 /etc/sysconfig/network-scripts/ifcfg-eth1 for gxx2sw-ib3
[SUCCESS  ] Verifying that gxx2sw-ib3 has at least 1 NTP Server, found 1
[INFO     ] Manually validate the following entries Date:(YYYY-MM-DD) 2014-09-07 Time:(HH:MM:SS) 20:37:06
[SUCCESS  ] Pre-update validation on gxx2sw-ib3
[INFO     ] Starting upgrade on gxx2sw-ib3 to 2.1.3_4. Please give upto 10 mins for the process to complete. DO NOT INTERRUPT or HIT CTRL+C during the upgrade
[SUCCESS  ] Load firmware 2.1.3_4 onto gxx2sw-ib3
[SUCCESS  ] Disable Subnet Manager on gxx2sw-ib3
[SUCCESS  ] Verify that /conf/configvalid is set to 1 on gxx2sw-ib3
[SUCCESS  ] Set SMPriority to 5 on gxx2sw-ib3
[INFO     ] Rebooting gxx2sw-ib3. Wait for 240 secs before continuing
[SUCCESS  ] Reboot gxx2sw-ib3
[SUCCESS  ] Restart Subnet Manager on gxx2sw-ib3
[INFO     ] Starting post-update validation on gxx2sw-ib3
[SUCCESS  ] Inifiniband switch gxx2sw-ib3 is at target patching level
[SUCCESS  ] Verifying host details in /etc/hosts and /etc/sysconfig/network-scripts/ifcfg-eth0 /etc/sysconfig/network-scripts/ifcfg-eth1 for gxx2sw-ib3
[SUCCESS  ] Verifying that gxx2sw-ib3 has at least 1 NTP Server, found 1
[INFO     ] Manually validate the following entries Date:(YYYY-MM-DD) 2014-09-07 Time:(HH:MM:SS) 12:49:54
[SUCCESS  ] Firmware verification on InfiniBand switch gxx2sw-ib3
[INFO     ] Post-check validation on IBSwitch gxx2sw-ib3
[SUCCESS  ] Update switch gxx2sw-ib3 to 2.1.3_4
[INFO     ] InfiniBand Switches ( gxx2sw-ib3 gxx2sw-ib2 ) updated to 2.1.3_4
[SUCCESS  ] Overall status

 ----- InfiniBand switch update process ended Sun Sep  7 14:47:43 CST 2014 -----
2014-09-07 14:47:43 +0800 1 of 1 :SUCCESS: DONE: Upgrade InfiniBand switch(es) to 2.1.3-4.

升级后的检查

整个升级成功后,还有一些步骤需要执行,例如我们把ASM的disk repair的时间修改回来,把CRS的状态改成enable,启动dbfs,以及检查IMAGE是否都已经升级到了11.2.3.3.0

----修改ASM的disk_repair_time
SQL> alter diskgroup DATA_GXX2 set attribute 'disk_repair_time'='3.6h';
Diskgroup altered.

----将CRS的状态改成enable
[root@gxx2db01 tmp]dcli -g dbs_group -l root "/u01/app/11.2.0.3/grid/bin/crsctl enable crs"

----检查计算节点和存储节点的IMAGE信息
[root@gxx2db01 mydbfs]# dcli -g /tmp/all_group -l root 'imagehistory'
gxx2db01: Version                              : 11.2.3.1.0.120304
gxx2db01: Image activation date                : 2002-05-03 22:47:44 +0800
gxx2db01: Imaging mode                         : fresh
gxx2db01: Imaging status                       : success
gxx2db01:
gxx2db01: Version                              : 11.2.3.3.0.131014.1
gxx2db01: Image activation date                : 2014-09-07 11:57:33 +0800
gxx2db01: Imaging mode                         : patch
gxx2db01: Imaging status                       : success
gxx2db01:
gxx2db02: Version                              : 11.2.3.1.0.120304
gxx2db02: Image activation date                : 2012-05-03 11:29:41 +0800
gxx2db02: Imaging mode                         : fresh
gxx2db02: Imaging status                       : success
gxx2db02:
gxx2db02: Version                              : 11.2.3.3.0.131014.1
gxx2db02: Image activation date                : 2014-09-06 22:03:14 +0800
gxx2db02: Imaging mode                         : patch
gxx2db02: Imaging status                       : success
gxx2db02:
gxx2cel01: Version                              : 11.2.2.3.5.110815
gxx2cel01: Image activation date                : 2011-10-19 16:15:42 -0700
gxx2cel01: Imaging mode                         : fresh
gxx2cel01: Imaging status                       : success
gxx2cel01:
gxx2cel01: Version                              : 11.2.3.1.0.120304
gxx2cel01: Image activation date                : 2012-05-03 03:00:13 -0700
gxx2cel01: Imaging mode                         : out of partition upgrade
gxx2cel01: Imaging status                       : success
gxx2cel01:
gxx2cel01: Version                              : 11.2.3.3.0.131014.1
gxx2cel01: Image activation date                : 2014-09-06 16:01:21 +0800
gxx2cel01: Imaging mode                         : out of partition upgrade
gxx2cel01: Imaging status                       : success
gxx2cel01:
gxx2cel02: Version                              : 11.2.2.3.5.110815
gxx2cel02: Image activation date                : 2011-10-19 16:26:30 -0700
gxx2cel02: Imaging mode                         : fresh
gxx2cel02: Imaging status                       : success
gxx2cel02:
gxx2cel02: Version                              : 11.2.3.1.0.120304
gxx2cel02: Image activation date                : 2012-05-03 02:59:52 -0700
gxx2cel02: Imaging mode                         : out of partition upgrade
gxx2cel02: Imaging status                       : success
gxx2cel02:
gxx2cel02: Version                              : 11.2.3.3.0.131014.1
gxx2cel02: Image activation date                : 2014-09-06 17:42:01 +0800
gxx2cel02: Imaging mode                         : out of partition upgrade
gxx2cel02: Imaging status                       : success
gxx2cel02:
gxx2cel03: Version                              : 11.2.2.3.5.110815
gxx2cel03: Image activation date                : 2011-10-19 16:26:59 -0700
gxx2cel03: Imaging mode                         : fresh
gxx2cel03: Imaging status                       : success
gxx2cel03:
gxx2cel03: Version                              : 11.2.3.1.0.120304
gxx2cel03: Image activation date                : 2012-05-03 02:58:38 -0700
gxx2cel03: Imaging mode                         : out of partition upgrade
gxx2cel03: Imaging status                       : success
gxx2cel03:
gxx2cel03: Version                              : 11.2.3.3.0.131014.1
gxx2cel03: Image activation date                : 2014-09-06 17:42:08 +0800
gxx2cel03: Imaging mode                         : out of partition upgrade
gxx2cel03: Imaging status                       : success

参考下列文档

Sun_Oracle_Database_Machine_Owner’s_Guide

How to backup / restore Exadata Database Server (Lunix) –社区文档

dbnodeupdate.sh: Exadata Database Server Patching using the DB Node Update Utility (文档 ID 1553103.1)

Exadata 11.2.3.3.0 release and patch (16278923) (文档 ID 1487339.1)

Information Center: Upgrading Oracle Exadata Database Machine [ID 1364356.2]

分享到: 更多