程式師世界 >> 數據庫知識 >> Oracle數據庫 >> Oracle教程 >> rac10g添加節點詳解

rac10g添加節點詳解

編輯：Oracle教程

rac10g添加節點詳解

目標：

當前我環境中是有兩個節點RAC1和RAC2 節點，現在增加一個RAC3節點。

概要：為現有的Oracle10g RAC 添加節點大致包括以下步驟:

1. 配置新的服務器節點上的硬件及操作系統環境

2. 向 Cluster 集群中加入該節點

3. 在新節點上安裝 Oracle Database software

4. 為新的節點配置監聽器 LISTENER

5. 通過 DBCA 為新的節點添加實例

注意：在新的服務器節點上配置操作系統環境

1. 這包括配置該節點今後使用的 public network 公用網絡和 private network 接口，不要忘記在 hosts 文件中加入之前節點的網絡信息，並將該份完整的hosts 文件傳到集群Cluster 中已有的節點上，保證處處可以訪問。

2. 同時需要在原有的基礎上配置 oracle(或其他DBA)用戶的身份等價性，這需要將新節點上生成的 id_rsa.pub 和id_dsa.pub 文件中的信息追加到authorized_keys 文件中，並保證在所有節點上均有這樣一份相同的authorized_keys 文件。

3. 調整新節點上的操作系統內核參數，保證其滿足今後在該節點上運行實例的內存要求以及 10g RAC Cluster 的推薦的udp網絡參數。

4. 調整新節點上的系統時間以保持同其他節點一致，或者配置NTP 服務。

5. 保證原有 Cluster 中所有節點上的CRS 都正常運行，否則addNode時會報錯。

6. 配置 clusterware 和database 軟件的安裝目錄，要求路徑和原有節點上的一致。

一．准備工作

1. 查看當前RAC環境版本和狀態

SYS@RACDB1>select * from v$version;

BANNER

----------------------------------------------------------------

Oracle Database 10g Enterprise Edition Release10.2.0.1.0 - Prod

PL/SQL Release 10.2.0.1.0 - Production

CORE 10.2.0.1.0 Production

TNS for Linux: Version 10.2.0.1.0 - Production

NLSRTL Version 10.2.0.1.0 – Production

[root@rac1 bin]# ./crs_stat -t

Name Type Target State Host

------------------------------------------------------------

ora....B1.inst application ONLINE ONLINE rac1

ora....B2.inst application ONLINE ONLINE rac2

ora.RACDB.db application ONLINE ONLINE rac1

ora....SM1.asm application ONLINE ONLINE rac1

ora....C1.lsnr application ONLINE ONLINE rac1

ora.rac1.gsd application ONLINE ONLINE rac1

ora.rac1.ons application ONLINE ONLINE rac1

ora.rac1.vip application ONLINE ONLINE rac1

ora....SM2.asm application ONLINE ONLINE rac2

ora....C2.lsnr application ONLINE ONLINE rac2

ora.rac2.gsd application ONLINE ONLINE rac2

ora.rac2.ons application ONLINE ONLINE rac2

ora.rac2.vip application ONLINE ONLINE rac2

2. 配置節點3

[root@rac3 ~]# hostname

rac3

[root@rac3 ~]# id oracle

uid=54321(oracle) gid=54321(oinstall)groups=54321(oinstall),54322(dba)

[root@rac3 ~]# ifconfig

eth0 Link encap:Ethernet HWaddr00:50:56:25:82:62

inet addr:192.168.90.10 Bcast:192.168.90.255 Mask:255.255.255.0

inet6 addr: fe80::250:56ff:fe25:8262/64 Scope:Link

UPBROADCAST RUNNING MULTICAST MTU:1500 Metric:1

RX packets:1 errors:0 dropped:0overruns:0 frame:0

TXpackets:12 errors:0 dropped:0 overruns:0 carrier:0

collisions:0 txqueuelen:1000

RXbytes:60 (60.0 b) TX bytes:720 (720.0 b)

Interrupt:67 Base address:0x2024

eth1 Link encap:Ethernet HWaddr00:50:56:2D:0F:8D

inet addr:192.168.90.11 Bcast:192.168.90.255 Mask:255.255.255.0

inet6 addr: fe80::250:56ff:fe2d:f8d/64 Scope:Link

UPBROADCAST RUNNING MULTICAST MTU:1500 Metric:1

RXpackets:20 errors:0 dropped:0 overruns:0 frame:0

TXpackets:14 errors:0 dropped:0 overruns:0 carrier:0

collisions:0 txqueuelen:1000

RXbytes:1200 (1.1 KiB) TX bytes:804 (804.0b)

Interrupt:67 Base address:0x20a4

lo Link encap:Local Loopback

inet addr:127.0.0.1 Mask:255.0.0.0

inet6 addr: ::1/128 Scope:Host

UPLOOPBACK RUNNING MTU:16436 Metric:1

RXpackets:723 errors:0 dropped:0 overruns:0 frame:0

TXpackets:723 errors:0 dropped:0 overruns:0 carrier:0

collisions:0 txqueuelen:0

RXbytes:1217460 (1.1 MiB) TX bytes:1217460(1.1 MiB)

3. 配置三個節點/etc/hosts映射

注意：三個節點都要配置！！！

[root@rac3 ~]# vi /etc/hosts

# Do not remove the following line, or variousprograms

# that require network functionality will fail.

127.0.0.1 localhost.localdomain localhost

::1 localhost6.localdomain6 localhost6

192.168.90.2 rac1

192.168.90.5 rac2

192.168.91.3 rac1-priv

192.168.91.6 rac2-priv

192.168.90.3 rac1-vip

192.168.90.4 rac2-vip

#=========add node rac3==========#

192.168.90.10 rac3

192.168.91.11 rac3-priv

192.168.90.7 rac3-vip

檢查網絡是否通暢：

[root@rac3 ~]# ping rac1

PING rac1 (192.168.90.2) 56(84) bytes of data.

64 bytes from rac1 (192.168.90.2): icmp_seq=1ttl=64 time=0.614 ms

64 bytes from rac1 (192.168.90.2): icmp_seq=2ttl=64 time=0.169 ms

--- rac1 ping statistics ---

2 packets transmitted, 2 received, 0% packet loss,time 1000ms

rtt min/avg/max/mdev = 0.169/0.391/0.614/0.223 ms

4. 配置OS級別內核參數

這裡顯示的都是要添加的參數，原來的都不要動！！！

[root@rac3 ~]# cat /etc/sysctl.conf

kernel.shmmni = 4096

kernel.sem = 250 32000 100 128

fs.file-max = 65536

net.ipv4.ip_local_port_range = 1024 65000

net.core.rmem_default = 1048576

net.core.rmem_max = 1048576

net.core.wmem_default = 262144

net.core.wmem_max = 262144

/sbin/sysctl –p 生效一下

[root@rac3 ~]# cat /etc/security/limits.conf

oracle soft nproc 2047

oracle hard nproc 16384

oracle soft nofile 1024

oracle hard nofile 65536

[root@rac3 ~]# cat /etc/pam.d/login

session required pam_selinux.so open

[root@rac3 ~]# cat /etc/profile

if [ $USER = oracle ]; then

if [ $SHELL = /bin/ksh ]; then

ulimit -p 16384

ulimit -n 65536

else

ulimit -u 16384 -n 65536

5. 檢查所需要的rpm是否都在,沒有的話具體安裝

[root@rac3 ~]# rpm -q binutils compat-dbcontrol-center gcc gcc-c++ glibc glibc-common libstdc++ libstdc++-devel make

binutils-2.17.50.0.6-14.el5

compat-db-4.2.52-5.1

control-center-2.16.0-16.el5

gcc-4.1.2-50.el5

gcc-c++-4.1.2-50.el5

glibc-2.5-58

glibc-common-2.5-58

libstdc++-4.1.2-50.el5

libstdc++-devel-4.1.2-50.el5

make-3.81-3.el5

二．開始配置Openfiler存儲

用節點3打開火狐配置：

配置略。。。就是加了一個rac3的MAPPING

2.1 在節點3上發現存儲如果沒有返回值重啟一下Linux

[root@rac3 ~]# iscsiadm --mode discoverydb --typesendtargets --portal 192.168.90.8 --discover

192.168.90.8:3260,1 rac3

[root@rac3 ~]#

[root@rac3 ~]# iscsiadm --mode node --targetnamerac3 192.168.90.10:3260 --login

Logging in to [iface: default, target: rac3,portal: 192.168.90.8,3260]

2.2 配置開機啟動規則

[root@rac3 ~]# cat /etc/udev/rules.d/60-raw.rules

# Enter raw device bindings here.

# An example would be:

# ACTION=="add", KERNEL=="sda", RUN+="/bin/raw/dev/raw/raw1 %N"

# to bind /dev/raw/raw1 to /dev/sda, or

# ACTION=="add", ENV{MAJOR}=="8",ENV{MINOR}=="1", RUN+="/bin/raw /dev/raw/raw2 %M %m"

# to bind /dev/raw/raw2 to the device with major 8,minor 1.

ACTION=="add",KERNEL=="/dev/sdb1", RUN+="/bin/raw /dev/raw/raw1 %N"

ACTION=="add", ENV{MAJOR}=="8",ENV{MINOR}=="17", RUN+="/bin/raw /dev/raw/raw1 %M %m"

ACTION=="add",KERNEL=="/dev/sdc1", RUN+="/bin/raw /dev/raw/raw2 %N"

ACTION=="add", ENV{MAJOR}=="8",ENV{MINOR}=="33", RUN+="/bin/raw /dev/raw/raw2 %M %m"

ACTION=="add",KERNEL=="/dev/sdd1", RUN+="/bin/raw /dev/raw/raw3 %N"

ACTION=="add", ENV{MAJOR}=="8",ENV{MINOR}=="49", RUN+="/bin/raw /dev/raw/raw3 %M %m"

ACTION=="add",KERNEL=="/dev/sde1", RUN+="/bin/raw /dev/raw/raw4 %N"

ACTION=="add", ENV{MAJOR}=="8",ENV{MINOR}=="65", RUN+="/bin/raw /dev/raw/raw4 %M %m"

ACTION=="add",KERNEL=="/dev/sdf1", RUN+="/bin/raw /dev/raw/raw5 %N"

ACTION=="add", ENV{MAJOR}=="8",ENV{MINOR}=="81", RUN+="/bin/raw /dev/raw/raw5 %M %m"

KERNEL=="raw[1-5]",OWNER="oracle", GROUP="oinstall", MODE="640"

使之生效

[root@rac3 ~]# start_udev

Starting udev: [ OK ]

三．創建相應目錄，配置環境變量，配置互信

3.1 創建目錄

[root@rac3 ~]# mkdir -p /u01/app/oracle

[root@rac3 ~]# chown oracle:oinstall -R /u01/

[root@rac3 ~]# ll /u01/

total 4

drwxr-xr-x 3 oracle oinstall 4096 Aug 26 12:28 app

3.2 配置環境變量

[oracle@rac3 ~]$ cat .bash_profile

# .bash_profile

# Get the aliases and functions

if [ -f ~/.bashrc ]; then

.~/.bashrc

# User specific environment and startup programs

PATH=$PATH:$HOME/bin

export PATH

export ORACLE_BASE=/u01/app/oracle

export ORACLE_HOME=$ORACLE_BASE/product/10.2.0/db_2

export CRS_HOME=$ORACLE_BASE/product/10.2.0/db_1

export PATH=$PATH:$CRS_HOME/bin:$ORACLE_HOME/bin

[oracle@rac3 ~]$ . .bash_profile

3.3 配置互信

[oracle@rac3 ~]$ ssh-keygen

Generating public/private rsa key pair.

Enter file in which to save the key(/home/oracle/.ssh/id_rsa):

Created directory '/home/oracle/.ssh'.

Enter passphrase (empty for no passphrase):

Enter same passphrase again:

Your identification has been saved in/home/oracle/.ssh/id_rsa.

Your public key has been saved in/home/oracle/.ssh/id_rsa.pub.

The key fingerprint is:

19:66:a4:57:de:5d:21:1c:4a:2b:f1:0b:31:79:ae:fcoracle@rac3

[oracle@rac3 ~]$ cd .ssh/

[oracle@rac3 .ssh]$ ls

id_rsa id_rsa.pub

[oracle@rac3 .ssh]$ scprac1:/home/oracle/.ssh/authorized_keys .

The authenticity of host 'rac1 (192.168.90.2)'can't be established.

RSA key fingerprint is94:54:4a:64:74:0f:d4:e8:7f:7a:ba:43:0d:0f:70:30.

Are you sure you want to continue connecting(yes/no)? yes

Warning: Permanently added 'rac1,192.168.90.2'(RSA) to the list of known hosts.

oracle@rac1's password:

authorized_keys 100% 786 0.8KB/s 00:00

[oracle@rac3 .ssh]$ cat id_rsa.pub >>authorized_keys

[oracle@rac3 .ssh]$ cat authorized_keys

ssh-rsaAAAAB3NzaC1yc2EAAAABIwAAAQEAzSn5D7BcQXTJbxwG9yW9no1nKB8n23ydm8f6g9ROrJ0iYVyK6Rg9iV1jS/NJHws/CInLWWYTqYuzZcTO+Hj2iAg8SzhaIBN9glXZvjbfzyS4Wi+FZUbH6TMDwiNXxKXEuWwUzH0c9yvvRuF/s2BoIve/rZ+go3lb4zsbCM3jLDFHDZmsJ89NLG80bljM8iHt6Y18Z3Il1OPFjgpojGg8jwQTXm2IWwxeRYdB6C9IxGJ2VUciOECqx5JtXEfC+vY0zl0zFtZnejVSiA9MZehS/QuCIcT0eC/+OsMVXAT93dsuVfZvuvfjsejmV0lnH9f001ZeBPl6pKqQWxUCVmcJKw==oracle@rac1

ssh-rsaAAAAB3NzaC1yc2EAAAABIwAAAQEAyApaZkkfr1WEXNJwLuukbmLFZEcXaYmZpCxZ78QwO3MKOyZbDaCpDY0muSqPa5UOuH///aXAXp8ki1JVhACVaq5/45yFKqYVxsOXHoxRRmUnCLnXbsnnK5qAew6pLzNNeNzMeqoCLz4rVM7r+aIDYs6j05H0oEXxAbe4E3pFroTdEl7ULM7kUWgWf4UlQKWNPVJ01YYhYnzbgXr2vpVpAYRMDuH6+PikF4cgl/WvpQBmO4WHkwqZ1m12bINSKfiX384UmhxzJWl4IYVlMYrqYqluVL14F/cUBFnV9avq6TxmraDG1eZwi1nCTZhLpMS1juXcRPGqY0mV3LkUSTwGwQ==oracle@rac2

ssh-rsaAAAAB3NzaC1yc2EAAAABIwAAAQEA0zDPoxlo7BJD2kCuKVhqA2vOML4IIWdKmP3ejqiqCxfgTkMUCoa0ml2AEOtB11FdEsRFJ7p3lxzLcYMgsY3fJCNb59KiyRA5FCqiqRBiVYiwnUYG3iVvFsz4brne6fv+mc4AMgvdw6UqrGVcgieY4754Hji/i6qbv4GkmHbGv2LMFgtBn3JXon4prJws8aepHt4hBp1F0nL99pC+xyHkXtqa7DGaFW3Qy7nIF05VdD+ibzgiFOYWqDShXYHKNLql++/LmR3/hC/W71CeED7NdPcu8X1Eg8OvypMfIu1jO6HpU1rhmwV7QG23XFJB2kxSxDbt4txeQLtCKbV8RwWPzw==oracle@rac3

[oracle@rac3 .ssh]$ scp authorized_keys rac1:/home/oracle/.ssh/

oracle@rac1's password:

authorized_keys 100% 1179 1.2KB/s 00:00

[oracle@rac3 .ssh]$ scp authorized_keysrac2:/home/oracle/.ssh/

The authenticity of host 'rac2 (192.168.90.5)'can't be established.

RSA key fingerprint is0b:7b:ff:55:fb:7b:80:a0:be:13:a0:25:0d:e8:47:2b.

Are you sure you want to continue connecting(yes/no)? yes

Warning: Permanently added 'rac2,192.168.90.5'(RSA) to the list of known hosts.

oracle@rac2's password:

authorized_keys 100%1179 1.2KB/s 00:00

3.4 驗證互信

編寫一個shell腳本

[oracle@rac2 ~]$ vi ssh.sh

ssh rac1 date

ssh rac1-priv date

ssh rac2 date

ssh rac2-priv date

ssh rac3 date

ssh rac3-priv date

節點1：

[oracle@rac3 ~]$ sh ssh.sh

Tue Aug 26 12:36:09 CST 2014

節點2

[oracle@rac3 ~]$ sh ssh.sh

Tue Aug 26 12:36:40 CST 2014

節點3

[oracle@rac3 ~]$ sh ssh.sh

Tue Aug 26 12:36:50 CST 2014

3.5 安裝幾個關於oracleasm的rpm包

使用Yum源安裝 --由節點1搭建的ftp

[root@rac3 yum.repos.d]# cat oel.repo

[oel5]

name = Enterprise Linux 5.6 DVD

baseurl=ftp://192.168.90.2/pub/Server

gpgcheck=0

[root@rac3 yum.repos.d]# yum -y install oracleasm*

Loaded plugins: rhnplugin, security

This system is not registered with ULN.

ULN support will be disabled.

oel5 | 1.1 kB 00:00

Setting up Install Process

Resolving Dependencies

--> Running transaction check

---> Package oracleasm-2.6.18-238.el5.i6860:2.0.5-1.el5 set to be updated

---> Package oracleasm-2.6.18-238.el5PAE.i6860:2.0.5-1.el5 set to be updated

--> Processing Dependency: kernel-PAE =2.6.18-238.el5 for package: oracleasm-2.6.18-238.el5PAE

---> Package oracleasm-2.6.18-238.el5debug.i6860:2.0.5-1.el5 set to be updated

--> Processing Dependency: kernel-debug =2.6.18-238.el5 for package: oracleasm-2.6.18-238.el5debug

---> Package oracleasm-2.6.18-238.el5xen.i6860:2.0.5-1.el5 set to be updated

--> Processing Dependency: kernel-xen =2.6.18-238.el5 for package: oracleasm-2.6.18-238.el5xen

---> Package oracleasm-support.i3860:2.1.4-1.el5 set to be updated

--> Running transaction check

---> Package kernel-PAE.i686 0:2.6.18-238.el5set to be installed

---> Package kernel-debug.i686 0:2.6.18-238.el5set to be installed

---> Package kernel-xen.i686 0:2.6.18-238.el5set to be installed

--> Finished Dependency Resolution

Dependencies Resolved

================================================================================

Package Arch Version Repository

Size

================================================================================

Installing:

oracleasm-2.6.18-238.el5 i686 2.0.5-1.el5 oel5 22 k

oracleasm-2.6.18-238.el5PAE i686 2.0.5-1.el5 oel5 22 k

oracleasm-2.6.18-238.el5debug i686 2.0.5-1.el5 oel5 23 k

oracleasm-2.6.18-238.el5xen i686 2.0.5-1.el5 oel5 22 k

oracleasm-support i386 2.1.4-1.el5 oel5 83 k

Installing for dependencies:

kernel-PAE i686 2.6.18-238.el5 oel5 17 M

kernel-debug i686 2.6.18-238.el5 oel5 18 M

kernel-xen i686 2.6.18-238.el5 oel5 18 M

Transaction Summary

================================================================================

Install 8 Package(s)

Upgrade 0 Package(s)

Total download size: 53 M

Downloading Packages:

(1/8):oracleasm-2.6.18-238.el5-2.0.5-1.el5.i686.rpm | 22 kB 00:00

(2/8):oracleasm-2.6.18-238.el5PAE-2.0.5-1.el5.i686.rpm | 22kB 00:00

(3/8):oracleasm-2.6.18-238.el5xen-2.0.5-1.el5.i686.rpm | 22kB 00:00

(4/8):oracleasm-2.6.18-238.el5debug-2.0.5-1.el5.i686.rp | 23 kB 00:00

(5/8): oracleasm-support-2.1.4-1.el5.i386.rpm | 83 kB 00:00

(6/8): kernel-PAE-2.6.18-238.el5.i686.rpm | 17 MB 00:01

(7/8): kernel-debug-2.6.18-238.el5.i686.rpm | 18 MB 00:01

(8/8): kernel-xen-2.6.18-238.el5.i686.rpm | 18 MB 00:01

--------------------------------------------------------------------------------

Total 15MB/s | 53 MB 00:03

Running rpm_check_debug

Running Transaction Test

Finished Transaction Test

Transaction Test Succeeded

Running Transaction

Installing :oracleasm-support 1/8

Installing : kernel-PAE 2/8

Installing : kernel-xen 3/8

Installing : kernel-debug 4/8

Installing :oracleasm-2.6.18-238.el5PAE 5/8

Installing : oracleasm-2.6.18-238.el5xen 6/8

Installing :oracleasm-2.6.18-238.el5debug 7/8

Installing :oracleasm-2.6.18-238.el5 8/8

Installed:

oracleasm-2.6.18-238.el5.i686 0:2.0.5-1.el5

oracleasm-2.6.18-238.el5PAE.i686 0:2.0.5-1.el5

oracleasm-2.6.18-238.el5debug.i686 0:2.0.5-1.el5

oracleasm-2.6.18-238.el5xen.i686 0:2.0.5-1.el5

oracleasm-support.i386 0:2.1.4-1.el5

Dependency Installed:

kernel-PAE.i686 0:2.6.18-238.el5 kernel-debug.i686 0:2.6.18-238.el5

kernel-xen.i686 0:2.6.18-238.el5

Complete!

四．開始增加節點（$ORA_CRS_HOME/oui/bin）

4.1 再次查看原集群狀態

[root@rac1 bin]# ./crs_stat -t

Name Type Target State Host

------------------------------------------------------------

ora....B1.inst application ONLINE ONLINE rac1

ora....B2.inst application ONLINE ONLINE rac2

ora.RACDB.db application ONLINE ONLINE rac1

ora....SM1.asm application ONLINE ONLINE rac1

ora....C1.lsnr application ONLINE ONLINE rac1

ora.rac1.gsd application ONLINE ONLINE rac1

ora.rac1.ons application ONLINE ONLINE rac1

ora.rac1.vip application ONLINE ONLINE rac1

ora....SM2.asm application ONLINE ONLINE rac2

ora....C2.lsnr application ONLINE ONLINE rac2

ora.rac2.gsd application ONLINE ONLINE rac2

ora.rac2.ons application ONLINE ONLINE rac2

ora.rac2.vip application ONLINE ONLINE rac2

4.2 開始配置

[root@rac1 bin]# xhost +

access control disabled, clients can connect fromany host

[root@rac1 bin]# su - oracle

[oracle@rac1 ~]$ cd/u01/app/oracle/product/10.2.0/db_1/oui/bin/

[oracle@rac1 bin]$ ./addNode.sh

歡迎界面welcome

加入增加節點的信息

Summary信息

開始配置

按順序與對應節點執行！！！！

不要用ssh，到對應節點上執行！！！

節點1：

[root@rac1 ~]#/u01/app/oracle/product/10.2.0/db_1/install/rootaddnode.sh

clscfg: EXISTING configuration version 3 detected.

clscfg: version 3 is 10G Release 2.

Attempting to add 1 new nodes to the configuration

Using ports: CSS=49895 CRS=49896 EVMC=49898 andEVMR=49897.

node <nodenumber>: <nodename><private interconnect name> <hostname>

node 3: rac3 rac3-priv rac3

Creating OCR keys for user 'root', privgrp 'root'..

Operation successful.

/u01/app/oracle/product/10.2.0/db_1/bin/srvctl addnodeapps -n rac3 -A rac3-vip/255.255.255.0/eth0 -o/u01/app/oracle/product/10.2.0/db_1

節點3：

[root@rac3 ~]#/u01/app/oracle/product/10.2.0/db_1/root.sh

WARNING: directory '/u01/app/oracle/product/10.2.0'is not owned by root

WARNING: directory '/u01/app/oracle/product' is notowned by root

WARNING: directory '/u01/app/oracle' is not ownedby root

WARNING: directory '/u01/app' is not owned by root

WARNING: directory '/u01' is not owned by root

Checking to see if Oracle CRS stack is alreadyconfigured

/etc/oracle does not exist. Creating it now.

OCR LOCATIONS = /dev/raw/raw1

OCR backup directory'/u01/app/oracle/product/10.2.0/db_1/cdata/crs' does not exist. Creating now

Setting the permissions on OCR backup directory

Setting up NS directories

Oracle Cluster Registry configuration upgradedsuccessfully

WARNING: directory '/u01/app/oracle/product/10.2.0'is not owned by root

WARNING: directory '/u01/app/oracle/product' is notowned by root

WARNING: directory '/u01/app/oracle' is not ownedby root

WARNING: directory '/u01/app' is not owned by root

WARNING: directory '/u01' is not owned by root

clscfg: EXISTING configuration version 3 detected.

clscfg: version 3 is 10G Release 2.

assigning default hostname rac1 for node 1.

assigning default hostname rac2 for node 2.

Successfully accumulated necessary OCR keys.

Using ports: CSS=49895 CRS=49896 EVMC=49898 andEVMR=49897.

node <nodenumber>: <nodename><private interconnect name> <hostname>

node 1: rac1 rac1-priv rac1

node 2: rac2 rac2-priv rac2

clscfg: Arguments check out successfully.

NO KEYS WERE WRITTEN. Supply -force parameter tooverride.

-force is destructive and will destroy any previouscluster

configuration.

Oracle Cluster Registry for cluster has alreadybeen initialized

Startup will be queued to init within 90 seconds.

Adding daemons to inittab

Expecting the CRS daemons to be up within 600seconds.

CSS is active on these nodes.

rac1

rac2

rac3

CSS is active on all nodes.

Waiting for the Oracle CRSD and EVMD to start

Oracle CRS stack installed and running underinit(1M)

Running vipca(silent) for configuring nodeapps

/u01/app/oracle/product/10.2.0/db_1/jdk/jre//bin/java:error while loading shared libraries: libpthread.so.0: cannot open sharedobject file: No such file or directory

在master節點的cssd.log中有詳細信息

五．為新節點安裝數據庫軟件：($ORACLE_HOME/oui/bin)

[oracle@rac1 ~]$ cd/u01/app/oracle/product/10.2.0/db_2/oui/bin/

[oracle@rac1 bin]$ ls

addLangs.sh addNode.sh lsnodes ouica.sh resource runConfig.sh runInstaller runInstaller.sh

[oracle@rac1 bin]$ ./addNode.sh

Starting Oracle Universal Installer...

No pre-requisite checks found in oraparam.ini, nosystem pre-requisite checks will be executed.

Oracle Universal Installer, Version 10.2.0.1.0Production

同樣一個summary 開始安裝

節點3：

[root@rac3 ~]#/u01/app/oracle/product/10.2.0/db_2/root.sh

Running Oracle10 root.sh script...

The following environment variables are set as:

ORACLE_OWNER= oracle

ORACLE_HOME= /u01/app/oracle/product/10.2.0/db_2

Enter the full pathname of the local bin directory:[/usr/local/bin]:

The file "dbhome" already exists in/usr/local/bin. Overwrite it? (y/n)

[n]:

The file "oraenv" already exists in/usr/local/bin. Overwrite it? (y/n)

[n]:

The file "coraenv" already exists in/usr/local/bin. Overwrite it? (y/n)

[n]:

Entries will be added to the /etc/oratab file asneeded by

Database Configuration Assistant when a database iscreated

Finished running generic part of root.sh script.

Now product-specific root actions will beperformed.

此時的nodeapps已經添加成功，現在添加Listener和instance

[root@rac1 bin]# ./crs_stat -t

Name Type Target State Host

------------------------------------------------------------

ora....B1.inst application ONLINE ONLINE rac1

ora....B2.inst application ONLINE ONLINE rac2

ora.RACDB.db application ONLINE ONLINE rac1

ora....SM1.asm application ONLINE ONLINE rac1

ora....C1.lsnr application ONLINE ONLINE rac1

ora.rac1.gsd application ONLINE ONLINE rac1

ora.rac1.ons application ONLINE ONLINE rac1

ora.rac1.vip application ONLINE ONLINE rac1

ora....SM2.asm application ONLINE ONLINE rac2

ora....C2.lsnr application ONLINE ONLINE rac2

ora.rac2.gsd application ONLINE ONLINE rac2

ora.rac2.ons application ONLINE ONLINE rac2

ora.rac2.vip application ONLINE ONLINE rac2

ora.rac3.gsd application ONLINE ONLINE rac3

ora.rac3.ons application ONLINE ONLINE rac3

ora.rac3.vip application ONLINE ONLINE rac3

配置監聽 -- 遇到問題將新節點重啟就好。
[oracle@rac3 bin]$ lsnrctl start
節點2：
[oracle@rac2 bin]$ netca

Oracle Net Services Configuration:

選擇 reconfigure