Clock Synchronization (Feat.Observer mode, CTSS daemon)

Oracle Installer 진행시 Clock Synchronization이란 항목을 마주하게 되었다. 하단에 detail을 눌러주면 

다음과 같은 prvg-**와 ACTION이 나오는데, PRVG-9664에 따르면 

Action: 모든 노드에 CTSS service를 멈추고 재시작 한다. NTP가 모든 모드에 구성되어 있거나 아예 구성되지 않거나 해야한다.

고 한다.

 

오라클 공식사이트의 내용에 따르면 cluster nodes 간 Time Synchronization하는 방법 세가지가 있다.

 

1. Windows Time service

2. An operating system configured network time protocol (NTP)

3. Oracle Cluster Time Synchronization Service

 

3번째인 Oracle Cluster Time Synchronization Service은 2번 NTP가 지원되지 않는 organizations을 위해 설계 되었다. 만약 NTP를 사용한다면, ctssd(Cluster Time Synchronization daemon)은 observer모드가 된다.

 

 

check point 해결 방법: ① NTP를 모든 노드에서 제거한 다음, ② CTSS service를 멈추고 재시작해줄 것이다.

 

① NTP를 모든 노드에서 제거

#  rm -rf /etc/ntp.conf

# rm -rf /etc/chrony.conf

# rm -rf /var/run/chronyd.pid

 

② CTSS service를 멈추고 재시작

grid 유저로 로그인한 뒤, crsctl check ctss 를 입력한다.

$ crsctl check ctss

# systemctl status chronyd

# systemctl stop chronyd

# systemctl disable chronyd

싱크를 disable로 만든다음 #systemctl status chronyd를 입력하면, inactive(dead)인 것을 확인 할 수 있다.

 

#ls –lrt /etc/chrony.conf 입력하면 해당 파일 확인된다.

#mv /etc/chrony.conf /etc/chrony.conf_backup (기존 것 백업하기)

#ls –lrt /etc/chrony.conf 다시 입력하면 no such file or directory 확인

#cd {GRID_HOME}/bin

# ./crsctl stop cluster –all

# ./crsctl start cluster –all(CTSS 멈추고 재시작 하는 단계)

[root@rac01 orahome]# cd /orahome/crs/product/19c/gihome_1/bin
[root@rac01 bin]# ./crsctl stop cluster -all
CRS-2673: Attempting to stop 'ora.crsd' on 'rac01'
CRS-2673: Attempting to stop 'ora.crsd' on 'rac02'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on server 'rac01'
CRS-2673: Attempting to stop 'ora.chad' on 'rac01'
CRS-2673: Attempting to stop 'ora.rac.db' on 'rac01'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on server 'rac02'
CRS-2673: Attempting to stop 'ora.rac.db' on 'rac02'
CRS-2673: Attempting to stop 'ora.qosmserver' on 'rac02'
CRS-2673: Attempting to stop 'ora.chad' on 'rac02'
CRS-2677: Stop of 'ora.rac.db' on 'rac01' succeeded
CRS-33673: Attempting to stop resource group 'ora.asmgroup' on server 'rac01'
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'rac01'
CRS-2673: Attempting to stop 'ora.RECO_DG.dg' on 'rac01'
CRS-2673: Attempting to stop 'ora.DATA_DG.dg' on 'rac01'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'rac01'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'rac01'
CRS-2677: Stop of 'ora.rac.db' on 'rac02' succeeded
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'rac02'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN2.lsnr' on 'rac02'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN3.lsnr' on 'rac02'
CRS-2673: Attempting to stop 'ora.cvu' on 'rac02'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'rac01' succeeded
CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'rac01' succeeded
CRS-2677: Stop of 'ora.RECO_DG.dg' on 'rac01' succeeded
CRS-2677: Stop of 'ora.DATA.dg' on 'rac01' succeeded
CRS-2677: Stop of 'ora.DATA_DG.dg' on 'rac01' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'rac01'
CRS-2677: Stop of 'ora.chad' on 'rac01' succeeded
CRS-2673: Attempting to stop 'ora.rac01.vip' on 'rac01'
CRS-2673: Attempting to stop 'ora.scan1.vip' on 'rac01'
CRS-2677: Stop of 'ora.LISTENER_SCAN3.lsnr' on 'rac02' succeeded
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'rac02' succeeded
CRS-2677: Stop of 'ora.chad' on 'rac02' succeeded
CRS-2673: Attempting to stop 'ora.rac02.vip' on 'rac02'
CRS-2677: Stop of 'ora.rac01.vip' on 'rac01' succeeded
CRS-2673: Attempting to stop 'ora.scan3.vip' on 'rac02'
CRS-2677: Stop of 'ora.LISTENER_SCAN2.lsnr' on 'rac02' succeeded
CRS-2677: Stop of 'ora.scan1.vip' on 'rac01' succeeded
CRS-2673: Attempting to stop 'ora.scan2.vip' on 'rac02'
CRS-2677: Stop of 'ora.cvu' on 'rac02' succeeded
CRS-2677: Stop of 'ora.asm' on 'rac01' succeeded
CRS-2677: Stop of 'ora.rac02.vip' on 'rac02' succeeded
CRS-2673: Attempting to stop 'ora.ASMNET1LSNR_ASM.lsnr' on 'rac01'
CRS-2677: Stop of 'ora.scan3.vip' on 'rac02' succeeded
CRS-2677: Stop of 'ora.scan2.vip' on 'rac02' succeeded
CRS-2677: Stop of 'ora.qosmserver' on 'rac02' succeeded
CRS-2677: Stop of 'ora.ASMNET1LSNR_ASM.lsnr' on 'rac01' succeeded
CRS-2673: Attempting to stop 'ora.asmnet1.asmnetwork' on 'rac01'
CRS-2677: Stop of 'ora.asmnet1.asmnetwork' on 'rac01' succeeded
CRS-33677: Stop of resource group 'ora.asmgroup' on server 'rac01' succeeded.
CRS-33673: Attempting to stop resource group 'ora.asmgroup' on server 'rac02'
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'rac02'
CRS-2673: Attempting to stop 'ora.RECO_DG.dg' on 'rac02'
CRS-2673: Attempting to stop 'ora.ons' on 'rac01'
CRS-2673: Attempting to stop 'ora.DATA_DG.dg' on 'rac02'
CRS-2677: Stop of 'ora.DATA_DG.dg' on 'rac02' succeeded
CRS-2677: Stop of 'ora.DATA.dg' on 'rac02' succeeded
CRS-2677: Stop of 'ora.RECO_DG.dg' on 'rac02' succeeded
CRS-2677: Stop of 'ora.ons' on 'rac01' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'rac01'
CRS-2677: Stop of 'ora.net1.network' on 'rac01' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'rac01' has completed
CRS-2673: Attempting to stop 'ora.asm' on 'rac02'
CRS-2677: Stop of 'ora.asm' on 'rac02' succeeded
CRS-2673: Attempting to stop 'ora.ASMNET1LSNR_ASM.lsnr' on 'rac02'
CRS-2677: Stop of 'ora.crsd' on 'rac01' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'rac01'
CRS-2673: Attempting to stop 'ora.storage' on 'rac01'
CRS-2673: Attempting to stop 'ora.evmd' on 'rac01'
CRS-2677: Stop of 'ora.ctssd' on 'rac01' succeeded
CRS-2677: Stop of 'ora.storage' on 'rac01' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'rac01'
CRS-2677: Stop of 'ora.evmd' on 'rac01' succeeded
CRS-2677: Stop of 'ora.ASMNET1LSNR_ASM.lsnr' on 'rac02' succeeded
CRS-2673: Attempting to stop 'ora.asmnet1.asmnetwork' on 'rac02'
CRS-2677: Stop of 'ora.asmnet1.asmnetwork' on 'rac02' succeeded
CRS-33677: Stop of resource group 'ora.asmgroup' on server 'rac02' succeeded.
CRS-2673: Attempting to stop 'ora.ons' on 'rac02'
CRS-2677: Stop of 'ora.ons' on 'rac02' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'rac02'
CRS-2677: Stop of 'ora.net1.network' on 'rac02' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'rac02' has completed
CRS-2677: Stop of 'ora.crsd' on 'rac02' succeeded
CRS-2673: Attempting to stop 'ora.storage' on 'rac02'
CRS-2673: Attempting to stop 'ora.evmd' on 'rac02'
CRS-2673: Attempting to stop 'ora.ctssd' on 'rac02'
CRS-2677: Stop of 'ora.storage' on 'rac02' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'rac02' succeeded
CRS-2677: Stop of 'ora.evmd' on 'rac02' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'rac02'

CRS-2677: Stop of 'ora.asm' on 'rac01' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac01'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac01' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'rac01'
CRS-2677: Stop of 'ora.cssd' on 'rac01' succeeded
CRS-2677: Stop of 'ora.asm' on 'rac02' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac02'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac02' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'rac02'
CRS-2677: Stop of 'ora.cssd' on 'rac02' succeeded
[root@rac01 bin]#
[root@rac01 bin]#
[root@rac01 bin]# ./crsctl start cluster -all
CRS-2672: Attempting to start 'ora.evmd' on 'rac02'
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac01'
CRS-2672: Attempting to start 'ora.evmd' on 'rac01'
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac02'
CRS-2676: Start of 'ora.cssdmonitor' on 'rac01' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'rac01'
CRS-2672: Attempting to start 'ora.diskmon' on 'rac01'
CRS-2676: Start of 'ora.diskmon' on 'rac01' succeeded
CRS-2676: Start of 'ora.cssdmonitor' on 'rac02' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'rac02'
CRS-2672: Attempting to start 'ora.diskmon' on 'rac02'
CRS-2676: Start of 'ora.diskmon' on 'rac02' succeeded
CRS-2676: Start of 'ora.evmd' on 'rac01' succeeded
CRS-2676: Start of 'ora.evmd' on 'rac02' succeeded
CRS-2676: Start of 'ora.cssd' on 'rac01' succeeded
CRS-2676: Start of 'ora.cssd' on 'rac02' succeeded
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'rac01'
CRS-2672: Attempting to start 'ora.ctssd' on 'rac01'
CRS-2672: Attempting to start 'ora.ctssd' on 'rac02'
CRS-2676: Start of 'ora.ctssd' on 'rac01' succeeded
CRS-2676: Start of 'ora.ctssd' on 'rac02' succeeded
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'rac02'
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'rac01' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'rac01'
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'rac02' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'rac02'
CRS-2676: Start of 'ora.asm' on 'rac02' succeeded
CRS-2672: Attempting to start 'ora.storage' on 'rac02'
CRS-2676: Start of 'ora.asm' on 'rac01' succeeded
CRS-2672: Attempting to start 'ora.storage' on 'rac01'
CRS-2676: Start of 'ora.storage' on 'rac01' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'rac01'
CRS-2676: Start of 'ora.crsd' on 'rac01' succeeded
CRS-2676: Start of 'ora.storage' on 'rac02' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'rac02'
CRS-2676: Start of 'ora.crsd' on 'rac02' succeeded

 

#./crsctl check ctss(ctss가 Active 모드 인 것을 확인)

 

oracle로 로그인한 뒤 cluvfy comp를 실행한다. (선제 작업: $ORACLE_HOME Path에 지정)

$ cluvfy comp clocksync –verbose

 

2번 노드에서도 동일하게 oracle user로 접속한 뒤, cluvfy를 실행한다.

1번 node와 마찬가지로

#./crsctl stop cluster –all

#systemctl stop ntpd

#mv /etc/ntp.conf /etc/ntp.conf.backup

#systemctl disable ntpd

#./crsctl start cluster -all

 

해주고 Check Again을 눌러주면 해당 항목이 없어진 것을 확인할 수 있다.

 

---

D.O.N.E!!!