Friday, May 9, 2025

19c autoupgrade prechecks fails with error DEPLOY_JOB_VALIDATIONS

19c autoupgrade prechecks fails with error DEPLOY_JOB_VALIDATIONS


Issue:

19c autoupgrade prechecks fails with error DEPLOY_JOB_VALIDATIONS

Error Message:

Check failed for UAT1, manual intervention needed for the below checks
[DEPLOY_JOB_VALIDATIONS]

Cause:

After checking on the precheck logs ir found that passwordless ssh connection for oracle user is not available for node1 to node2 within RAC cluster nodes  

Fix:

Establish the passwordless sss-connection between RAC nodes (node1 and node2)

Error Logs and commands output:

1. Create config file using auto-upgrade jar file.

[oracle@oraclelab1 19c-autoupg]$ env |grep ORA
ORACLE_SID=UAT1
ORACLE_BASE=/u01/app/oracle
ORACLE_HOME=/u01/app/oracle/product/12.2.0.1/dbhome_1

[oracle@oraclelab1 19c-autoupg]$ /u01/app/oracle/product/19.0.0.0/dbhome_1/jdk/bin/java -jar /u01/app/oracle/product/19.0.0.0/dbhome_1/rdbms/admin/autoupgrade.jar -create_sample_file config
Created sample configuration file /u01/patches/19c-autoupg/sample_config.cfg
[oracle@oraclelab1 19c-autoupg]$ 

2. Modify the config file according to the target database which are planning to upgrade

[oracle@oraclelab1 19c-autoupg]$ cp sample_config.cfg UAT_config.cfg
[oracle@oraclelab1 19c-autoupg]$ vi UAT_config.cfg

3. Run the auto-upgrade prechks in ANALYZE mode which reported the failure

[oracle@oraclelab1 19c-autoupg]$ /u01/app/oracle/product/19.0.0.0/dbhome_1/jdk/bin/java -jar /u01/app/oracle/product/19.0.0.0/dbhome_1/rdbms/admin/autoupgrade.jar -config UAT_config.cfg -mode ANALYZE
AutoUpgrade 24.8.241119 launched with default internal options
Processing config file ...
+--------------------------------+
| Starting AutoUpgrade execution |
+--------------------------------+
1 Non-CDB(s) will be analyzed
Type 'help' to list console commands
upg> upg> upg>
upg> lsj
+----+-------+---------+---------+-------+----------+-------+----------------------------+
|Job#|DB_NAME|    STAGE|OPERATION| STATUS|START_TIME|UPDATED|                     MESSAGE|
+----+-------+---------+---------+-------+----------+-------+----------------------------+
| 100|   UAT1|PRECHECKS|EXECUTING|RUNNING|  10:28:06| 2s ago|Loading database information|
+----+-------+---------+---------+-------+----------+-------+----------------------------+
Total jobs 1

upg> lsj
+----+-------+---------+---------+-------+----------+-------+----------------------------+
|Job#|DB_NAME|    STAGE|OPERATION| STATUS|START_TIME|UPDATED|                     MESSAGE|
+----+-------+---------+---------+-------+----------+-------+----------------------------+
| 101|   UAT1|PRECHECKS|EXECUTING|RUNNING|  10:32:06| 4s ago|Loading database information|
+----+-------+---------+---------+-------+----------+-------+----------------------------+
Total jobs 1

upg> Job 101 completed
------------------- Final Summary --------------------
Number of databases            [ 1 ]

Jobs finished                  [1]
Jobs failed                    [0]

Please check the summary report at:
/u01/patches/19c-autoupg/cfgtoollogs/upgrade/auto/status/status.html
/u01/patches/19c-autoupg/cfgtoollogs/upgrade/auto/status/status.log
[oracle@oraclelab1 19c-autoupg]$

4. Error message reported on the prechecks log

[oracle@oraclelab1 19c-autoupg]$ more /u01/patches/19c-autoupg/cfgtoollogs/upgrade/auto/status/status.log
==========================================
          Autoupgrade Summary Report
==========================================
[Date]           Thu May 08 10:32:38 IST 2025
[Number of Jobs] 1
==========================================
[Job ID] 101
==========================================
[DB Name]                UAT
[Version Before Upgrade] 12.2.0.1.0
[Version After Upgrade]  19.17.0.0.0
------------------------------------------
[Stage Name]    PRECHECKS
[Status]        FAILURE
[Start Time]    2025-05-08 10:32:06
[Duration]      0:00:31
[Log Directory] /u01/patches/19c-autoupg/UAT/UAT1/101/prechecks
[Detail]        /u01/patches/19c-autoupg/UAT/UAT1/101/prechecks/uat_preupgrade.log
                Check failed for UAT1, manual intervention needed for the below checks
                [DEPLOY_JOB_VALIDATIONS]
Cause:The following checks have ERROR severity and no auto fixup is available or
the fixup failed to resolve the issue. Fix them before continuing:
UAT1 DEPLOY_JOB_VALIDATIONS
Reason:Database Checks has Failed details in /u01/patches/19c-autoupg/UAT/UAT1/101/prechecks
Action:[MANUAL]
Info:Return status is ERROR
ExecutionError:No
Error Message:The following checks have ERROR severity and no auto fixup is available or
the fixup failed to resolve the issue. Fix them before continuing:
UAT1 DEPLOY_JOB_VALIDATIONS
------------------------------------------
[oracle@oraclelab1 19c-autoupg]$

5. Check the precheck logs for the more details which indicated that passwordless ssh connection for oracle user is not available for node1 to node2 within RAC cluster nodes  

[root@oraclelab1 prechecks]# more uat_preupgrade.log
Report generated by AutoUpgrade 24.8.241119 (#b404cf007) on 2025-05-08 10:32:37

Upgrade-To version: 19.0.0.0.0

=======================================
Status of the database prior to upgrade
=======================================
      Database Name:  UAT1
     Container Name:  UAT1
       Container ID:  0
            Version:  12.2.0.1.0
     DB Patch Level:  UNKNOWN
         Compatible:  12.2.0
          Blocksize:  8192
           Platform:  Linux x86 64-bit
      Timezone File:  26
  Database log mode:  ARCHIVELOG
           Readonly:  false
            Edition:  EE

==============
BEFORE UPGRADE
==============

  REQUIRED ACTIONS
  ================
  1.  Fix the specified validations before running AutoUpgrade in DEPLOY mode.

      Before running AutoUpgrade in DEPLOY mode, all job based validations must
      succeed.

      The following job based validations will fail if AutoUpgrade is run in
      DEPLOY mode.

      *All the nodes of the cluster must be configured with passwordless
      connectivity
      Not able to establish passwordless connectivity the following node
      [oraclelab2.localdomain.com]. It may not be configured properly

6. Follow the below blog or document link for How to enable the passwordless ssh-connection between RAC nodes.

Follow the below blog for enabling the passwordless connectivity
https://mallik034.blogspot.com/2020/02/establish-passwordless-ssh-connection.html

7. After the enabling the passwordless ssh-connection then verify using below commands 

[oracle@oraclelab1 ~]$ ssh oraclelab2.localdomain.com
[oracle@oraclelab2 ~]$
[oracle@oraclelab2 ~]$ ssh oraclelab1.localdomain.com
[oracle@oraclelab1 ~]$

8. Rerun the auto-upgrade prechks in ANALYZE mode which got completed successfully 

[oracle@oraclelab1 19c-autoupg]$ /u01/app/oracle/product/19.0.0.0/dbhome_1/jdk/bin/java -jar /u01/app/oracle/product/19.0.0.0/dbhome_1/rdbms/admin/autoupgrade.jar -config UAT_config.cfg -mode ANALYZE
AutoUpgrade 24.8.241119 launched with default internal options
Processing config file ...
+--------------------------------+
| Starting AutoUpgrade execution |
+--------------------------------+
1 Non-CDB(s) will be analyzed
Type 'help' to list console commands
upg> lsj
+----+-------+---------+---------+-------+----------+-------+----------------+
|Job#|DB_NAME|    STAGE|OPERATION| STATUS|START_TIME|UPDATED|         MESSAGE|
+----+-------+---------+---------+-------+----------+-------+----------------+
| 102|   UAT1|PRECHECKS|EXECUTING|RUNNING|  10:41:22| 0s ago|Executing Checks|
+----+-------+---------+---------+-------+----------+-------+----------------+
Total jobs 1

upg> Job 102 completed
------------------- Final Summary --------------------
Number of databases            [ 1 ]

Jobs finished                  [1]
Jobs failed                    [0]

Please check the summary report at:
/u01/patches/19c-autoupg/cfgtoollogs/upgrade/auto/status/status.html
/u01/patches/19c-autoupg/cfgtoollogs/upgrade/auto/status/status.log
[oracle@oraclelab1 19c-autoupg]$ more /u01/patches/19c-autoupg/cfgtoollogs/upgrade/auto/status/status.log
==========================================
          Autoupgrade Summary Report
==========================================
[Date]           Thu May 08 10:41:42 IST 2025
[Number of Jobs] 1
==========================================
[Job ID] 102
==========================================
[DB Name]                UAT
[Version Before Upgrade] 12.2.0.1.0
[Version After Upgrade]  19.17.0.0.0
------------------------------------------
[Stage Name]    PRECHECKS
[Status]        SUCCESS
[Start Time]    2025-05-08 10:41:22
[Duration]      0:00:20
[Log Directory] /u01/patches/19c-autoupg/UAT/UAT1/102/prechecks
[Detail]        /u01/patches/19c-autoupg/UAT/UAT1/102/prechecks/uat_preupgrade.log
                Check passed and no manual intervention needed
------------------------------------------
[oracle@oraclelab1 19c-autoupg]$

No comments:

Post a Comment

-bash: oraenv: No such file or directory

-bash: oraenv: No such file or directory What Are Root.sh And OrainstRoot.sh Scripts In A Standalone RDBMS Installation? (Doc ID 1493121.1) ...