Tuesday, February 11, 2020

Exadata - RAC TFA Collector - TFA with Database Support Tools Bundle

TFA Collector - TFA with Database Support Tools Bundle

Oracle Trace File Analyzer (TFA) provides a number of diagnostic tools in a single bundle, making it easy to gather diagnostic information about the Oracle database and clusterware, which in turn helps with problem resolution when dealing with Oracle Support.

My Oracle Support note 1513912.1 "TFA Collector - Tool for Enhanced Diagnostic Gathering" at https://support.oracle.com/CSP/main/article?cmd=show&type=NOT&id=1513912.1

Trace File Analyzer (TFA) Collector simplifies diagnostic data collection on Oracle Cluster Ready Services (CRS), Oracle Grid Infrastructure (Oracle GI), and Oracle RAC systems. TFA behaves in a similar manner to the ion utility packaged with Oracle Clusterware. Both tools collect and package diagnostic data. However, TFA is much more powerful than ion because TFA centralizes and automates the collection of diagnostic information.

Please refer the below MOS document for more details:
TFA Collector - TFA with Database Support Tools Bundle (Doc ID 1513912.1)

Patch download, unzip and Install/upgrade:

HOST01:(root)-/opt
>mkdir oracle.tfa

HOST01:(root)-/opt
>ls -ltrh

HOST01:(root)-/opt
>cp /u01/patches/TFA/TFA-LINUX_v18.1.1.zip /opt/oracle.tfa/

HOST01:(root)-/opt
>cd /opt/oracle.tfa/

HOST01:(root)-/opt/oracle.tfa
>ls -ltrh
total 172M
-rw-r--r-- 1 root root 172M Apr  5 04:12 TFA-LINUX_v18.1.1.zip

HOST01:(root)-/opt/oracle.tfa
>unzip TFA-LINUX_v18.1.1.zip
Archive:  TFA-LINUX_v18.1.1.zip
  inflating: README.txt
  inflating: installTFA-LINUX
HOST01:(root)-/opt/oracle.tfa

TFA installation:

HOST01:(root)-/opt/oracle.tfa
>./installTFA-LINUX
TFA Installation Log will be written to File : /tmp/tfa_install_385107_2018_04_05-04_15_23.log

Starting TFA installation

TFA Version: 181100 Build Date: 201802010159

TFA HOME : /u01/app/12.2.0.1/grid/tfa/HOST01/tfa_home

Installed Build Version: 122120 Build Date: 201709270025

TFA is already installed. Patching /u01/app/12.2.0.1/grid/tfa/HOST01/tfa_home...
TFA patching CRS or DB from zipfile extracted to /tmp/.385107.tfa
TFA patching typical install from zipfile is written to /u01/app/12.2.0.1/grid/tfa/HOST01/tfapatch.log

TFA will be Patched on:
HOST01
HOST02

Do you want to continue with patching TFA? [Y|N] [Y]:

Checking for ssh equivalency in HOST02
HOST02 is configured for ssh user equivalency for root user

Using SSH to patch TFA to remote nodes :

Applying Patch on HOST02:

TFA_HOME: /u01/app/12.2.0.1/grid/tfa/HOST02/tfa_home
Stopping TFA Support Tools...
Shutting down TFA
oracle-tfa stop/waiting. . . . .
Killing TFA running with pid 101177. . .
Successfully shutdown TFA..
Copying files from HOST01 to HOST02...

Current version of Berkeley DB in  is 5 or higher, so no DbPreUpgrade required
WARNING - TFA Software is older than 180 days. Please consider upgrading TFA to the latest version.
Moving Properties.bkp to Properties
WARNING - TFA Software is older than 180 days. Please consider upgrading TFA to the latest version.
WARNING - TFA Software is older than 180 days. Please consider upgrading TFA to the latest version.
Running commands to fix init.tfa and tfactl in HOST02...
WARNING - TFA Software is older than 180 days. Please consider upgrading TFA to the latest version.
WARNING - TFA Software is older than 180 days. Please consider upgrading TFA to the latest version.
WARNING - TFA Software is older than 180 days. Please consider upgrading TFA to the latest version.
Updating init.tfa in HOST02...
Starting TFA in HOST02...
Starting TFA..
oracle-tfa start/running, process 23827
Waiting up to 100 seconds for TFA to be started... . . . .
Successfully started TFA Process... . . . .
WARNING - TFA Software is older than 180 days. Please consider upgrading TFA to the latest version.
TFA Started and listening for commands
WARNING - TFA Software is older than 180 days. Please consider upgrading TFA to the latest version.
WARNING - TFA Software is older than 180 days. Please consider upgrading TFA to the latest version.

Enabling Access for Non-root Users on HOST02...

Applying Patch on HOST01:

Stopping TFA Support Tools...

Shutting down TFA for Patching...

Shutting down TFA
oracle-tfa stop/waiting. . . . .
Killing TFA running with pid 240432. . .
Successfully shutdown TFA..

No Berkeley DB upgrade required

Copying TFA Certificates...
Moving Properties.bkp to Properties

Running commands to fix init.tfa and tfactl in localhost

Starting TFA in HOST01...

Starting TFA..
oracle-tfa start/running, process 105565
Waiting up to 100 seconds for TFA to be started... . . . .
Successfully started TFA Process... . . . .
TFA Started and listening for commands

Enabling Access for Non-root Users on HOST01...

WARNING - TFA Software is older than 180 days. Please consider upgrading TFA to the latest version.
WARNING - TFA Software is older than 180 days. Please consider upgrading TFA to the latest version.
.-------------------------------------------------------------------.
| Host        | TFA Version | TFA Build ID         | Upgrade Status |
+-------------+-------------+----------------------+----------------+
| HOST01 |  18.1.1.0.0 | 18110020180201015951 | UPGRADED       |
| HOST02 |  18.1.1.0.0 | 18110020180201015951 | UPGRADED       |
'-------------+-------------+----------------------+----------------'
HOST01:(root)-/opt/oracle.tfa


TFA post verification:

HOST01:(root)-/u01/app/12.2.0.1/grid/tfa/bin
>./tfactl  print status
.----------------------------------------------------------------------------------------------------.
| Host        | Status of TFA | PID    | Port | Version    | Build ID             | Inventory Status |
+-------------+---------------+--------+------+------------+----------------------+------------------+
| HOST01 | RUNNING       | 105843 | 5000 | 18.1.1.0.0 | 18110020180201015951 | COMPLETE         |
| HOST02 | RUNNING       |  24075 | 5000 | 18.1.1.0.0 | 18110020180201015951  | COMPLETE         |
'-------------+---------------+--------+------+------------+----------------------+------------------'
HOST01:(root)-/u01/app/12.2.0.1/grid/tfa/bin


HOST01:(root)-/u01/app/12.2.0.1/grid/tfa/bin
>./tfactl print repository
.-----------------------------------------------------.
|                     HOST01                     |
+----------------------+------------------------------+
| Repository Parameter | Value                        |
+----------------------+------------------------------+
| Location             | /u01/app/grid/tfa/repository |
| Maximum Size (MB)    | 10240                        |
| Current Size (MB)    | 758                          |
| Free Size (MB)       | 9482                         |
| Status               | OPEN                         |
'----------------------+------------------------------'

.-----------------------------------------------------.
|                     HOST02                     |
+----------------------+------------------------------+
| Repository Parameter | Value                        |
+----------------------+------------------------------+
| Location             | /u01/app/grid/tfa/repository |
| Maximum Size (MB)    | 10240                        |
| Current Size (MB)    | 604                          |
| Free Size (MB)       | 9636                         |
| Status               | OPEN                         |
'----------------------+------------------------------'
HOST01:(root)-/u01/app/12.2.0.1/grid/tfa/bin


TFA collection:

utility: tfactl

Below are the steps to collect TFA:

[root@HOST01]locate tfactl
/u01/app/12.2.0.1/grid/bin/tfactl
/u01/app/12.2.0.1/grid/suptools/tfa/release/tfa_home/bin/tfactl
/u01/app/12.2.0.1/grid/suptools/tfa/release/tfa_home/bin/tfactl.bat.tmpl
/u01/app/12.2.0.1/grid/suptools/tfa/release/tfa_home/bin/tfactl.pl
/u01/app/12.2.0.1/grid/suptools/tfa/release/tfa_home/bin/tfactl.tmpl
/u01/app/12.2.0.1/grid/suptools/tfa/release/tfa_home/bin/common/tfactlglobal.pm
/u01/app/12.2.0.1/grid/suptools/tfa/release/tfa_home/bin/common/tfactlshare.pm
/u01/app/12.2.0.1/grid/suptools/tfa/release/tfa_home/bin/common/tfactlwin.pm
/u01/app/12.2.0.1/grid/suptools/tfa/release/tfa_home/bin/common/exceptions/tfactlexceptions.pm
/u01/app/12.2.0.1/grid/suptools/tfa/release/tfa_home/bin/modules/tfactlaccess.pm
/u01/app/12.2.0.1/grid/suptools/tfa/release/tfa_home/bin/modules/tfactladmin.pm
/u01/app/12.2.0.1/grid/suptools/tfa/release/tfa_home/bin/modules/tfactlanalyze.pm
/u01/app/12.2.0.1/grid/suptools/tfa/release/tfa_home/bin/modules/tfactlbase.pm
/u01/app/12.2.0.1/grid/suptools/tfa/release/tfa_home/bin/modules/tfactlcell.pm
/u01/app/12.2.0.1/grid/suptools/tfa/release/tfa_home/bin/modules/tfactlcollection.pm
/u01/app/12.2.0.1/grid/suptools/tfa/release/tfa_home/bin/modules/tfactldiagcollect.pm
/u01/app/12.2.0.1/grid/suptools/tfa/release/tfa_home/bin/modules/tfactldirectory.pm
/u01/app/12.2.0.1/grid/suptools/tfa/release/tfa_home/bin/modules/tfactlexttools.pm
/u01/app/12.2.0.1/grid/suptools/tfa/release/tfa_home/bin/modules/tfactlips.pm
/u01/app/12.2.0.1/grid/suptools/tfa/release/tfa_home/bin/modules/tfactlmineocr.pm
/u01/app/12.2.0.1/grid/suptools/tfa/release/tfa_home/bin/modules/tfactlprint.pm
/u01/app/12.2.0.1/grid/suptools/tfa/release/tfa_home/resources/tfactlhelp.xml
/u01/app/12.2.0.1/grid/tfa/bin/tfactl
HOST01:(grid):(+ASM1)- /home/grid

HOST01:(grid)$/u01/app/12.2.0.1/grid/tfa/bin/tfactl diagcollect -all -from "MON/23/2018 06:30:00" -to "MON/23/2018 07:30:00"

WARNING: User 'grid' is not allowed to run Collections on Storage Cells (Run diagcollect as root user to collect files from Storage Cells).

Collecting data for all components using above parameters...
Collecting data for all nodes
Scanning files from Feb/03/2018 04:00:00 to Feb/03/2018 06:30:00
Creating ips package in master node ...
Trying ADR basepath /u01/app/oracle
Trying to use ADR homepath diag/rdbms/obiprod/OBIPROD1 ...
Submitting request to generate package for ADR homepath /u01/app/oracle/diag/rdbms/obiprod/OBIPROD1
Trying to use ADR homepath diag/rdbms/obiprod/OBIPROD ...
Submitting request to generate package for ADR homepath /u01/app/oracle/diag/rdbms/obiprod/OBIPROD
Trying to use ADR homepath diag/rdbms/dbm01/DBM011 ...
Submitting request to generate package for ADR homepath /u01/app/oracle/diag/rdbms/dbm01/DBM011
Trying to use ADR homepath diag/rdbms/ebsprod_delete/EBSPROD1 ...
Submitting request to generate package for ADR homepath /u01/app/oracle/diag/rdbms/ebsprod_delete/EBSPROD1
Trying to use ADR homepath diag/rdbms/obipaos/OBIPAOS1 ...
Submitting request to generate package for ADR homepath /u01/app/oracle/diag/rdbms/obipaos/OBIPAOS1
Trying ADR basepath /u01/app/grid
Trying to use ADR homepath diag/asm/+asm/+ASM1 ...
Submitting request to generate package for ADR homepath /u01/app/grid/diag/asm/+asm/+ASM1
Trying to use ADR homepath diag/crs/HOST01/crs ...
Submitting request to generate package for ADR homepath /u01/app/grid/diag/crs/HOST01/crs
Master package completed for ADR homepath /u01/app/oracle/diag/rdbms/obiprod/OBIPROD1
Master package completed for ADR homepath /u01/app/oracle/diag/rdbms/obiprod/OBIPROD
Master package completed for ADR homepath /u01/app/oracle/diag/rdbms/obipaos/OBIPAOS1
Master package completed for ADR homepath /u01/app/oracle/diag/rdbms/ebsprod_delete/EBSPROD1
Created package 3 based on time range 2018-02-03 04:00:00.000000 -05:00 to 2018-02-03 06:30:00.000000 -05:00, correlation level basic
Master package completed for ADR homepath /u01/app/oracle/diag/rdbms/dbm01/DBM011
Created package 3 based on time range 2018-02-03 04:00:00.000000 -05:00 to 2018-02-03 06:30:00.000000 -05:00, correlation level basic
Master package completed for ADR homepath /u01/app/grid/diag/asm/+asm/+ASM1
Created package 3 based on time range 2018-02-03 04:00:00.000000 -05:00 to 2018-02-03 06:30:00.000000 -05:00, correlation level basic
Master package completed for ADR homepath /u01/app/oracle/diag/rdbms/ebsprod/EBSPROD1
Created package 3 based on time range 2018-02-03 04:00:00.000000 -05:00 to 2018-02-03 06:30:00.000000 -05:00, correlation level basic
Master package completed for ADR homepath /u01/app/grid/diag/crs/HOST01/crs
Created package 3 based on time range 2018-02-03 04:00:00.000000 -05:00 to 2018-02-03 06:30:00.000000 -05:00, correlation level basic
Master package completed for ADR homepath /u01/app/oracle/diag/rdbms/ebsprod/EBSPROD
Created package 3 based on time range 2018-02-03 04:00:00.000000 -05:00 to 2018-02-03 06:30:00.000000 -05:00, correlation level basic
Non matching adrhomepath for diag/rdbms/ebsprod_delete/EBSPROD1 during the creation of ips package in remote node HOST02.
Non matching adrhomepath for diag/rdbms/ebsprod_delete/EBSPROD1 during the creation of ips package in remote node HOST03.
Non matching adrhomepath for diag/rdbms/dbm01/DBM011 during the creation of ips package in remote node HOST02.
Non matching adrhomepath for diag/rdbms/ebsprod/EBSPROD during the creation of ips package in remote node HOST02.
Non matching adrhomepath for diag/rdbms/ebsprod/EBSPROD during the creation of ips package in remote node HOST03.
Non matching adrhomepath for diag/rdbms/ebsprod/EBSPROD1 during the creation of ips package in remote node HOST02.
Non matching adrhomepath for diag/rdbms/ebsprod/EBSPROD1 during the creation of ips package in remote node HOST03.
Remote package completed for ADR homepath(s) /diag/crs/HOST02/crs,/diag/crs/HOST03/crs
Remote package completed for ADR homepath(s) /diag/asm/+asm/+ASM2,/diag/asm/+asm/+ASM3

Collection Id : 20180203063237HOST01

Detailed Logging at : /u01/app/grid/tfa/repository/collection_Sat_Feb_03_06_32_37_EST_2018_node_all/diagcollect_20180203063237_HOST01.log
2018/02/03 06:33:30 EST : Collection Name : tfa_Sat_Feb_03_06_32_37_EST_2018.zip
2018/02/03 06:33:30 EST : Collecting diagnostics from hosts : [HOST03, HOST01, HOST02]
2018/02/03 06:33:30 EST : Scanning of files for Collection in progress...
2018/02/03 06:33:30 EST : Collecting additional diagnostic information...
2018/02/03 06:39:37 EST : Completed collection of additional diagnostic information...
2018/02/03 06:42:30 EST : Getting list of files satisfying time range [02/03/2018 04:00:00 EST, 02/03/2018 06:30:00 EST]
2018/02/03 06:42:47 EST : Collecting ADR incident files...
2018/02/03 06:42:48 EST : Completed Local Collection
2018/02/03 06:42:48 EST : Remote Collection in Progress...
.--------------------------------------.
|          Collection Summary          |
+------------+-----------+------+------+
| Host       | Status    | Size | Time |
+------------+-----------+------+------+
| HOST02 | Completed | 98MB | 297s |
| HOST03 | Completed | 91MB | 355s |
| HOST01 | Completed | 70MB | 558s |
'------------+-----------+------+------'

Logs are being collected to: /u01/app/grid/tfa/repository/collection_Sat_Feb_03_06_32_37_EST_2018_node_all
/u01/app/grid/tfa/repository/collection_Sat_Feb_03_06_32_37_EST_2018_node_all/HOST01.tfa_Sat_Feb_03_06_32_37_EST_2018.zip
/u01/app/grid/tfa/repository/collection_Sat_Feb_03_06_32_37_EST_2018_node_all/HOST03.tfa_Sat_Feb_03_06_32_37_EST_2018.zip
/u01/app/grid/tfa/repository/collection_Sat_Feb_03_06_32_37_EST_2018_node_all/HOST02.tfa_Sat_Feb_03_06_32_37_EST_2018.zip
HOST01:(grid):(+ASM1)- /home/grid


[root@na2drdbadm01 ~]# /u01/app/12.2.0.1/grid/tfa/bin/tfactl diagcollect -all

WARNING - TFA Software is older than 180 days. Please consider upgrading TFA to the latest version.
The -all switch is being deprecated as collection of all components is the default behavior. TFA will continue to collect all components.

Collecting data for the last 12 hours for all components...
Collecting data for all nodes and cells
Creating ips package in master node ...
Trying ADR basepath /u01/app/oracle
Trying to use ADR homepath diag/rdbms/dbm01/dbm011 ...
Submitting request to generate package for ADR homepath /u01/app/oracle/diag/rdbms/dbm01/dbm011
Trying to use ADR homepath diag/rdbms/obixprod/DROBIXP ...
Submitting request to generate package for ADR homepath /u01/app/oracle/diag/rdbms/obixprod/DROBIXP
Trying to use ADR homepath diag/rdbms/drobixp/DROBIXP ...
Submitting request to generate package for ADR homepath /u01/app/oracle/diag/rdbms/drobixp/DROBIXP
Trying to use ADR homepath diag/rdbms/drebsxp/DREBSXP ...
Submitting request to generate package for ADR homepath /u01/app/oracle/diag/rdbms/drebsxp/DREBSXP
Trying ADR basepath /u01/app/grid
Trying to use ADR homepath diag/crs/na2drdbadm01/crs ...
Submitting request to generate package for ADR homepath /u01/app/grid/diag/crs/na2drdbadm01/crs
Collection Id : 20180405093216HOST03

Detailed Logging at : /u01/app/grid/tfa/repository/collection_Thu_Apr_05_09_32_16_EDT_2018_node_all/diagcollect_20180405093216_HOST03.log
2018/04/05 09:32:53 EDT : NOTE : Any file or directory name containing the string .com will be renamed to replace .com with dotcom
2018/04/05 09:32:53 EDT : Collection Name : tfa_Thu_Apr_05_09_32_16_EDT_2018.zip
2018/04/05 09:32:53 EDT : Collecting diagnostics from hosts : [HOST03, HOST01, HOST02]
2018/04/05 09:32:53 EDT : Scanning of files for Collection in progress...
2018/04/05 09:32:53 EDT : Collecting additional diagnostic information...
2018/04/05 09:33:03 EDT : Getting list of files satisfying time range [04/04/2018 03:51:00 EDT, 04/04/2018 06:00:00 EDT]
2018/04/05 09:33:19 EDT : Collecting ADR incident files...
2018/04/05 09:38:01 EDT : Completed collection of additional diagnostic information...
2018/04/05 09:38:06 EDT : Completed Local Collection
2018/04/05 09:38:06 EDT : Remote Collection in Progress...
.--------------------------------------.
|          Collection Summary          |
+------------+-----------+------+------+
| Host       | Status    | Size | Time |
+------------+-----------+------+------+
| HOST01 | Completed | 95MB | 311s |
| HOST02 | Completed | 80MB | 311s |
| HOST03 | Completed | 79MB | 313s |
'------------+-----------+------+------'
Logs are being collected to: /u01/app/grid/tfa/repository/collection_Thu_Apr_05_09_32_16_EDT_2018_node_all
/u01/app/grid/tfa/repository/collection_Thu_Apr_05_09_32_16_EDT_2018_node_all/HOST01.tfa_Thu_Apr_05_09_32_16_EDT_2018.zip
/u01/app/grid/tfa/repository/collection_Thu_Apr_05_09_32_16_EDT_2018_node_all/HOST02.tfa_Thu_Apr_05_09_32_16_EDT_2018.zip
/u01/app/grid/tfa/repository/collection_Thu_Apr_05_09_32_16_EDT_2018_node_all/HOST03.tfa_Thu_Apr_05_09_32_16_EDT_2018.zip
[root@HOST03 ~]$


Please do follow me and support me on,

Regards,
Mallikarjun Ramadurg
Mobile: +91 9880616848
WhatsApp: +91 9880616848


No comments:

Post a Comment

Automation Script | Archivelog Generation Hourly Monitoring

1. List out all the running databases and pic one database where we want to monitore the archive log generation from last 1 month. [oracle@o...