Background:
Egypt time zone is GMT+2. Starting from year 1988, Egypt started to use the summer time zone (GMT +3) starting from the last Thursday of Apr till the last Thursday of September (5 months), then it reset back to GMT +2 for the remaining of the year.
Summer time zone was cancelled at 20-Apr-2011, then it returned back at 7-May-2014, then it was finally cancelled at 23-Apr-2015. So, now Egypt has one time zone which is GMT +2
It looks like this decisions was not reflected in the software side, so, still some software are referring to the Egypt Summer Time Zone and not updated yet.
So, what is the issue?:
So, I receive some customer complaints, that the Enterprise Manger stopped working either during Apr or September each year!.
So, my customer has an 11.2.0.3 database with Oracle Enterprise Manager database control.
I examined the key log files of the Enterprise Manager database control, following are the result:
emdctl.trc
2019-05-22 14:53:51,672 Thread-1714583296 ERROR main: nmectla_agentctl: Error connecting to https://dba:3938/emd/main. Returning status code 1 2019-05-22 14:53:54,249 Thread-3375814400 WARN http: nmehl_connect_internal: connect failed to (dba:3938): Connection refused (error = 111) 2019-05-22 14:53:54,249 Thread-3375814400 ERROR main: nmectla_agentctl: Error connecting to https://dba:3938/emd/main. Returning status code 1 2019-05-22 14:53:56,844 Thread-1448261376 WARN http: nmehl_connect_internal: connect failed to (dba:3938): Connection refused (error = 111) 2019-05-22 14:53:56,844 Thread-1448261376 ERROR main: nmectla_agentctl: Error connecting to https://dba:3938/emd/main. Returning status code 1 2019-05-22 14:54:54,141 Thread-1532524288 WARN http: nmehl_connect_internal: connect failed to (dba:3938): Connection refused (error = 111) 2019-05-22 14:54:54,141 Thread-1532524288 ERROR main: nmectla_agentctl: Error connecting to https://dba:3938/emd/main. Returning status code 1
emdb.nohup
WARNING: Code-source /u01/app/oracle/product/11.2.0/dbhome_1/sysman/jlib/ocm/http_client.jar (from manifest of /u01/app/oracle/product/11.2.0/dbhome_1/sysman/jlib/emocmclnt.jar) has the same filename but is not identical to /u01/app/oracle/product/11.2.0/dbhome_1/oc4j/j2ee/home/lib/http_client.jar (from (ignore manifest Class-Path) in META-INF/boot.xml in /u01/app/oracle/product/11.2.0/dbhome_1/oc4j/j2ee/home/oc4j.jar). If it contains different versions of the same classes, it will be masked as the latter is already visible in the search path of loader em.web.em:0.0.0.
WARNING: Code-source /u01/app/oracle/product/11.2.0/dbhome_1/sysman/jlib/ocm/log4j-core.jar (from manifest of /u01/app/oracle/product/11.2.0/dbhome_1/sysman/jlib/emocmclnt.jar) has the same filename but is not identical to /u01/app/oracle/product/11.2.0/dbhome_1/sysman/jlib/log4j-core.jar (from in /u01/app/oracle/product/11.2.0/dbhome_1/oc4j/j2ee/oc4j_applications/applications/em/em). If it contains different versions of the same classes, it will be masked as the latter is already visible in the search path of loader em.web.em:0.0.0.
WARNING: Code-source /u01/app/oracle/product/11.2.0/dbhome_1/sysman/jlib/ocm/xmlparserv2.jar (from manifest of /u01/app/oracle/product/11.2.0/dbhome_1/sysman/jlib/emocmclnt.jar) has the same filename but is not identical to /u01/app/oracle/product/11.2.0/dbhome_1/oc4j/lib/xmlparserv2.jar (from (ignore manifest Class-Path) in META-INF/boot.xml in /u01/app/oracle/product/11.2.0/dbhome_1/oc4j/j2ee/home/oc4j.jar). If it contains different versions of the same classes, it will be masked as the latter is already visible in the search path of loader em.web.em:0.0.0.
19/05/22 15:49:59 securePort = 1158
19/05/22 15:49:59 isOMSSecure = 1 isOMSSecureLocked = 1
19/05/22 15:50:02 ExtendClusterIntegration: init: start
19/05/22 15:50:02 ExtendClusterIntegration: init: end
19/05/22 15:50:02 ProvCommonIntegration.init, registering the Page Handlers and Page Segment Handlers
19/05/22 15:50:02 PAF Integration init BEGIN
19/05/22 15:50:02 PAF Integration init END
19/05/22 15:50:04 Oracle Containers for J2EE 10g (10.1.3.4.0) initialized
emoms.log
2019-05-19 01:00:04,267 [JobWorker 803:Thread-27] ERROR em.jobs executeCommand.370 - UpdateARUTables: Oracle MetaLink credentials are incorrect or missing. Click Patching Setup to set required parameters.
2019-05-20 01:00:03,225 [JobWorker 813:Thread-27] ERROR em.jobs executeCommand.370 - UpdateARUTables: Oracle MetaLink credentials are incorrect or missing. Click Patching Setup to set required parameters.
2019-05-21 01:00:02,161 [JobWorker 824:Thread-27] ERROR em.jobs executeCommand.370 - UpdateARUTables: Oracle MetaLink credentials are incorrect or missing. Click Patching Setup to set required parameters.
2019-05-22 01:00:01,721 [JobWorker 863:Thread-27] ERROR em.jobs executeCommand.370 - UpdateARUTables: Oracle MetaLink credentials are incorrect or missing. Click Patching Setup to set required parameters.
2019-05-22 15:50:01,013 [OC4J Launcher] ERROR app.ContextInitializer contextInitialized.420 - Integration Class not found: oracle.sysman.eml.target.slb.common.SLBIntegration
2019-05-22 15:50:01,379 [OC4J Launcher] ERROR app.ContextInitializer contextInitialized.420 - Integration Class not found: oracle.sysman.pp.asprov.ui.intg.ASProvisioningIntegration
2019-05-22 15:50:02,892 [OC4J Launcher] ERROR app.ContextInitializer contextInitialized.420 - Integration Class not found: oracle.sysman.pp.paf.sample.ui.intg.PAFDemoIntegration
2019-05-22 15:50:02,892 [OC4J Launcher] ERROR app.ContextInitializer contextInitialized.420 - Integration Class not found: oracle.sysman.emCLI.CLIIntg
2019-05-22 15:50:02,893 [OC4J Launcher] ERROR app.ContextInitializer contextInitialized.420 - Integration Class not found: oracle.sysman.emCLI.CLIDownloadIntg
2019-05-22 15:50:02,894 [OC4J Launcher] ERROR app.ContextInitializer contextInitialized.420 - Integration Class not found: oracle.sysman.pp.pa.ui.intg.PatchAdvisorIntegration
2019-05-22 15:50:02,894 [OC4J Launcher] ERROR app.ContextInitializer contextInitialized.420 - Integration Class not found: oracle.sysman.pp.sidb.ui.intg.SIDBProvisioningIntegration
2019-05-22 15:50:02,895 [OC4J Launcher] ERROR app.ContextInitializer contextInitialized.420 - Integration Class not found: oracle.sysman.pp.pa.ospatch.intg.OSPatchIntg
2019-05-22 15:50:02,896 [OC4J Launcher] ERROR app.ContextInitializer contextInitialized.420 - Integration Class not found: oracle.sysman.pp.pa.ulnpatch.intg.ULNPatchIntg
2019-05-22 15:50:02,973 [OC4J Launcher] ERROR app.ContextInitializer contextInitialized.420 - Integration Class not found: oracle.sysman.pp.racprov.ui.intg.RACProvIntegration
2019-05-22 15:50:02,974 [OC4J Launcher] ERROR app.ContextInitializer contextInitialized.420 - Integration Class not found: oracle.sysman.pp.ec.ui.intg.ExtendClusterIntegration
2019-05-22 15:50:02,974 [OC4J Launcher] ERROR app.ContextInitializer contextInitialized.420 - Integration Class not found: oracle.sysman.pp.dn.ui.intg.DltNodeIntegration
2019-05-22 15:50:02,975 [OC4J Launcher] ERROR app.ContextInitializer contextInitialized.420 - Integration Class not found: oracle.sysman.pp.common.ui.intg.ProvCommonIntegration
2019-05-22 15:50:02,975 [OC4J Launcher] ERROR app.ContextInitializer contextInitialized.420 - Integration Class not found: oracle.sysman.pp.bpelprov.ui.intg.BPELProvisioningIntegration
agabend.log:
The agentTZRegion value in /u01/app/oracle/product/11.2.0/dbhome_1/dba_prod/sysman/config/emd.properties is not in agreement with what agent thinks it should be.Please verify your environment to make sure that TZ setting has not changed since the last start of the agent. If you modified the timezone setting in the environment, please stop the agent and exectute 'emctl resetTZ agent' and also execute the script mgmt_target.set_agent_tzrgn(, ) to get the value propagated to repository.
emagent.trc
SQL = "/* OracleOEM */
with max1 as (select :1 as select_tab,:2 as select_priv fr"…
LOGIN = dbsnmp/@(DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=dba)(PORT=1521))(CONNECT_DATA=(SID=prod)))
2019-04-21 15:31:08,583 Thread-3445561376 WARN vpxoci: OCI Error -- ErrorCode(1436): ORA-01436: CONNECT BY loop in user data
SQL = "/* OracleOEM */
with max1 as (select :1 as select_tab,:2 as select_priv fr"…
LOGIN = dbsnmp/@(DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=dba)(PORT=1521))(CONNECT_DATA=(SID=prod)))
2019-04-21 15:31:08,587 Thread-3445561376 WARN vpxoci: OCI Error -- ErrorCode(1436): ORA-01436: CONNECT BY loop in user data
SQL = "/* OracleOEM */
with max1 as (select :1 as select_tab,:2 as select_priv fr"…
LOGIN = dbsnmp/@(DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=dba)(PORT=1521))(CONNECT_DATA=(SID=prod)))
emagent.log
2019-04-05 15:30:55,191 Thread-1594873600 EMAgent normal shutdown (00703)
2019-04-05 15:31:00,206 Thread-3550512896 Starting Agent 10.2.0.4.4 from /u01/app/oracle/product/11.2.0/dbhome_1 (00701)
2019-04-05 15:31:00,395 Thread-3550512896 Undefined column name __intervalONNECT_DATA in expression ((gc_cr_recv < _gc_cr_recv) ? 0 : (gc_cr_recv - _gc_cr_recv))/__intervalONNECT_DATA=(SID=%SID%)))
(00104)
2019-04-05 15:31:00,395 Thread-3550512896 Undefined column name __intervalCT_DATA in expression ((gc_cur_recv < _gc_cur_recv) ? 0 : (gc_cur_recv - _gc_cur_recv))/__intervalCT_DATA=(SID=%SID%)))
(00104)
2019-04-05 15:31:00,395 Thread-3550512896 Undefined column name __intervalrvalCT_DATA in expression ((gc_cr_serv < _gc_cr_serv) ? 0 : (gc_cr_serv - _gc_cr_serv))/__intervalrvalCT_DATA=(SID=%SID%)))
(00104)
2019-04-05 15:31:00,395 Thread-3550512896 Undefined column name __intervalCT_DATA in expression ((gc_cur_serv < _gc_cur_serv) ? 0 : (gc_cur_serv - _gc_cur_serv))/__intervalCT_DATA=(SID=%SID%)))
(00104)
2019-04-05 15:31:00,395 Thread-3550512896 Undefined column name __intervalATA in expression ((msg_sent_dir < _msg_sent_dir) ? 0 : (msg_sent_dir - _msg_sent_dir))/__intervalATA=(SID=%SID%)))
(00104)
2019-04-05 15:31:00,395 Thread-3550512896 Undefined column name __intervalinterval in expression ((msg_recv_act < _msg_recv_act) ? 0 : (msg_recv_act - _msg_recv_act))/__intervalinterval=%SID%)))
(00104)
2019-04-05 15:31:00,448 Thread-3550512896 [Load Balancer Switch] InstanceProperty (snmpTimeout) is marked OPTIONAL but is being used (00506)
2019-04-05 15:31:01,620 Thread-3550512896 EMAgent started successfully (00702)
emagent_perl.trc
pwdexpiry.pl: Wed Apr 17 15:52:39 2019: WARN: pwdexpiry: Invalid number of arguments passed
pwdexpiry.pl: Thu Apr 18 15:52:38 2019: WARN: pwdexpiry: number of args is 1
pwdexpiry.pl: Thu Apr 18 15:52:38 2019: WARN: pwdexpiry: Invalid number of arguments passed
alertlogAdr.pl: Thu Apr 18 17:40:33 2019: WARN: target: 865DBDBE698C61E6DF2085EB7CB95284; unable to open alert log at
pwdexpiry.pl: Fri Apr 19 15:52:39 2019: WARN: pwdexpiry: number of args is 1
pwdexpiry.pl: Fri Apr 19 15:52:39 2019: WARN: pwdexpiry: Invalid number of arguments passed
pwdexpiry.pl: Sat Apr 20 15:52:38 2019: WARN: pwdexpiry: number of args is 1
pwdexpiry.pl: Sat Apr 20 15:52:38 2019: WARN: pwdexpiry: Invalid number of arguments passed
pwdexpiry.pl: Sun Apr 21 15:52:38 2019: WARN: pwdexpiry: number of args is 1
pwdexpiry.pl: Sun Apr 21 15:52:38 2019: WARN: pwdexpiry: Invalid number of arguments passed
So, it is clear from the agabend.log file that it is the regular time zone issue.
Solution:
export TZ=Asia/Riyadh
[oracle@dba config]$ emctl resetTZ agent
Oracle Enterprise Manager 11g Database Control Release 11.2.0.3.0
Copyright (c) 1996, 2011 Oracle Corporation. All rights reserved.
Updating /u01/app/oracle/product/11.2.0/dbhome_1/dba_prod/sysman/config/emd.properties…
Successfully updated /u01/app/oracle/product/11.2.0/dbhome_1/dba_prod/sysman/config/emd.properties.
Login as the em repository user and run the script:
exec mgmt_target.set_agent_tzrgn('dba:3938','Asia/Riyadh')
and commit the changes
This can be done for example by logging into sqlplus and doing
SQL> exec mgmt_target.set_agent_tzrgn('dba:3938','Asia/Riyadh')
SQL> commit
sqlplus sysman/********
exec mgmt_target.set_agent_tzrgn('dba:3938','Asia/Riyadh');
Commit;
emctl stop dbconsole
emctl start dbconsole
Donate to support our blogging work
$1.00
Thanks
Ahmed
Ahmed AbdelFattah Blog ! 