fs_clone failed in Production

[syed raza]

Hi Emran,
I am facing fs_clone failed in my Production instance from last 3 days
i am using 12.2.4 db version 11.2.0.3 on linux 6
 as I am already set the parameter
export TIMEDPROCESS_TIMEOUT=-1
export CONFIG_JVM_ARGS="-Xms1500m -Xmx3000m"
adop phase=fs_clone force=yes

       
Running : /app/apps/fs2/EBSapps/comn/util/jdk32/jre/bin/java -classpath /app/apps/fs2/FMW_Home/Oracle_EBS-app1/shared-libs/ebs-appsb
org/WEB-INF/lib/ebsAppsborgManifest.jar:/app/apps/fs2/EBSapps/comn/java/classes -mx256m -classpath /app/apps/fs2/FMW_Home/Oracle_
EBS-app1/shared-libs/ebs-appsborg/WEB-INF/lib/ebsAppsborgManifest.jar:/app/apps/fs2/EBSapps/comn/java/classes:/app/apps/fs2/FMW_Home
/Oracle_EBS-app1/shared-libs/ebs-appsborg/WEB-INF/lib/ebsAppsborgManifest.jar:/app/apps/fs2/EBSapps/comn/java/classes/oracle/apps/fn
d/jar/adall.jar:/app/apps/fs2/FMW_Home/webtier/opmn/lib/wlfullclient.jar oracle.apps.fnd.txk.util.UpdateOhsT2PMovePlan -contextfile
/app/apps/fs2/inst/apps/NODPROD_noidaapp/appl/admin/NODPROD_noidaapp.xml -moveplan /app/apps/fs1/EBSapps/comn/adopclone_noidaapp/FMW
/OHS/moveplan.xml -logfile /app/apps/fs1/inst/apps/NODPROD_noidaapp/admin/log/clone/txkSetOHSConfig_09041952/provision_09041952.log
-promptmsg 'hide'
Modifying T2P plan is successfull

###################################################
Applying ohs<timestamp>.jar as per T2P moveplan.xml
###################################################

Apply clone ran successfully

OHS EBS_web_NODPROD shutdown succcessfully

#####################################
Generating apps.conf for cloneohsconfig
######################################

apps.conf generated successfully

#########################################
Registering OHS instance with AdminServer
#########################################

Running /app/apps/fs2/FMW_Home/webtier/perl/bin/perl /app/apps/fs2/FMW_Home/webtier/instances/EBS_web_NODPROD_OHS1/bin/opmnctl regis
terinstance -oracleHome /app/apps/fs2/FMW_Home/webtier -oracleInstance /app/apps/fs2/FMW_Home/webtier/instances/EBS_web_NODPROD_OHS1
-instanceName EBS_web_NODPROD_OHS1 -adminHost noidaapp.flexfilm.com -adminPort 7012 -adminUsername weblogic -adminPasswordFile /app
/apps/fs1/EBSapps/comn/adopclone_noidaapp/FMW/tempPlainInfo.txt -logFile /app/apps/fs1/inst/apps/NODPROD_noidaapp/admin/log/clone/tx
kSetOHSConfig_09041952/provision_09041952.log -logLevel "INFO"


Update of EBS_web_NODPROD registration successful

Successfully updated context variable s_ohs_installed with the value generateEBSOHSConfigFiles

Successfully uploaded /app/apps/fs2/inst/apps/NODPROD_noidaapp/appl/admin/NODPROD_noidaapp.xml to database

EBS_web_NODPROD is failed to start !!

[ErmanArslansOracleBlog]

We need to see more logs actually.. because what you are seeing in that output is just the result.. We need to see the cause/causes.

Also you may be missing some prereq that need to be installed/configured in this system..

Run and fix all missing prerequisites as per Note 250262.1 RDA 4 - Health Check / Validation Engine Guide .

Also send me the log ->  

/app/apps/fs1/inst/apps/NODPROD_noidaapp/admin/log/clone/txkSetOHSConfig_09041952/provision_09041952.log

[syed raza]

Hi Emran, Please attached logfile provision_09041952.log

[ErmanArslansOracleBlog]

Send me the most recent 3 session logs from $APPL_TOP_NE/../log/adop

 you will see something like this
fs_clone_20130319_233614 --> this is a directory
adop_20130319_233614.log

send me the fs_clone* log directory for the failed session..

[syed raza]

fs_clone_20180902_222335.rarfs_clone_20180903_092907.rarfs_clone_20180903_100559.rarfs_clone_20180903_175746.rarfs_clone_20180904_000220.rar


EXIT STATUS: 1
/app/apps/fs2/FMW_Home/oracle_common/oui/bin/detachHome.sh went through successfully.
LOG FILE: /app/apps/fs_ne/EBSapps/log/adop/88/fs_clone_20180904_000220/NODPROD_noidaapp/TXK_SYNC_create/oracle_common_detachHome.out.
ORACLE HOME /app/apps/fs2/FMW_Home/Oracle_OAMWebGate1 already detached.
Directory /app/apps/fs2/EBSapps/10.1.2 already exists.
Execute SYSTEM command : /app/apps/fs1/EBSapps/10.1.2/oui/bin/runInstaller -removeHome -silent ORACLE_HOME=/app/apps/fs2/EBSapps/10.1.2



in this it shows
ORACLE HOME /app/apps/fs2/FMW_Home/Oracle_OAMWebGate1 already detached.
But we are not using the OAMWEBGate1

txkADOPPreparePhaseSynchronize.log in this file it shows the entry of Oracle_OAMWEBGATE1
please help me to find from where  it pick the value

thanks

[ErmanArslansOracleBlog]

Found:
----
txkSetOHSConfig.pl
Script Executed in 34659 milliseconds, returning status 1
ERROR: Script failed, exit code 1

->
Check this note -> "12.2 E-Business Suite adop phase=fs_clone Fails On /txkSetOHSConfig.pl With Error 'FATAL ERROR ERRORMSG: ...adclone.pl did not go through successfully' (Doc ID 2179658.1)"

[syed raza]

Hi Emran,
Thanks for your reply i see in my production instances in that there is no any strong cipher entry
ssl enabled="true" wallet-file="/app/apps/fs2/FMW_Home/webtier/instances/EBS_web_NODPROD_OHS1/config/OPMN/opmn/wallet"/>
   </notification-server>
   <process-manager>
      <process-modules>
         <module path="$ORACLE_HOME/opmn/lib/libopmnohs">
            <module-id id="OHS2"/>
         </module>
         <module path="$ORACLE_HOME/opmn/lib/libopmncustom">
            <module-id id="CUSTOM"/>
         </module>
         <module path="$ORACLE_HOME/opmn/lib/libopmnoid">
            <module-id id="OID"/>
         </module>
         <module path="$ORACLE_HOME/opmn/lib/libopmnbi">
            <module-id id="BIServer"/>
            <module-id id="BIScheduler"/>
            <module-id id="BIPresentationServices"/>
            <module-id id="BIClusterController"/>
            <module-id id="BIJavaHost"/>
         </module>
         <module path="$ORACLE_HOME/opmn/lib/libopmnovd">
            <module-id id="OVD"/>
         </module>
         <module path="$ORACLE_HOME/opmn/lib/libopmnwc">
            <module-id id="WebCache"/>
            <module-id id="WebCache-admin"/>
         </module>
         <module path="$ORACLE_HOME/opmn/lib/libopmnreports">
            <module-id id="ReportsServices"/>
            <module-id id="ReportsBridgeServices"/>
         </module>
         <module path="$ORACLE_HOME/opmn/lib/libopmndisco">
            <module-id id="Disco_ServicesStatus"/>
            <module-id id="Disco_SessionServer"/>
            <module-id id="Disco_PreferenceServer"/>
         </module>
         <module path="$ORACLE_HOME/opmn/lib/libopmnemagent">
            <module-id id="EMAGENT"/>
         </module>

[ErmanArslansOracleBlog]

Send me the output of RDA as per Note 250262.1 RDA 4 - Health Check / Validation Engine Guide

[syed raza]

91.rarAPPS_HCVE_A_EBS122_lin_res_latest.htm

[syed raza]

Hi Emran,
Still we are facing the same issue in my production Environment and from last 8 days working with oracle

[ErmanArslansOracleBlog]

I m looking to your rda output, and I see that, you have below 2 things in failed status.

A03550 DNS Lookup FAILED nslookup IP_address
A03590 DNS Settings FAILED ATTEMPTSUndef TIMEOUTUndef

Did you check them accordingly?