adcfgclone.pl appsTier dualfs erroring out while Instantiating the OHS Config.

[ef_arg]

adcfgclone.pl appsTier dualfs  is erroring out while  Instantiating the OHS Config


adcfgclone.pl error:

------------------------
Configuring: Run file system....
LogFile located at /PROD/SID/appl/fs2/inst/apps/SID_host/admin/log/clone/run/RCloneApplyAppstier_06290017.log

ERROR: Failed to configure the target system,
please check the logfile in : /PROD/SID/appl/fs2/inst/apps/SID_host/admin/log/clone
$  
$bash-3.2$ ls /PROD/SID/appl/fs2/inst/apps/SID_host/admin/log/clone/
run
bash-3.2$ ls -l /PROD/SID/appl/fs2/inst/apps/SID_host/admin/log/clone/run
total 818
-rw-r--r--   1 applmgr dba      1092 Jun 29 00:44 adcvmlog.xml
drwxr-xr-x   2 applmgr dba         4 Jun 29 00:40 fmwT2PApply
-rw-r--r--   1 applmgr dba     14285 Jun 29 00:44 NetServiceHandler.log
drwxr-xr-x   2 applmgr dba         4 Jun 29 01:03 ohsT2PApply
-rw-r--r--   1 applmgr dba    309933 Jun 29 01:03 RCloneApplyAppstier_06290017.log
drwxr-xr-x   2 applmgr dba         4 Jun 29 01:00 txkSetOHSConfig_06290100
drwxr-xr-x   2 applmgr dba         4 Jun 29 00:58 wlsT2PApply
bash-3.2$

bash-3.2$ cat /PROD/SID/appl/fs2/inst/apps/SID_host/admin/log/clone/run/RCloneApplyAppstier_06290017.log
...
START: Instantiating the OHS Config.
Running /PROD/SID/appl/fs2/FMW_Home/webtier/perl/bin/perl  -I/PROD/SID/appl/fs2/FMW_Home/webtier/perl/lib/5.10.0 -I/PROD/SID/appl/fs2/FMW_Home/webti
er/perl/lib/site_perl/5.10.0 -I/PROD/SID/appl/fs2/EBSapps/appl/au/12.0.0/perl -I/PROD/SID/appl/fs2/FMW_Home/webtier/ohs/mod_perl/lib/site_perl/5.10.0/s
un4-solaris-thread-multi-64 /PROD/SID/appl/fs2/EBSapps/appl/fnd/12.0.0/patch/115/bin/txkSetOHSConfig.pl cfgCloneInstance -ctxfile=/PROD/SID/appl/fs2/in
st/apps/SID_host/appl/admin/SID_host.xml -archvloc=/PROD/SID/appl/fs2/EBSapps/comn/clone/FMW/OHS/ohsarchive.jar -mvpln=/PROD/SID/appl/fs2/EBS
apps/comn/clone/FMW/OHS/moveplan.xml -t2plogloc=/PROD/SID/appl/fs2/inst/apps/SID_host/admin/log/clone/run/ohsT2PApply -logdir=/PROD/SID/appl/fs2/i
nst/apps/SID_host/admin/log/clone/run -console=off -promptmsg=hide
Script Executed in 153161 milliseconds, returning status 255
ERROR: Script failed, exit code 255
bash-3.2$

bash-3.2$ cd /PROD/SID/appl/fs2/inst/apps/SID_host/admin/log/clone/run/ohsT2PApply
bash-3.2$ ls -l
total 522
-rw-r--r--   1 applmgr dba      1851 Jun 29 01:03 CLONE2024-06-29_01-00-37_1835937867.error
-rw-r--r--   1 applmgr dba    157925 Jun 29 01:03 CLONE2024-06-29_01-00-37_1835937867.log
bash-3.2$

bash-3.2$ cat CLONE2024-06-29_01-00-37_1835937867.error
WARNING : Failed to start component EBS_web_SID
SEVERE : [PLUGIN][OHS] - ERROR - Jun 29, 2024 01:03:04 - CLONE-26009   OHS T2P failed.
SEVERE : [PLUGIN][OHS] - CAUSE - Jun 29, 2024 01:03:04 - CLONE-26009   Unable to start OS component.
SEVERE : [PLUGIN][OHS] - ACTION - Jun 29, 2024 01:03:04 - CLONE-26009   Check clone log and error file and ohs log file /PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/diagnostics/logs/OHS/EBS_web_SID/console~OHS~1.log for root cause.
SEVERE : Jun 29, 2024 01:03:04 - ERROR - CLONE-20218   Cloning is not successful.
SEVERE : Jun 29, 2024 01:03:04 - CAUSE - CLONE-20218   An internal operation failed.
SEVERE : Jun 29, 2024 01:03:04 - ACTION - CLONE-20218   Provide the clone log and error file for investigation.
oracle.as.t2p.exceptions.FMWT2PPasteConfigException: java.lang.Exception: Unable to start OHS Component.
        at oracle.as.clone.ohs.impl.OHSComponentApplyClonerImpl.doPostPasteConfig(OHSComponentApplyClonerImpl.java:251)
        at oracle.as.clone.cloner.component.ComponentApplyCloner.doClone(ComponentApplyCloner.java:193)
        at oracle.as.clone.cloner.Cloner.doFinalClone(Cloner.java:63)
        at oracle.as.clone.request.ApplyCloneRequest.applyArchive(ApplyCloneRequest.java:198)
        at oracle.as.clone.request.ApplyCloneRequest._clone(ApplyCloneRequest.java:77)
        at oracle.as.clone.process.CloningExecutionProcess.execute(CloningExecutionProcess.java:131)
        at oracle.as.clone.process.CloningExecutionProcess.execute(CloningExecutionProcess.java:114)
        at oracle.as.clone.client.CloningClient.executeT2PCommand(CloningClient.java:236)
        at oracle.as.clone.client.CloningClient.main(CloningClient.java:124)
Caused by: java.lang.Exception: Unable to start OHS Component.
        at oracle.as.clone.ohs.impl.OHSComponentApplyClonerImpl.doPostPasteConfig(OHSComponentApplyClonerImpl.java:247)
        ... 8 more
bash-3.2$


bash-3.2$ cat CLONE2024-06-29_01-00-37_1835937867.log
...
FINE : Jun 29, 2024 01:00:54 - CLONE-22260   Executing following command:
 /bin/chmod 600 /PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/config/OHS/EBS_web_SID/oracle_apache.conf .
FINE : [PLUGIN][OHS] OHSPasteConfig:restorePermissionOfAllConfigFiles :: Permission of /PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/config/OHS/EBS_web_SID/oracle_apache.conf file changed successfully
INFO : [PLUGIN][OHS] Jun 29, 2024 01:00:54 - CLONE-26156   Permission of configuration files are restored successfully.
FINE : [PLUGIN][OHS] MovableComponentBuilder:getHttpdConfFilePath :: Path of httpd.conf file is = /PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/config/OHS/EBS_web_SID/httpd.conf
INFO : [PLUGIN][OHS] Jun 29, 2024 01:00:54 - CLONE-26116   Updating webgate specific configuration, if any ...
FINE : [PLUGIN][OHS] OHS is not configured with webgate as no WebGateInstalldir config property is not present in moveplan.
FINE : [PLUGIN][OHS] No webgate install directory is found in the moveplan. No update for webgate specific.
FINE : Jun 29, 2024 01:00:54 - [CloneLogger:setSystemOutErrToCloneLogger] Invoking setSystemOutErrToCloneLogger 2
INFO : [PLUGIN][OHS] Jun 29, 2024 01:00:54 - CLONE-26104   Stopping OHS component ...
INFO : [PLUGIN][OHS] Jun 29, 2024 01:00:54 - CLONE-26105   OHS component stopped successfully.
INFO : [PLUGIN][OHS] Jun 29, 2024 01:00:54 - CLONE-26108   Starting OHS component ...
FINE : [PLUGIN][OHS] Component start status =false
FINE : Jun 29, 2024 01:03:04 - [CloneLogger:unSetSystemOutErrToCloneLogger] Invoking unsetSystemOutErrToCloneLogger 2
INFO : Jun 29, 2024 01:03:04 - CLONE-21276
---------------------------------------------------
               T2P Summary Begin
---------------------------------------------------
Error Message  :1
  [PLUGIN][OHS] - ERROR - Jun 29, 2024 01:03:04 - CLONE-26009   OHS T2P failed.
  [PLUGIN][OHS] - CAUSE - Jun 29, 2024 01:03:04 - CLONE-26009   Unable to start OS component.
  [PLUGIN][OHS] - ACTION - Jun 29, 2024 01:03:04 - CLONE-26009   Check clone log and error file and ohs log file /PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/diagnostics/logs/OHS/EBS_web_SID/console~OHS~1.log for root cause.




---------------------------------------------------
               T2P Summary End
---------------------------------------------------
bash-3.2$

bash-3.2$ cat /PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/diagnostics/logs/OHS/EBS_web_SID/console~OHS~1.log

--------
24/06/29 01:00:54 Start process
--------
/PROD/SID/appl/fs2/FMW_Home/webtier/ohs/bin/apachectl startssl: execing httpd
ModSecurity: WARNING Using transformations in SecDefaultAction is deprecated (/PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/config/OHS/EBS_web_SID/security2.conf:62).
ModSecurity: WARNING Using transformations in SecDefaultAction is deprecated (/PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/config/OHS/EBS_web_SID/security2.conf:84).
[Sat Jun 29 01:00:54 2024] [warn] Errors will be logged into /PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/diagnostics/logs/OHS/EBS_web_SID/EBS_web_SID.log
ModSecurity: WARNING Using transformations in SecDefaultAction is deprecated (/PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/config/OHS/EBS_web_SID/security2.conf:62).
ModSecurity: WARNING Using transformations in SecDefaultAction is deprecated (/PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/config/OHS/EBS_web_SID/security2.conf:84).
[Sat Jun 29 01:00:55 2024] [warn] Errors will be logged into /PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/diagnostics/logs/OHS/EBS_web_SID/EBS_web_SID.log
Audit init

--------
24/06/29 01:03:04 Stop process
--------
/PROD/SID/appl/fs2/FMW_Home/webtier/ohs/bin/apachectl stop: httpd stopped
bash-3.2$

bash-3.2$ cat /PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/diagnostics/logs/OHS/EBS_web_SID/EBS_web_SID.log
[2024-06-29T01:00:55.0133-03:00] [OHS] [WARNING:32] [OHS-205] [core.c] [host_id: host] [host_addr: 10.0.10.19] [pid: 11181] [tid: 1] [user: applmgr] [VirtualHost: host.domain.net:0]  Init: (host.domain.net:443) SSLv3 is an insecure protocol. Please consider using TLS instead of SSLv3.

[2024-06-29T01:00:55.0189-03:00] [OHS] [WARNING:32] [OHS-205] [core.c] [host_id: host] [host_addr: 10.0.10.19] [pid: 11181] [tid: 1] [user: applmgr] [VirtualHost: host.domain.net:10009]  Init: (host.domain.net:10009) SSLv3 is an insecure protocol. Please consider using TLS instead of SSLv3.

[2024-06-29T01:00:55.0200-03:00] [OHS] [NOTIFICATION:16] [OHS-9999] [core.c] [host_id: host] [host_addr: 10.0.10.19] [pid: 11181] [tid: 1] [user: applmgr] [VirtualHost: main]  ModSecurity for Apache/2.7.4 (http://www.modsecurity.org/) configured.

[2024-06-29T01:00:55.0200-03:00] [OHS] [NOTIFICATION:16] [OHS-9999] [core.c] [host_id: host] [host_addr: 10.0.10.19] [pid: 11181] [tid: 1] [user: applmgr] [VirtualHost: main]  ModSecurity: APR compiled version="1.4.5"; loaded version="1.4.5"

[2024-06-29T01:00:55.0200-03:00] [OHS] [NOTIFICATION:16] [OHS-9999] [core.c] [host_id: host] [host_addr: 10.0.10.19] [pid: 11181] [tid: 1] [user: applmgr] [VirtualHost: main]  ModSecurity: PCRE compiled version="5.0 "; loaded version="5.0 13-Sep-2004"

[2024-06-29T01:00:55.0200-03:00] [OHS] [NOTIFICATION:16] [OHS-9999] [core.c] [host_id: host] [host_addr: 10.0.10.19] [pid: 11181] [tid: 1] [user: applmgr] [VirtualHost: main]  ModSecurity: LIBXML compiled version="2.7.2"

[2024-06-29T01:00:56.1271-03:00] [OHS] [WARNING:32] [OHS-205] [core.c] [host_id: host] [host_addr: 10.0.10.19] [pid: 11181] [tid: 1] [user: applmgr] [VirtualHost: host.domain.net:0]  Init: (host.domain.net:443) SSLv3 is an insecure protocol. Please consider using TLS instead of SSLv3.

[2024-06-29T01:00:56.2176-03:00] [OHS] [WARNING:32] [OHS-205] [core.c] [host_id: host] [host_addr: 10.0.10.19] [pid: 11181] [tid: 1] [user: applmgr] [VirtualHost: host.domain.net:10009]  Init: (host.domain.net:10009) SSLv3 is an insecure protocol. Please consider using TLS instead of SSLv3.

[2024-06-29T01:00:56.2957-03:00] [OHS] [NOTIFICATION:16] [OHS-9999] [core.c] [host_id: host] [host_addr: 10.0.10.19] [pid: 11181] [tid: 1] [user: applmgr] [VirtualHost: main]  WebLogic Server Plugin version 1.1 <WLSPLUGINS_11.1.1.9.0_SOLARIS.SPARC64_150206.1116>

[2024-06-29T01:00:56.3548-03:00] [OHS] [NOTIFICATION:16] [OHS-9999] [core.c] [host_id: host] [host_addr: 10.0.10.19] [pid: 11181] [tid: 1] [user: applmgr] [VirtualHost: main]  Oracle-HTTP-Server-11g/11.1.1.9.0 (Unix) mod_ssl/11.1.1.9.0 OtherSSL/0.0.0 mod_onsint/2.0 configured -- resuming normal operations

[2024-06-29T01:03:06.3016-03:00] [OHS] [NOTIFICATION:16] [OHS-9999] [core.c] [host_id: host] [host_addr: 10.0.10.19] [pid: 11181] [tid: 1] [user: applmgr] [VirtualHost: main]  caught SIGTERM, shutting down

bash-3.2$

[ErmanArslansOracleBlog]

This may be due to "SSLv3 is an insecure protocol. Please consider using TLS instead of SSLv3."

When did this start to happen? Are your SSL Cipers up-to-date?


Also see the following MOS Notes and evaluate the solutions documented in them ->

TxkSetOHSConfig.pl Fails During Clone with oracle.as.t2p.exceptions.FMWT2PPasteConfigException: java.lang.Exception: Unable to start OHS Component. (Doc ID 2190477.1)

Starting Apache adapcctl.sh : exiting with status 204 Error and Unable to initialize SSL environment, nzos call nzosSetCipherSuite returned 28884 (Doc ID 2848088.1)

[ef_arg]

Hi Erman,

Your support is very much appreciatted. This is a legacy software that was unnatended for a while, and keep it in "automatic mode" :).

I cant tell if is new issue after any change/patching or never worked. As per the bash_history, looks like they applied some FMW patches with bsu.sh at some point before pre clonning the instance but I dont have any details.

I did tested this solution already:

TxkSetOHSConfig.pl Fails During Clone with oracle.as.t2p.exceptions.FMWT2PPasteConfigException: java.lang.Exception: Unable to start OHS Component. (Doc ID 2190477.1)

--export CONFIG_JVM_ARGS="-Xms1024m -Xmx1024m"
--re run perl adcfgclone.pl appsTier dualfs
--same error

Starting Apache adapcctl.sh : exiting with status 204 Error and Unable to initialize SSL environment, nzos call nzosSetCipherSuite returned 28884 (Doc ID 2848088.1)
--Looks like this setup was never completed on the source:
---->Prerequisite Steps to Configure Oracle Fusion Middleware 11.1.1.9 Components for Oracle E-Business Suite Release 12.2 Before Applying July 2019 or Later FMW OSS Security Patch (Doc ID 2555355.1)
------->"Section 4: Configuring the SSL Protocol and Cipher Suites"

bash-3.2$ cat /PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/config/OHS/EBS_web_SID/ssl.conf |grep SSLProtocol
                        SSLProtocol    -all +TLSv1 +SSLv3
bash-3.2$ cat /PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/config/OHS/EBS_web_SID/ssl.conf |grep SSLCipher
                        #SSLCipherSuite SSL_RSA_WITH_RC4_128_MD5,SSL_RSA_WITH_RC4_128_SHA,SSL_RSA_WITH_3DES_EDE_CBC_SHA,SSL_RSA_WITH_DES_CBC_SHA,TLS_RSA_WITH_AES_128_CBC_SHA,TLS_RSA_WITH_AES_256_CBC_SHA
                        SSLCipherSuite HIGH:MEDIUM:!aNULL:+SHA1:+MD5:+HIGH:+MEDIUM
bash-3.2$

bash-3.2$ cat /PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/config/OHS/EBS_web_SID/admin.conf |grep SSLProtocol
                SSLProtocol nzos_Version_1_0 nzos_Version_3_0
bash-3.2$ cat /PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/config/OHS/EBS_web_SID/admin.conf |grep SSLCipher
                SSLCipherSuite SSL_RSA_WITH_RC4_128_SHA
bash-3.2$

bash-3.2$ cat /PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/config/OPMN/opmn/opmn.xml |grep ssl
      <ssl enabled="true" wallet-file="/PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/config/OPMN/opmn/wallet"/>
        <data id="start-mode" value="ssl-enabled"/>
bash-3.2$

The thing is that, FMW_HOME is recreated from adcfgclone, so not sure how to make changes there.

-Additional troubleshooting, I saw some old post here, indicating the root cause could be related with s_ohs_installed

--PM.error Occurred On adop phase=fs_clone (Doc ID 1939065.1)
Source $CONTEXT_FILE: (Note "inst_" is bkp of source INST_TOP

bash-3.2$ cat /PROD/SID/appl/fs2/inst_/apps/sourceDomain/appl/admin/sourceDomain.xml |grep s_ohs_installed
         <config_option type="techstack" oa_var="s_ohs_installed">generateEBSOHSConfigFiles</config_option>
bash-3.2$

Target $CONTEXT_FILE, created by adcfgclone:

bash-3.2$ cat $CONTEXT_FILE |grep s_ohs_installed
         <config_option type="techstack" oa_var="s_ohs_installed">false</config_option>
bash-3.2$

I tried to manually update s_ohs_installed from "false" to "generateEBSOHSConfigFiles" in both run/patch context files right after it is created by adcfgclone, before the OHS step is reach, but no luck. As per the note, I should also upload that modified context file to the DB with CtxSynchronizer but Im not sure this aproach is applicable to a clone scenario.

Let me know what you think.

[ErmanArslansOracleBlog]

Did you run RDA and take corrective actions?

->Fix all missing prerequisites as per Note 250262.1 RDA 4 - Health Check / Validation Engine Guide

[ef_arg]

Hi Erman, I did but... now I think i might have run it incorrectly. I cant find instructions on how to run it...

I passed "/PROD/SID/appl" as the base path... should I pass the FWM_HOME instead?

Regards

[ErmanArslansOracleBlog]

You have to get preinstall RDA output for EBS.

See -> Remote Diagnostic Agent (RDA) - Information Center (Doc ID 2388643.2) - TAB Nane : USING RDA

Also use "rda.sh -T hcve"

[ErmanArslansOracleBlog]

note that hcve is "Health Check Validation Engine"

[ef_arg]

Hi Erman,

Im getting some failed validations:

ID     NAME                 RESULT  VALUE
====== ==================== ======= ==========================================
A00100 OS Type              RECORD  SunOS SPARC 2.10 (Update 11) 64-bit
A00200 OS Certified?        PASSED  Certified
A00210 Got Maint Updates?   PASSED  MaintUpdOk
A01010 ApplTierDirectory    RECORD  /PROD/SID/appl
A01020 A_T Valid?           PASSED  ATexists
A01030 A_T Permissions OK?  PASSED  CorrectPerms
A01040 A_T Disk Space       PASSED  Available
A01400 Got Software Tools?  PASSED  tools_found
A02020 ulimits OK?          PASSED  ulimitOK
A02210 Kernel Params OK?    PASSED  KernelOK
A03010 Space in tmp         PASSED  Available
A03510 IP Address           RECORD  10.0.10.19
A03530 Domain Name          RECORD  NotFound
A03540 /etc/hosts Format    FAILED  No entry found
A03550 DNS Lookup           FAILED  Host not correctly registered in DNS
A03560 Net Service Access?  PASSED  PermOk
A03570 Port 6000            PASSED  Free
A03620 anon port range OK?  FAILED  tcp_smallest tcp_largest udp_smallest...
A04400 Got OS Packages?     PASSED  All required OS packages are installed
A05400 Solaris 10 Patches?  PASSED  Adequate
Result file: output/collect/APPS_HCVE_A_EBS122_sol_res.htm
bash-3.2$

Is it important to mention that we have 2 Separated EBS instances, with same patch level, setup, etc. The clone is not erroring out for the other one, and "rda.sh -T hcve" is trowing the exact same result.

Only difference between the two envs is hostname and IP

$ ifconfig -a
lo0: flags=2001000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL> mtu 8232 index 1
inet 127.0.0.1 netmask ff000000
vnic5: flags=100001000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4,PHYSRUNNING> mtu 1500 index 2
inet 10.0.10.20 netmask ffffff00 broadcast 10.0.10.255
$

Not working
# ifconfig -a
lo0: flags=2001000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL> mtu 8232 index 1
inet 127.0.0.1 netmask ff000000
vnic2: flags=100001000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4,PHYSRUNNING> mtu 1500 index 2
inet 10.0.10.19 netmask ff000000 broadcast 10.255.255.255
ether 2:8:20:66:f1:b2
#

Im starting to thing the issue could be some kind of corruption at the time of the copy.
Regards

[ErmanArslansOracleBlog]

Did you solve the following ones and retry?

A03540 /etc/hosts Format    FAILED  No entry found
A03550 DNS Lookup           FAILED  Host not correctly registered in DNS

[ef_arg]

I tried everything and that validation is still failing, not sure what it is actually checking.
The hosts file is there ( it is a symb. link to ./inet/hosts, granted 777 just in case, and the format is correct.

[ef_arg]

Hi Erman,

We opened a case with oracle support, not very helpfull sofar, but today they just told us the issue is DB clone:

"we DO NOT support running FND_CONC_CLONE.SETUP_CLEAN for cloning. we know running this command will prevent information to be collected properly in the database and prevents the cloning on the application tier to configure the server when running Rapid Clone"

and also, in fnd_nodes table, virtual IP value is set, and they said "virtual IP are only allowed for RAC cloning and Rapid Clone would never have setup virtual IP unless detecting a Clusterware --- something is wrong in the database cloning" <-- This is single node (db and app server on the same box) so this is the expected setup.

It is weird they blaiming FND_CONC_CLONE.SETUP_CLEAN when we are following the exact same procedure in our second environment and it is working just fine.

Regards

[ef_arg]

Hi Erman,

I´m doing some progress from my end. So... since the postclone script is erroring out trying to start the OHS component, i tried to start it up manually with $ADMIN_SCRIPTS_HOME/adapcctl.sh start

As expected, after some time it is erroring out with status 152, and the logs are not very friendly BUT, the error (or not error) is similar to the ones im getting while doing the postclone:

bash-3.2$ adapcctl.sh start

You are running adapcctl.sh version 120.0.12020000.6

Starting OPMN managed Oracle HTTP Server (OHS) instance ...

adapcctl.sh: exiting with status 152

adapcctl.sh: check the logfile /PROD/SID/appl/fs2/inst/apps/SID_hostname/logs/appl/admin/log/adapcctl.txt for more information ...

bash-3.2$ cat /PROD/SID/appl/fs2/inst/apps/SID_hostname/logs/appl/admin/log/adapcctl.txt

07/10/24-00:52:50 :: adapcctl.sh version 120.0.12020000.6
07/10/24-00:52:50 :: adapcctl.sh: starting OPMN if it is not running

opmnctl start: opmn is already running.

07/10/24-00:52:50 :: adapcctl.sh: starting OPMN managed OHS instance

opmnctl startproc: starting opmn managed processes...
================================================================================
opmn id=applmgr:6701
Response: 0 of 1 processes started.

ias-instance id=EBS_web_SID_OHS1
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
--------------------------------------------------------------------------------
ias-component/process-type/process-set:
  EBS_web_SID/OHS/OHS/

Error
--> Process (index=1,uid=66076761,pid=18512)
  time out while waiting for a managed process to start
  Log:
  /PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/diagnostics/logs/OHS/EBS_web_SID/console~OHS~1.log


07/10/24-00:55:01 :: adapcctl.sh: exiting with status 152

================================================================================
bash-3.2$cat /PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/diagnostics/logs/OHS/EBS_web_SID/console~OHS~1.log

--------
24/07/10 00:46:05 Start process
--------
/PROD/SID/appl/fs2/FMW_Home/webtier/ohs/bin/apachectl startssl: execing httpd
ModSecurity: WARNING Using transformations in SecDefaultAction is deprecated (/PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/config/OHS/EBS_web_SID/security2.conf:62).
ModSecurity: WARNING Using transformations in SecDefaultAction is deprecated (/PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/config/OHS/EBS_web_SID/security2.conf:84).
[Wed Jul 10 00:46:05 2024] [warn] Errors will be logged into /PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/diagnostics/logs/OHS/EBS_web_SID/EBS_web_SID.log
ModSecurity: WARNING Using transformations in SecDefaultAction is deprecated (/PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/config/OHS/EBS_web_SID/security2.conf:62).
ModSecurity: WARNING Using transformations in SecDefaultAction is deprecated (/PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/config/OHS/EBS_web_SID/security2.conf:84).
[Wed Jul 10 00:46:06 2024] [warn] Errors will be logged into /PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/diagnostics/logs/OHS/EBS_web_SID/EBS_web_SID.log
Audit init

--------
24/07/10 00:48:15 Stop process
--------
/PROD/SID/appl/fs2/FMW_Home/webtier/ohs/bin/apachectl stop: httpd stopped

--------
24/07/10 00:52:51 Start process
--------
/PROD/SID/appl/fs2/FMW_Home/webtier/ohs/bin/apachectl startssl: execing httpd
ModSecurity: WARNING Using transformations in SecDefaultAction is deprecated (/PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/config/OHS/EBS_web_SID/security2.conf:62).
ModSecurity: WARNING Using transformations in SecDefaultAction is deprecated (/PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/config/OHS/EBS_web_SID/security2.conf:84).
[Wed Jul 10 00:52:51 2024] [warn] Errors will be logged into /PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/diagnostics/logs/OHS/EBS_web_SID/EBS_web_SID.log
ModSecurity: WARNING Using transformations in SecDefaultAction is deprecated (/PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/config/OHS/EBS_web_SID/security2.conf:62).
ModSecurity: WARNING Using transformations in SecDefaultAction is deprecated (/PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/config/OHS/EBS_web_SID/security2.conf:84).
[Wed Jul 10 00:52:52 2024] [warn] Errors will be logged into /PROD/SID/appl/fs2/FMW_Home/webtier/instances/EBS_web_SID_OHS1/diagnostics/logs/OHS/EBS_web_SID/EBS_web_SID.log
Audit init

--------
24/07/10 00:55:01 Stop process
--------
/PROD/SID/appl/fs2/FMW_Home/webtier/ohs/bin/apachectl stop: httpd stopped
bash-3.2$

After doing some troubleshooting, I found several notes asking to validate the httpd.conf and webgate.conf (Ex: Starting HTTP Server fails with "Time Out While Waiting For a Managed Process to Start" with WebGate is Configured (Doc ID 1916960.1)) and then I noticed webgate.conf is not present in my cloned FMW_HOME

bash-3.2$ cd /PROD/SID/appl/fs2/ <<-- This is current run fs
bash-3.2$ ls -l
total 26
drwxr-xr-x   5 applmgr dba         5 May  8  2016 EBSapps
drwxr-x---  11 applmgr dba        17 Jul 10 00:32 FMW_Home  
drwxr-x---  11 applmgr dba        17 May  8  2016 FMW_Home_ <--Backup
drwxr-xr-x   3 applmgr dba         3 Jul 10 00:02 inst
drwxr-xr-x   3 applmgr dba         3 May  6  2016 inst_ <--Backup
drwxr-xr-x  15 applmgr dba        32 Jul  8 02:41 rda
-r--r--r--   1 applmgr dba      2314 Mar 11 19:39 readme.txt
bash-3.2$

bash-3.2$ find . -name "webgate.conf"
./FMW_Home_/webtier/instances/EBS_web_SID_OHS1/config/OHS/EBS_web_SID/webgate.conf
./inst_/apps/SID_sourceHostname/appl/admin/cutover/OHS/EBS_web_SID/webgate.conf
./inst_/apps/SID_sourceHostname/admin/out/05082153/webgate.conf
./inst_/apps/SID_sourceHostname/admin/out/05081424/webgate.conf
./inst_/apps/SID_sourceHostname/admin/out/05081145/webgate.conf
bash-3.2$

Should I force the fix and manually copy webgate from the bkp?
Regards

[ErmanArslansOracleBlog]

Good for you.

But you got status 152..

Do you have any problems with DNS resolutions in this environment? -- considering the error you got in the orachk... ???

Considering ->

A03540 /etc/hosts Format    FAILED  No entry found
A03550 DNS Lookup           FAILED  Host not correctly registered in DNS

And the MOS NOTE:
--->
EBS 12.2 Production Http Services Not Coming Up (Doc ID 2945209.1) -- DNS related status 152.

And also did you check the following? ->

http://erman-arslan-s-oracle-forum.124.s1.nabble.com/Apache-exiting-with-152-td11857.html

[ErmanArslansOracleBlog]

I don't think that, this is related with fnd_conc_clone.setup_clean.. No need to concentrate on that at the moment.

[ef_arg]

I did tried the solution from http://erman-arslan-s-oracle-forum.124.s1.nabble.com/Apache-exiting-with-152-td11857.html but same error msg.

Regarding the dns, this is local and etc hots is set correctly so i’m not sure what im missing

[ErmanArslansOracleBlog]

please fix the orachk because I see some clues about it in MOS Note -> EBS 12.2 Production Http Services Not Coming Up (Doc ID 2945209.1) -- DNS related status 152.

[ef_arg]

Yes, agree. Saw that note, in my case the platform is Sparc 5.10. but yes, everything points to the dns.

Ill review this with the os admin is a few hs. I’ll keep you posted.
Regards.

[ErmanArslansOracleBlog]

Okay. good. lets see

[ef_arg]

We are in a bottleneck.. we dont have a DNS Server, and nslookup is not honoring what we have in /etc/hosts



 

[ErmanArslansOracleBlog]

What about "A03540 /etc/hosts Format    FAILED  No entry found"?