opfinbac@udkfinp03:/opt/application/V12/etcc/wrk$ adopscanlog Scanning /opt/application/V12/fs_ne/EBSapps/log/adop/71/ directory ... /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_143220/fs_clone/validate/remote_execution_result_level1.xml: -------------------------------------------------------------------------------------------------------------------- /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_143220/fs_clone/validate/remote_execution_result_level2.xml: -------------------------------------------------------------------------------------------------------------------- /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_143220/fs_clone/udkfinp03/TXK_SYNC_create/txkADOPPreparePhaseSynchronize.log: ------------------------------------------------------------------------------------------------------------------------------------- Lines #(501-503): TIME : Mon Feb 17 17:39:32 2020 FUNCTION: main::runFSCloneApply [ Level 1 ] ERRORMSG: /opt/application/V12/fs1/EBSapps/comn/adopclone_udkfinp03/bin/adclone.pl did not go through successfully. /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_143220/fs_clone/udkfinp03/TXK_SYNC_create/fsclone_apply/FSCloneApplyAppsTier_02171551.log: -------------------------------------------------------------------------------------------------------------------------------------------------- Lines #(5302-5306): Script Executed in 14357 milliseconds, returning status 1 ERROR: Failed to execute /opt/application/V12/fs2/EBSapps/appl/ad/12.0.0/patch/115/bin/adPostDomainCloneCfg.pl START: Inside exitClone.... /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_143220/fs_clone/udkfinp03/adop.log: ------------------------------------------------------------------------------------------- Lines #(135-140): [PROCEDURE] Calling: /opt/application/V12/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl [EVENT] Log: /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_143220/fs_clone/udkfinp03 [UNEXPECTED]Error occurred running "perl /opt/application/V12/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl -contextfile=/opt/application/V12/fs1/inst/apps/DBOFINP1_udkfinp03/appl/admin/DBOFINP1_udkfinp03.xml -patchcontextfile=/opt/application/V12/fs2/inst/apps/DBOFINP1_udkfinp03/appl/admin/DBOFINP1_udkfinp03.xml -promptmsg=hide -console=off -mode=create -sync_mode=copy -sessionid=71 -timestamp=20200217_143220 -outdir=/opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_143220/fs_clone/udkfinp03" [UNEXPECTED]occurred during CLONE Patch File System from Run File System, running command: "perl /opt/application/V12/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl -contextfile=/opt/application/V12/fs1/inst/apps/DBOFINP1_udkfinp03/appl/admin/DBOFINP1_udkfinp03.xml -patchcontextfile=/opt/application/V12/fs2/inst/apps/DBOFINP1_udkfinp03/appl/admin/DBOFINP1_udkfinp03.xml -promptmsg=hide -console=off -mode=create -sync_mode=copy -sessionid=71 -timestamp=20200217_143220 -outdir=/opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_143220/fs_clone/udkfinp03". [EVENT] Releasing managed server ports. [PROCEDURE] [START 2020/02/17 17:39:32] Releasing ports Lines #(152-156): and appltop_id=3233 and node_name='udkfinp03'" [PROCEDURE] [END 2020/02/17 17:39:37] Updating status of patches [UNEXPECTED]fs_clone has failed. [PROCEDURE] [START 2020/02/17 17:39:38] Unlocking sessions table [STATEMENT] Unlocking ad_adop_sessions table for udkfinp03 with wait interval of 60 seconds and number of tries 6 /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_143220/fs_clone/remote_execution_result_level1.xml: ----------------------------------------------------------------------------------------------------------- Status of remote command on Node udkfinp03 is failed. Error string was found in the above file. Please check the adoplog files created in udkfinp03 for more details. Status of remote command on Node udkfinp03 is failed. Unexpected string was found in the above file. Please check the adoplog files created in udkfinp03 for more details. Status of remote command on Node udkfinp03 is failed. Error string was found in the above file. Please check the adoplog files created in udkfinp03 for more details. /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_143220/adop.log: ------------------------------------------------------------------------ Lines #(227-232): Running "adop phase=fs_clone" actions on node(s): udkfinp03 Remote execution results xml output file: /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_143220/fs_clone/remote_execution_result_level1.xml [ERROR] Node: "udkfinp03" Status: "failed" [ERROR] adop phase=fs_clone failed on Node: "udkfinp03" [STATEMENT] SQL Statment : " update ad_adop_session_patches set status='F' ,end_date=to_date('','DD-MM-YYYY HH24:MI:SS') Lines #(238-244): and node_name IN ('udkfinp03') " [ERROR] adop phase=fs_clone failed or is incomplete on Admin node: udkfinp03 [ERROR] Unable to continue processing on other available nodes: udkfinp04,udkfinp05,udkfinp06,udkfinp07,udkfinp08 [UNEXPECTED]Error running "adop phase=fs_clone" on node(s): udkfinp03. [EVENT] Stopping services on patch file system. /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_191054/fs_clone/validate/remote_execution_result_level1.xml: -------------------------------------------------------------------------------------------------------------------- /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_191054/fs_clone/validate/remote_execution_result_level2.xml: -------------------------------------------------------------------------------------------------------------------- /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_191054/fs_clone/udkfinp03/TXK_SYNC_create/txkADOPPreparePhaseSynchronize.log: ------------------------------------------------------------------------------------------------------------------------------------- Lines #(313-315): TIME : Mon Feb 17 19:42:00 2020 FUNCTION: main::runFSCloneApply [ Level 1 ] ERRORMSG: /opt/application/V12/fs1/EBSapps/comn/adopclone_udkfinp03/bin/adclone.pl did not go through successfully. /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_191054/fs_clone/udkfinp03/TXK_SYNC_create/fsclone_apply/FSCloneApplyAppsTier_02171925.log: -------------------------------------------------------------------------------------------------------------------------------------------------- Lines #(468-472): Script Executed in 12406 milliseconds, returning status 1 ERROR: Failed to execute /opt/application/V12/fs2/EBSapps/appl/ad/12.0.0/patch/115/bin/adPostDomainCloneCfg.pl START: Inside exitClone.... /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_191054/fs_clone/udkfinp03/adop.log: ------------------------------------------------------------------------------------------- Lines #(135-140): [PROCEDURE] Calling: /opt/application/V12/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl [EVENT] Log: /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_191054/fs_clone/udkfinp03 [UNEXPECTED]Error occurred running "perl /opt/application/V12/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl -contextfile=/opt/application/V12/fs1/inst/apps/DBOFINP1_udkfinp03/appl/admin/DBOFINP1_udkfinp03.xml -patchcontextfile=/opt/application/V12/fs2/inst/apps/DBOFINP1_udkfinp03/appl/admin/DBOFINP1_udkfinp03.xml -promptmsg=hide -console=off -mode=create -sync_mode=copy -sessionid=71 -timestamp=20200217_191054 -outdir=/opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_191054/fs_clone/udkfinp03" [UNEXPECTED]occurred during CLONE Patch File System from Run File System, running command: "perl /opt/application/V12/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl -contextfile=/opt/application/V12/fs1/inst/apps/DBOFINP1_udkfinp03/appl/admin/DBOFINP1_udkfinp03.xml -patchcontextfile=/opt/application/V12/fs2/inst/apps/DBOFINP1_udkfinp03/appl/admin/DBOFINP1_udkfinp03.xml -promptmsg=hide -console=off -mode=create -sync_mode=copy -sessionid=71 -timestamp=20200217_191054 -outdir=/opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_191054/fs_clone/udkfinp03". [EVENT] Releasing managed server ports. [PROCEDURE] [START 2020/02/17 19:42:00] Releasing ports Lines #(152-156): and appltop_id=3233 and node_name='udkfinp03'" [PROCEDURE] [END 2020/02/17 19:42:03] Updating status of patches [UNEXPECTED]fs_clone has failed. [PROCEDURE] [START 2020/02/17 19:42:04] Unlocking sessions table [STATEMENT] Unlocking ad_adop_sessions table for udkfinp03 with wait interval of 60 seconds and number of tries 6 /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_191054/fs_clone/remote_execution_result_level1.xml: ----------------------------------------------------------------------------------------------------------- Status of remote command on Node udkfinp03 is failed. Error string was found in the above file. Please check the adoplog files created in udkfinp03 for more details. Status of remote command on Node udkfinp03 is failed. Unexpected string was found in the above file. Please check the adoplog files created in udkfinp03 for more details. Status of remote command on Node udkfinp03 is failed. Error string was found in the above file. Please check the adoplog files created in udkfinp03 for more details. /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_191054/adop.log: ------------------------------------------------------------------------ Lines #(246-251): Running "adop phase=fs_clone" actions on node(s): udkfinp03 Remote execution results xml output file: /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_191054/fs_clone/remote_execution_result_level1.xml [ERROR] Node: "udkfinp03" Status: "failed" [ERROR] adop phase=fs_clone failed on Node: "udkfinp03" [STATEMENT] SQL Statment : " update ad_adop_session_patches set status='F' ,end_date=to_date('','DD-MM-YYYY HH24:MI:SS') Lines #(257-263): and node_name IN ('udkfinp03') " [ERROR] adop phase=fs_clone failed or is incomplete on Admin node: udkfinp03 [ERROR] Unable to continue processing on other available nodes: udkfinp04,udkfinp05,udkfinp06,udkfinp07,udkfinp08 [UNEXPECTED]Error running "adop phase=fs_clone" on node(s): udkfinp03. [EVENT] Stopping services on patch file system. /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_203014/fs_clone/validate/udkfinp03/txkADOPValidations.log: ------------------------------------------------------------------------------------------------------------------ Lines #(27-31): [SUCCESS]: None of the required ports for patch file system is reserved in /etc/services ValidatePatchFSPortPool: [ERROR]: Some of the ports specified for the patch file system are not available. ValidateETCHosts: [SUCCESS]: All required entries exist in /etc/hosts. /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_203014/fs_clone/validate/udkfinp03/ADOPValidations_detailed.log: ------------------------------------------------------------------------------------------------------------------------ Lines #(421-425): Port 6700 is free Checking Node Manager Port on udkfinp03: Port Value = 5558 RC-50204: Error: - Node Manager Port in use: Port Value = 5558 Checking WLS Admin Server Port on udkfinp03: Port Value = 7003 WLS Admin Server Port available: Port Value = 7003 Lines #(457-461): ----------------------------- ERROR: The following required ports are in use: ----------------------------- 5558 : Node Manager Port /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_203014/fs_clone/validate/remote_execution_result_level1.xml: -------------------------------------------------------------------------------------------------------------------- Status of remote command on Node udkfinp03 is failed. Error string was found in the above file. Please check the adoplog files created in udkfinp03 for more details. /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_203014/adop.log: ------------------------------------------------------------------------ Lines #(194-199): Running "txkADOPValidation" actions on node(s): udkfinp03 Remote execution results xml output file: /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_203014/fs_clone/validate/remote_execution_result_level1.xml [ERROR] Node: "udkfinp03" Status: "failed" [ERROR] txkADOPValidation failed on Node: "udkfinp03" [STATEMENT] SQL Statment : " update ad_adop_session_patches set status='F' ,end_date=to_date('','DD-MM-YYYY HH24:MI:SS') Lines #(205-211): and node_name IN ('udkfinp03') " [ERROR] txkADOPValidation failed or is incomplete on Admin node: udkfinp03 [ERROR] Unable to continue processing on other available nodes: udkfinp04,udkfinp05,udkfinp06,udkfinp07,udkfinp08 [UNEXPECTED]Error running "txkADOPValidation" on node(s): udkfinp03. [EVENT] Summary report for current adop session: /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_203937/fs_clone/validate/remote_execution_result_level1.xml: -------------------------------------------------------------------------------------------------------------------- /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_203937/fs_clone/validate/remote_execution_result_level2.xml: -------------------------------------------------------------------------------------------------------------------- /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_203937/fs_clone/udkfinp03/TXK_SYNC_create/fsclone_apply/FSCloneApplyAppsTier_02172051.log: -------------------------------------------------------------------------------------------------------------------------------------------------- Lines #(468-472): Script Executed in 11205 milliseconds, returning status 1 ERROR: Failed to execute /opt/application/V12/fs2/EBSapps/appl/ad/12.0.0/patch/115/bin/adPostDomainCloneCfg.pl START: Inside exitClone.... /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_203937/fs_clone/udkfinp03/TXK_SYNC_create/txkADOPPreparePhaseSynchronize.log: ------------------------------------------------------------------------------------------------------------------------------------- Lines #(313-315): TIME : Mon Feb 17 21:05:51 2020 FUNCTION: main::runFSCloneApply [ Level 1 ] ERRORMSG: /opt/application/V12/fs1/EBSapps/comn/adopclone_udkfinp03/bin/adclone.pl did not go through successfully. /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_203937/fs_clone/udkfinp03/adop.log: ------------------------------------------------------------------------------------------- Lines #(135-140): [PROCEDURE] Calling: /opt/application/V12/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl [EVENT] Log: /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_203937/fs_clone/udkfinp03 [UNEXPECTED]Error occurred running "perl /opt/application/V12/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl -contextfile=/opt/application/V12/fs1/inst/apps/DBOFINP1_udkfinp03/appl/admin/DBOFINP1_udkfinp03.xml -patchcontextfile=/opt/application/V12/fs2/inst/apps/DBOFINP1_udkfinp03/appl/admin/DBOFINP1_udkfinp03.xml -promptmsg=hide -console=off -mode=create -sync_mode=copy -sessionid=71 -timestamp=20200217_203937 -outdir=/opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_203937/fs_clone/udkfinp03" [UNEXPECTED]occurred during CLONE Patch File System from Run File System, running command: "perl /opt/application/V12/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl -contextfile=/opt/application/V12/fs1/inst/apps/DBOFINP1_udkfinp03/appl/admin/DBOFINP1_udkfinp03.xml -patchcontextfile=/opt/application/V12/fs2/inst/apps/DBOFINP1_udkfinp03/appl/admin/DBOFINP1_udkfinp03.xml -promptmsg=hide -console=off -mode=create -sync_mode=copy -sessionid=71 -timestamp=20200217_203937 -outdir=/opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_203937/fs_clone/udkfinp03". [EVENT] Releasing managed server ports. [PROCEDURE] [START 2020/02/17 21:05:51] Releasing ports Lines #(152-156): and appltop_id=3233 and node_name='udkfinp03'" [PROCEDURE] [END 2020/02/17 21:05:53] Updating status of patches [UNEXPECTED]fs_clone has failed. [PROCEDURE] [START 2020/02/17 21:05:54] Unlocking sessions table [STATEMENT] Unlocking ad_adop_sessions table for udkfinp03 with wait interval of 60 seconds and number of tries 6 /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_203937/fs_clone/remote_execution_result_level1.xml: ----------------------------------------------------------------------------------------------------------- Status of remote command on Node udkfinp03 is failed. Error string was found in the above file. Please check the adoplog files created in udkfinp03 for more details. Status of remote command on Node udkfinp03 is failed. Unexpected string was found in the above file. Please check the adoplog files created in udkfinp03 for more details. Status of remote command on Node udkfinp03 is failed. Error string was found in the above file. Please check the adoplog files created in udkfinp03 for more details. /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_203937/adop.log: ------------------------------------------------------------------------ Lines #(246-251): Running "adop phase=fs_clone" actions on node(s): udkfinp03 Remote execution results xml output file: /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_203937/fs_clone/remote_execution_result_level1.xml [ERROR] Node: "udkfinp03" Status: "failed" [ERROR] adop phase=fs_clone failed on Node: "udkfinp03" [STATEMENT] SQL Statment : " update ad_adop_session_patches set status='F' ,end_date=to_date('','DD-MM-YYYY HH24:MI:SS') Lines #(257-263): and node_name IN ('udkfinp03') " [ERROR] adop phase=fs_clone failed or is incomplete on Admin node: udkfinp03 [ERROR] Unable to continue processing on other available nodes: udkfinp04,udkfinp05,udkfinp06,udkfinp07,udkfinp08 [UNEXPECTED]Error running "adop phase=fs_clone" on node(s): udkfinp03. [EVENT] Stopping services on patch file system. /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_212005/fs_clone/validate/remote_execution_result_level1.xml: -------------------------------------------------------------------------------------------------------------------- /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_212005/fs_clone/validate/remote_execution_result_level2.xml: -------------------------------------------------------------------------------------------------------------------- /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_212005/fs_clone/udkfinp03/TXK_SYNC_create/txkADOPPreparePhaseSynchronize.log: ------------------------------------------------------------------------------------------------------------------------------------- Lines #(501-503): TIME : Tue Feb 18 00:42:53 2020 FUNCTION: main::runFSCloneApply [ Level 1 ] ERRORMSG: /opt/application/V12/fs1/EBSapps/comn/adopclone_udkfinp03/bin/adclone.pl did not go through successfully. /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_212005/fs_clone/udkfinp03/TXK_SYNC_create/fsclone_apply/ohsT2PApply/CLONE2020-02-18_00-41-51_1629847418.log: -------------------------------------------------------------------------------------------------------------------------------------------------------------------- Lines #(1109-1113): --------------------------------------------------- Error Message :1 [PLUGIN][OHS] - ERROR - Feb 18, 2020 00:42:51 - CLONE-26009 OHS T2P failed. [PLUGIN][OHS] - CAUSE - Feb 18, 2020 00:42:51 - CLONE-26009 Unable to start OS component. [PLUGIN][OHS] - ACTION - Feb 18, 2020 00:42:51 - CLONE-26009 Check clone log and error file and ohs log file /opt/application/V12/fs2/FMW_Home/webtier/instances/EBS_web_OHS1/diagnostics/logs/OHS/EBS_web/console~OHS~1.log for root cause. /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_212005/fs_clone/udkfinp03/TXK_SYNC_create/fsclone_apply/FSCloneApplyAppsTier_02172236.log: -------------------------------------------------------------------------------------------------------------------------------------------------- Lines #(5792-5796): Running /opt/application/V12/fs2/FMW_Home/webtier/perl/bin/perl -I/opt/application/V12/fs2/FMW_Home/webtier/perl/lib/5.10.0 -I/opt/application/V12/fs2/FMW_Home/webtier/perl/lib/site_perl/5.10.0 -I/opt/application/V12/fs2/EBSapps/appl/au/12.0.0/perl -I/opt/application/V12/fs2/FMW_Home/webtier/ohs/mod_perl/lib/site_perl/5.10.0/sun4-solaris-thread-multi-64 /opt/application/V12/fs2/EBSapps/appl/fnd/12.0.0/patch/115/bin/txkSetOHSConfig.pl cfgCloneInstance -ctxfile=/opt/application/V12/fs2/inst/apps/DBOFINP1_udkfinp03/appl/admin/DBOFINP1_udkfinp03.xml -archvloc=/opt/application/V12/fs1/EBSapps/comn/adopclone_udkfinp03/FMW/OHS/ohsarchive.jar -mvpln=/opt/application/V12/fs1/EBSapps/comn/adopclone_udkfinp03/FMW/OHS/moveplan.xml -t2plogloc=/opt/application/V12/fs1/inst/apps/DBOFINP1_udkfinp03/admin/log/clone/ohsT2PApply -logdir=/opt/application/V12/fs1/inst/apps/DBOFINP1_udkfinp03/admin/log/clone -console=off -promptmsg=hide Script Executed in 69555 milliseconds, returning status 255 ERROR: Script failed, exit code 255 START: Inside exitClone.... /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_212005/fs_clone/udkfinp03/adop.log: ------------------------------------------------------------------------------------------- Lines #(135-140): [PROCEDURE] Calling: /opt/application/V12/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl [EVENT] Log: /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_212005/fs_clone/udkfinp03 [UNEXPECTED]Error occurred running "perl /opt/application/V12/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl -contextfile=/opt/application/V12/fs1/inst/apps/DBOFINP1_udkfinp03/appl/admin/DBOFINP1_udkfinp03.xml -patchcontextfile=/opt/application/V12/fs2/inst/apps/DBOFINP1_udkfinp03/appl/admin/DBOFINP1_udkfinp03.xml -promptmsg=hide -console=off -mode=create -sync_mode=copy -sessionid=71 -timestamp=20200217_212005 -outdir=/opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_212005/fs_clone/udkfinp03" [UNEXPECTED]occurred during CLONE Patch File System from Run File System, running command: "perl /opt/application/V12/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl -contextfile=/opt/application/V12/fs1/inst/apps/DBOFINP1_udkfinp03/appl/admin/DBOFINP1_udkfinp03.xml -patchcontextfile=/opt/application/V12/fs2/inst/apps/DBOFINP1_udkfinp03/appl/admin/DBOFINP1_udkfinp03.xml -promptmsg=hide -console=off -mode=create -sync_mode=copy -sessionid=71 -timestamp=20200217_212005 -outdir=/opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_212005/fs_clone/udkfinp03". [EVENT] Releasing managed server ports. [PROCEDURE] [START 2020/02/18 00:42:53] Releasing ports Lines #(152-156): and appltop_id=3233 and node_name='udkfinp03'" [PROCEDURE] [END 2020/02/18 00:42:56] Updating status of patches [UNEXPECTED]fs_clone has failed. [PROCEDURE] [START 2020/02/18 00:42:57] Unlocking sessions table [STATEMENT] Unlocking ad_adop_sessions table for udkfinp03 with wait interval of 60 seconds and number of tries 6 /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_212005/fs_clone/remote_execution_result_level1.xml: ----------------------------------------------------------------------------------------------------------- Status of remote command on Node udkfinp03 is failed. Error string was found in the above file. Please check the adoplog files created in udkfinp03 for more details. Status of remote command on Node udkfinp03 is failed. Unexpected string was found in the above file. Please check the adoplog files created in udkfinp03 for more details. Status of remote command on Node udkfinp03 is failed. Error string was found in the above file. Please check the adoplog files created in udkfinp03 for more details. /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_212005/adop.log: ------------------------------------------------------------------------ Lines #(247-252): Running "adop phase=fs_clone" actions on node(s): udkfinp03 Remote execution results xml output file: /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200217_212005/fs_clone/remote_execution_result_level1.xml [ERROR] Node: "udkfinp03" Status: "failed" [ERROR] adop phase=fs_clone failed on Node: "udkfinp03" [STATEMENT] SQL Statment : " update ad_adop_session_patches set status='F' ,end_date=to_date('','DD-MM-YYYY HH24:MI:SS') Lines #(258-264): and node_name IN ('udkfinp03') " [ERROR] adop phase=fs_clone failed or is incomplete on Admin node: udkfinp03 [ERROR] Unable to continue processing on other available nodes: udkfinp04,udkfinp05,udkfinp06,udkfinp07,udkfinp08 [UNEXPECTED]Error running "adop phase=fs_clone" on node(s): udkfinp03. [EVENT] Stopping services on patch file system. /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200220_145243/fs_clone/validate/remote_execution_result_level1.xml: -------------------------------------------------------------------------------------------------------------------- /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200220_145243/fs_clone/validate/remote_execution_result_level2.xml: -------------------------------------------------------------------------------------------------------------------- /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200220_145243/fs_clone/udkfinp03/TXK_SYNC_create/fsclone_apply/FSCloneApplyAppsTier_02201607.log: -------------------------------------------------------------------------------------------------------------------------------------------------- Lines #(5792-5796): Running /opt/application/V12/fs2/FMW_Home/webtier/perl/bin/perl -I/opt/application/V12/fs2/FMW_Home/webtier/perl/lib/5.10.0 -I/opt/application/V12/fs2/FMW_Home/webtier/perl/lib/site_perl/5.10.0 -I/opt/application/V12/fs2/EBSapps/appl/au/12.0.0/perl -I/opt/application/V12/fs2/FMW_Home/webtier/ohs/mod_perl/lib/site_perl/5.10.0/sun4-solaris-thread-multi-64 /opt/application/V12/fs2/EBSapps/appl/fnd/12.0.0/patch/115/bin/txkSetOHSConfig.pl cfgCloneInstance -ctxfile=/opt/application/V12/fs2/inst/apps/DBOFINP1_udkfinp03/appl/admin/DBOFINP1_udkfinp03.xml -archvloc=/opt/application/V12/fs1/EBSapps/comn/adopclone_udkfinp03/FMW/OHS/ohsarchive.jar -mvpln=/opt/application/V12/fs1/EBSapps/comn/adopclone_udkfinp03/FMW/OHS/moveplan.xml -t2plogloc=/opt/application/V12/fs1/inst/apps/DBOFINP1_udkfinp03/admin/log/clone/ohsT2PApply -logdir=/opt/application/V12/fs1/inst/apps/DBOFINP1_udkfinp03/admin/log/clone -console=off -promptmsg=hide Script Executed in 58323 milliseconds, returning status 255 ERROR: Script failed, exit code 255 START: Inside exitClone.... /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200220_145243/fs_clone/udkfinp03/TXK_SYNC_create/fsclone_apply/ohsT2PApply/CLONE2020-02-20_17-51-47_697371906.log: ------------------------------------------------------------------------------------------------------------------------------------------------------------------- Lines #(1113-1117): --------------------------------------------------- Error Message :1 [PLUGIN][OHS] - ERROR - Feb 20, 2020 17:52:36 - CLONE-26009 OHS T2P failed. [PLUGIN][OHS] - CAUSE - Feb 20, 2020 17:52:36 - CLONE-26009 Unable to start OS component. [PLUGIN][OHS] - ACTION - Feb 20, 2020 17:52:36 - CLONE-26009 Check clone log and error file and ohs log file /opt/application/V12/fs2/FMW_Home/webtier/instances/EBS_web_OHS1/diagnostics/logs/OHS/EBS_web/console~OHS~1.log for root cause. /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200220_145243/fs_clone/udkfinp03/TXK_SYNC_create/txkADOPPreparePhaseSynchronize.log: ------------------------------------------------------------------------------------------------------------------------------------- Lines #(501-503): TIME : Thu Feb 20 17:52:38 2020 FUNCTION: main::runFSCloneApply [ Level 1 ] ERRORMSG: /opt/application/V12/fs1/EBSapps/comn/adopclone_udkfinp03/bin/adclone.pl did not go through successfully. /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200220_145243/fs_clone/udkfinp03/adop.log: ------------------------------------------------------------------------------------------- Lines #(135-140): [PROCEDURE] Calling: /opt/application/V12/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl [EVENT] Log: /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200220_145243/fs_clone/udkfinp03 [UNEXPECTED]Error occurred running "perl /opt/application/V12/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl -contextfile=/opt/application/V12/fs1/inst/apps/DBOFINP1_udkfinp03/appl/admin/DBOFINP1_udkfinp03.xml -patchcontextfile=/opt/application/V12/fs2/inst/apps/DBOFINP1_udkfinp03/appl/admin/DBOFINP1_udkfinp03.xml -promptmsg=hide -console=off -mode=create -sync_mode=copy -sessionid=71 -timestamp=20200220_145243 -outdir=/opt/application/V12/fs_ne/EBSapps/log/adop/71/20200220_145243/fs_clone/udkfinp03" [UNEXPECTED]occurred during CLONE Patch File System from Run File System, running command: "perl /opt/application/V12/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl -contextfile=/opt/application/V12/fs1/inst/apps/DBOFINP1_udkfinp03/appl/admin/DBOFINP1_udkfinp03.xml -patchcontextfile=/opt/application/V12/fs2/inst/apps/DBOFINP1_udkfinp03/appl/admin/DBOFINP1_udkfinp03.xml -promptmsg=hide -console=off -mode=create -sync_mode=copy -sessionid=71 -timestamp=20200220_145243 -outdir=/opt/application/V12/fs_ne/EBSapps/log/adop/71/20200220_145243/fs_clone/udkfinp03". [EVENT] Releasing managed server ports. [PROCEDURE] [START 2020/02/20 17:52:38] Releasing ports Lines #(152-156): and appltop_id=3233 and node_name='udkfinp03'" [PROCEDURE] [END 2020/02/20 17:52:41] Updating status of patches [UNEXPECTED]fs_clone has failed. [PROCEDURE] [START 2020/02/20 17:52:42] Unlocking sessions table [STATEMENT] Unlocking ad_adop_sessions table for udkfinp03 with wait interval of 60 seconds and number of tries 6 /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200220_145243/fs_clone/remote_execution_result_level1.xml: ----------------------------------------------------------------------------------------------------------- Status of remote command on Node udkfinp03 is failed. Error string was found in the above file. Please check the adoplog files created in udkfinp03 for more details. Status of remote command on Node udkfinp03 is failed. Unexpected string was found in the above file. Please check the adoplog files created in udkfinp03 for more details. Status of remote command on Node udkfinp03 is failed. Error string was found in the above file. Please check the adoplog files created in udkfinp03 for more details. /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200220_145243/adop.log: ------------------------------------------------------------------------ Lines #(247-252): Running "adop phase=fs_clone" actions on node(s): udkfinp03 Remote execution results xml output file: /opt/application/V12/fs_ne/EBSapps/log/adop/71/20200220_145243/fs_clone/remote_execution_result_level1.xml [ERROR] Node: "udkfinp03" Status: "failed" [ERROR] adop phase=fs_clone failed on Node: "udkfinp03" [STATEMENT] SQL Statment : " update ad_adop_session_patches set status='F' ,end_date=to_date('','DD-MM-YYYY HH24:MI:SS') Lines #(258-264): and node_name IN ('udkfinp03') " [ERROR] adop phase=fs_clone failed or is incomplete on Admin node: udkfinp03 [ERROR] Unable to continue processing on other available nodes: udkfinp04,udkfinp05,udkfinp06,udkfinp07,udkfinp08 [UNEXPECTED]Error running "adop phase=fs_clone" on node(s): udkfinp03. [EVENT] Stopping services on patch file system.