Log: /app/apps/fs_ne/EBSapps/log/adop/91/adop_20180910_093915.log
[START 2018/09/10 09:39:16]Arguments passed to adop
    phase=fs_clone force=yes 
[END   2018/09/10 09:39:16]Arguments passed to adop
[STATEMENT] Performing verification of parameters
[STATEMENT] Sourcing the Run Edition environment: /app/apps/fs1/EBSapps/appl/APPSNODPROD_noidaapp.env

[EVENT]     Validating system setup...
    [STATEMENT] Checking for the required ENV setup 
    [STATEMENT]  Using 12 workers (Default: 12, Recommended maximum limit: 636)
    [PROCEDURE] [START 2018/09/10 09:39:31] Determining admin node
    [STATEMENT] Admin node : "noidaapp"
    [PROCEDURE] [END   2018/09/10 09:39:31] Determining admin node
    [EVENT]     Node registry is valid.
    [PROCEDURE] [START 2018/09/10 09:39:31] Performing database sanity checks
    [WARNING]   ETCC: The following database fixes are not applied in node noidadb
                  UPGRADE REQUIRED
                Refer to My Oracle Support Knowledge Document 1594274.1 for instructions.
    [PROCEDURE] [END   2018/09/10 09:39:31] Finished performing database sanity checks
[PROCEDURE] [START 2018/09/10 09:39:31] Acquiring lock on sessions table
[STATEMENT] Locking ad_adop_sessions table for noidaapp with wait interval of 60 seconds and number of tries 2

[PROCEDURE] [END   2018/09/10 09:39:31] Acquiring lock on sessions table

[EVENT]     Checking for pending adop sessions...
    [PROCEDURE] [START 2018/09/10 09:39:31] Checking for any pending sessions
    [EVENT]     Checking for pending hotpatch session...
        [PROCEDURE] [START 2018/09/10 09:39:32] Checking active hotpatch session
        [STATEMENT] Fetching number of incomplete cycles for noidaapp having appltop_id=1197.
        [STATEMENT] value of incomplete_session: "0"
        [PROCEDURE] [END   2018/09/10 09:39:32] Checking active hotpatch session
    [EVENT]     Checking for pending cleanup session...
        [PROCEDURE] [START 2018/09/10 09:39:32] Checking for active cleanup session
        [PROCEDURE] [END   2018/09/10 09:39:32] Checking for active cleanup session
    [PROCEDURE] [START 2018/09/10 09:39:32] Checking for active FS_CLONE session
    [PROCEDURE] [END   2018/09/10 09:39:32] Checking for active FS_CLONE session
    [STATEMENT] Master Session Id: NOT DEFINED
    [EVENT]     No pending session exists.
    [EVENT]     Staging new adop session...
        [PROCEDURE] [START 2018/09/10 09:39:32] Staging the current session
        [PROCEDURE] [START 2018/09/10 09:39:32] Checking if node "noidaapp" previously failed
        [PROCEDURE] [END   2018/09/10 09:39:32] Checking if node "noidaapp" previously failed
        [STATEMENT] Fetching the node list where fs_clone or config clone did not complete
        [STATEMENT] Incomplete nodes: "noidaapp"

        [STATEMENT] Fetching the node list where fs_clone or config clone completed successfully
        [STATEMENT] Completed nodes: ""

        [STATEMENT] An incomplete fs_clone Session is already present: "ADOP Session ID:91"
        [STATEMENT] adop will do fs_clone on all the nodes from the starting since FORCE option is set
        [STATEMENT] 'CLONE' entry found
        [STATEMENT] Updating the 'CLONE' status to NOT-STARTED for host: noidaapp and session id: 91 
        [PROCEDURE] [END   2018/09/10 09:39:32] Staging the current session
[PROCEDURE] [START 2018/09/10 09:39:32] Unlocking sessions table
[STATEMENT] Unlocking ad_adop_sessions table for noidaapp with wait interval of 60 seconds and number of tries 2

[PROCEDURE] [END   2018/09/10 09:39:32] Unlocking sessions table
[PROCEDURE] [START 2018/09/10 09:39:32] adzdoptl.pl run

===========================================================================
ADOP (C.Delta.6)
Session ID: 91
Node: noidaapp
Phase: fs_clone
===========================================================================
[STATEMENT] Inside createPatchCtxFile()...
[STATEMENT] PATCH context file exists

[EVENT]     Validating configuration on node: [noidaapp]...
    [STATEMENT] Calling task: "Executing txkADOPValidation script on noidaapp"; script: "/app/apps/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPValidations.pl"; args: " -contextfile=/app/apps/fs1/inst/apps/NODPROD_noidaapp/appl/admin/NODPROD_noidaapp.xml -patchctxfile=/app/apps/fs2/inst/apps/NODPROD_noidaapp/appl/admin/NODPROD_noidaapp.xml -phase=fs_clone -logloc=/app/apps/fs_ne/EBSapps/log/adop/91/fs_clone_20180910_093915/NODPROD_noidaapp -promptmsg=hide"
    [PROCEDURE] [START 2018/09/10 09:39:33] Executing txkADOPValidation script on noidaapp
    [PROCEDURE] Calling: /app/apps/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPValidations.pl
    [EVENT]     Log: /app/apps/fs_ne/EBSapps/log/adop/91/fs_clone_20180910_093915/NODPROD_noidaapp
    [PROCEDURE] [END   2018/09/10 09:41:26] Executing txkADOPValidation script on noidaapp
[PROCEDURE] [START 2018/09/10 09:41:26] Executing steps for FS_CLONE phase...
[PROCEDURE] [START 2018/09/10 09:41:26] Running FS Clone

[EVENT]     Checking if there are pending cleanup actions...
    [PROCEDURE] [START 2018/09/10 09:41:26] Performing check to see if pending cleanup actions exist
    [EVENT]     No pending cleanup actions exist.
    [PROCEDURE] [END   2018/09/10 09:41:26] Performing check to see if pending cleanup actions exist

[EVENT]     Blocking the managed servers ports...
    [PROCEDURE] [START 2018/09/10 09:41:27] Blocking the ports
    [STATEMENT] Calling task: "Blocking ports on noidaapp"; script: "/app/apps/fs1/inst/apps/NODPROD_noidaapp/admin/install/txkCloneAcquirePort.pl"; args: " -option=listen -server=noidaapp.flexfilm.com -ports=5567,7012,7612,7412,7212,7812,6111,6211 -log=/app/apps/fs_ne/EBSapps/log/adop/91/fs_clone_20180910_093915/NODPROD_noidaapp/txkCloneAcquirePort.log"
    [PROCEDURE] [START 2018/09/10 09:41:28] Blocking ports on noidaapp
    [PROCEDURE] Calling: /app/apps/fs1/inst/apps/NODPROD_noidaapp/admin/install/txkCloneAcquirePort.pl
    [EVENT]     Log: /app/apps/fs_ne/EBSapps/log/adop/91/fs_clone_20180910_093915/NODPROD_noidaapp/txkCloneAcquirePort.log
    [PROCEDURE] [END   2018/09/10 09:42:13] Blocking ports on noidaapp
    [PROCEDURE] [END   2018/09/10 09:42:13] Blocking the ports
[PROCEDURE] [START 2018/09/10 09:42:13] Updating the patches status
[PROCEDURE] [START 2018/09/10 09:42:14] Updating session process id
[PROCEDURE] [END   2018/09/10 09:42:14] Updating session process id
[STATEMENT] SQL statement : "  update ad_adop_session_patches
  set status='R'
  where applied_file_system_base = '/app/apps/fs1' and
  patch_file_system_base = '/app/apps/fs2' and bug_number='CLONE' and status <> 'Y'
  and appltop_id=1197 and node_name='noidaapp'"
[PROCEDURE] [END   2018/09/10 09:42:14] Updating the patches status

[EVENT]     Performing CLONE steps...
    [PROCEDURE] [START 2018/09/10 09:42:14] CLONE Patch File System from Run File System
    [PROCEDURE] Calling: /app/apps/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl
    [EVENT]     Log: /app/apps/fs_ne/EBSapps/log/adop/91/fs_clone_20180910_093915/NODPROD_noidaapp
    [UNEXPECTED]Error occurred while executing "perl /app/apps/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl -contextfile=/app/apps/fs1/inst/apps/NODPROD_noidaapp/appl/admin/NODPROD_noidaapp.xml -patchcontextfile=/app/apps/fs2/inst/apps/NODPROD_noidaapp/appl/admin/NODPROD_noidaapp.xml -promptmsg=hide -console=off -mode=create -sessionid=91 -timestamp=20180910_093915 -outdir=/app/apps/fs_ne/EBSapps/log/adop/91/fs_clone_20180910_093915/NODPROD_noidaapp"
    [UNEXPECTED]Error occurred while CLONE Patch File System from Run File System using command: "perl /app/apps/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl -contextfile=/app/apps/fs1/inst/apps/NODPROD_noidaapp/appl/admin/NODPROD_noidaapp.xml -patchcontextfile=/app/apps/fs2/inst/apps/NODPROD_noidaapp/appl/admin/NODPROD_noidaapp.xml -promptmsg=hide -console=off -mode=create -sessionid=91 -timestamp=20180910_093915 -outdir=/app/apps/fs_ne/EBSapps/log/adop/91/fs_clone_20180910_093915/NODPROD_noidaapp".
    [EVENT]     Releasing the managed servers ports...
        [PROCEDURE] [START 2018/09/10 17:11:57] Releasing the ports
        [STATEMENT] Calling task: "Releasing ports on noidaapp"; script: "/app/apps/fs1/inst/apps/NODPROD_noidaapp/admin/install/txkCloneAcquirePort.pl"; args: " -option=close -server=noidaapp.flexfilm.com -ports=5567,7012,7612,7412,7212,7812,6111,6211 -log=/app/apps/fs_ne/EBSapps/log/adop/91/fs_clone_20180910_093915/NODPROD_noidaapp/txkCloneAcquirePort.log"
        [PROCEDURE] [START 2018/09/10 17:11:58] Releasing ports on noidaapp
        [PROCEDURE] Calling: /app/apps/fs1/inst/apps/NODPROD_noidaapp/admin/install/txkCloneAcquirePort.pl
        [EVENT]     Log: /app/apps/fs_ne/EBSapps/log/adop/91/fs_clone_20180910_093915/NODPROD_noidaapp/txkCloneAcquirePort.log
        [PROCEDURE] [END   2018/09/10 17:11:58] Releasing ports on noidaapp
        [PROCEDURE] [END   2018/09/10 17:11:58] Releasing the ports
    [PROCEDURE] [START 2018/09/10 17:11:58] Updating the patches status
    [STATEMENT] SQL statement : "  update ad_adop_session_patches
  set status='F'
  where applied_file_system_base = '/app/apps/fs1' and
  patch_file_system_base = '/app/apps/fs2' and bug_number='CLONE' and status <> 'Y'
  and appltop_id=1197 and node_name='noidaapp'"
    [PROCEDURE] [END   2018/09/10 17:11:58] Updating the patches status
    [EVENT]     Stopping services on patch file system...
        [EVENT]     Stopping admin server...
            [PROCEDURE] [START 2018/09/10 17:11:58] Check and Stop patch Admin Server
            [PROCEDURE] [START 2018/09/10 17:11:59] Check and Stop patch FS Admin Server
            [PROCEDURE] [END   2018/09/10 17:12:10] Check and Stop patch FS Admin Server
            [PROCEDURE] [END   2018/09/10 17:12:10] Check and Stop patch Admin Server
        [EVENT]     Stopping node manager...
            [PROCEDURE] [START 2018/09/10 17:12:10] Check and Stop patch Node Manager
            [PROCEDURE] [START 2018/09/10 17:12:11] Check and Stop patch Node Manager
            [PROCEDURE] [END   2018/09/10 17:12:15] Check and Stop patch Node Manager
            [PROCEDURE] [END   2018/09/10 17:12:15] Check and Stop patch Node Manager
    [UNEXPECTED]fs_clone phase completed with errors/warnings. Please check logfiles
    [PROCEDURE] [START 2018/09/10 17:12:15] Unlocking sessions table
    [STATEMENT] Unlocking ad_adop_sessions table for noidaapp with wait interval of 60 seconds and number of tries 2

    [PROCEDURE] [END   2018/09/10 17:12:15] Unlocking sessions table
