Wednesday 17 July 2013

Unable to flush restart file in aiurof()

While doing adpatch for HRMS RUP 6 patch (16000686) in R12.1.3 instance, I could see that the patch session was frozen.

I tried the usual checks on the database node to see if there was any space issue or if the archive log destination is full, but there were no problem from that side. 

I then looked at adctrl

Adctrl was bringing the below.

Enter your choice [1] :


        Control
Worker  Code      Context            Filename                    Status
------  --------  -----------------  --------------------------  --------------
     1  Run       AutoPatch R120                                 Wait
     2  Run       AutoPatch R120                                 Wait
     3  Run       AutoPatch R120                                 Wait
     4  Run       AutoPatch R120                                 Wait
     5  Run       AutoPatch R120                                 Wait
     6  Run       AutoPatch R120                                 Wait
     7  Run       AutoPatch R120                                 Wait
     8  Run       AutoPatch R120                                 Wait
     9  Run       AutoPatch R120                                 Wait
    10  Run       AutoPatch R120                                 Wait
    11  Run       AutoPatch R120                                 Wait
    12  Run       AutoPatch R120                                 Wait
    13  Run       AutoPatch R120                                 Wait
    14  Run       AutoPatch R120                                 Wait
    15  Run       AutoPatch R120                                 Wait
    16  Run       AutoPatch R120                                 Wait
    17  Run       AutoPatch R120                                 Wait
    18  Run       AutoPatch R120                                 Wait
    19  Run       AutoPatch R120                                 Wait
    20  Run       AutoPatch R120                                 Wait
    21  Run       AutoPatch R120                                 Wait
    22  Run       AutoPatch R120                                 Wait
    23  Run       AutoPatch R120                                 Wait
    24  Run       AutoPatch R120                                 Wait
    25  Run       AutoPatch R120                                 Wait
    26  Run       AutoPatch R120                                 Wait
    27  Run       AutoPatch R120                                 Wait
    28  Run       AutoPatch R120                                 Wait
    29  Run       AutoPatch R120                                 Wait
    30  Run       AutoPatch R120                                 Wait
    31  Run       AutoPatch R120                                 Wait
    32  Run       AutoPatch R120     gh52doup.pkb                Assigned



I looked at what is there in the worker 32.
cd $APPL_TOP/admin/$TWO_TASK/log

tail -100 adwork032.log | more

Below is the log.

Time when worker started job: Wed Jul 17 2013 17:16:01


Start time for file is: Wed Jul 17 2013 17:16:01

package /u01/PATC/oracle/apps/apps_st/appl/ben/12.0.0/patch/115/sql/bendsgel.pkb

Done deactivating PL/SQL compilation.

Statement executed.

Done resetting PL/SQL compilation.


Time when worker completed job: Wed Jul 17 2013 17:16:01


Time when worker started job: Wed Jul 17 2013 17:16:02

AD Worker error:
Unable to flush restart file in aiurof()

Error opening worker restart file in aijwro().

Time when worker failed: Wed Jul 17 2013 17:16:02

AD Worker is complete.

Errors and warnings are listed in the log file
/u01/PATC/oracle/apps/apps_st/appl/admin/EBSPATCH/log/adwork032.log

and in other log files in the same directory.



------------------- 

So, I went back to adctrl, and did the command to restart the worker 32. 


                    AD Controller Menu
     ---------------------------------------------------

     1.    Show worker status

     2.    Tell worker to restart a failed job

     3.    Tell worker to quit

     4.    Tell manager that a worker failed its job

     5.    Tell manager that a worker acknowledges quit

     6.    Restart a worker on the current machine

     7.    Exit







Enter your choice [1] : 6


You chose 6 - Restart a worker on the current machine.
Before you enter the worker number below, make sure that there is no
worker process already running with that worker number.

Enter the worker number(s)/range(s) or 'all' for all workers,
or press [Return] to go back to the menu : 32

Control code changed to 'Startup' for worker 32.
Review the messages above, then press [Return] to continue.

                    AD Controller Menu
     ---------------------------------------------------

     1.    Show worker status

     2.    Tell worker to restart a failed job

     3.    Tell worker to quit

     4.    Tell manager that a worker failed its job

     5.    Tell manager that a worker acknowledges quit

     6.    Restart a worker on the current machine

     7.    Exit







Enter your choice [1] :


        Control
Worker  Code      Context            Filename                    Status
------  --------  -----------------  --------------------------  --------------
     1  Run       AutoPatch R120                                 Wait
     2  Run       AutoPatch R120                                 Wait
     3  Run       AutoPatch R120                                 Wait
     4  Run       AutoPatch R120                                 Wait
     5  Run       AutoPatch R120                                 Wait
     6  Run       AutoPatch R120                                 Wait
     7  Run       AutoPatch R120                                 Wait
     8  Run       AutoPatch R120                                 Wait
     9  Run       AutoPatch R120                                 Wait
    10  Run       AutoPatch R120                                 Wait
    11  Run       AutoPatch R120                                 Wait
    12  Run       AutoPatch R120                                 Wait
    13  Run       AutoPatch R120                                 Wait
    14  Run       AutoPatch R120                                 Wait
    15  Run       AutoPatch R120                                 Wait
    16  Run       AutoPatch R120                                 Wait
    17  Run       AutoPatch R120                                 Wait
    18  Run       AutoPatch R120                                 Wait
    19  Run       AutoPatch R120                                 Wait
    20  Run       AutoPatch R120                                 Wait
    21  Run       AutoPatch R120                                 Wait
    22  Run       AutoPatch R120                                 Wait
    23  Run       AutoPatch R120                                 Wait
    24  Run       AutoPatch R120                                 Wait
    25  Run       AutoPatch R120                                 Wait
    26  Run       AutoPatch R120                                 Wait
    27  Run       AutoPatch R120                                 Wait
    28  Run       AutoPatch R120                                 Wait
    29  Run       AutoPatch R120                                 Wait
    30  Run       AutoPatch R120                                 Wait
    31  Run       AutoPatch R120                                 Wait
    32  Run       AutoPatch R120     gh52doup.pkb                Running

Review the messages above, then press [Return] to continue.



After that was done, the patch session started resuming normally. 

1 comment:

  1. Thanks for the solution. We have also faced the same issue while 12.1.3 NLS upgrade patch and we started the worker using adctrl option 6. but till now I am not able to find the root cause of this ssue and also frozen adworker processes became defunct. Do you have any idea on why these processes became defunct and root casue of the issue?

    Aprreciated your help in this regard.

    Thanks
    Kumar

    ReplyDelete