Tuesday, 17 December 2013

DB Adapter Insert error -javax.resource.spi.IllegalStateException in Oracle SOA Env

Hi Folks,

We have been facing a strange issue in SOA Env.

The issue is DB Adapter sometimes failing to insert the data into One table.

I wanted to stress the word "strange" here, bcz this issue is not continuously happening -only sometimes.

Error Message :

Error: Exception occured when binding was invoked. Exception occured during invocation of JCA binding: "JCA Binding execute of Reference operation 'insert' failed due to: JCA Binding Component connection issue. JCA Binding Component is unable to create an outbound JCA (CCI) connection. The JCA Binding Component was unable to establish an outbound JCA CCI connection due to the following issue: javax.resource.spi.IllegalStateException: [Connector:199176]Unable to execute allocateConnection(...) on ConnectionManager. A stale Connection Factory or Connection Handle may be used. The connection pool associated with it has already been destroyed. Try to re-lookup Connection Factory eis/DB/ETCfrom JNDI and get a new Connection Handle. Please make sure that the JCA connection factory and any dependent connection factories have been configured with a sufficient limit for max connections. Please also make sure that the physical connection to the backend EIS is available and the backend itself is accepting connections. ". The invoked JCA adapter raised a resource exception. Please examine the above error message carefully to determine a resolution.

We have been struggled lot and finally figured out the root cause.


There is a disconnection between WLS and JCA connection pool manager.
When we update JCA adapter deployment with new JNDI and redeploy the adapter instance then WLS invalidates all the existing connections and it seems WLS even doesn't know that JCA connection pool is the owner of these connections and it doesn't inform JCA pool manager that it has invalidated the connections.
Now JCA pool manager has no idea of what happened and it still maintains invalid connections in its pool.

Absolutely when client requests JCA connection then JCA manager try to return the dead connection which results above error.

Solution 1 : 

1.Log on to your Admin console and navigate to Domain -> Deployments -> <adapter name> -> Configuration Tab -> Outbound Connection Pools Tab -> Under Groups and Instances expand the javax.resource.cci.ConnectionFactory
2.Locate and select the adapter JNDI and click on the Connection Pool Tab.
3.Please check to see if Shrinking is enabled. If not, please enable it.
4.Please check the value for Shrink Frequency Seconds. The default for some connection pools is as high as 900 seconds. Please reset this to 600 seconds or less.
5.Activate your changes.

We set connection shrink time to 600 sec that means 10 min. 

What does "ShrinkFrequencySeconds" parameter mean? 
"The number of seconds to wait before shrinking a connection pool that has incrementally increased to meet demand. ShrinkingEnabled must be set to true for a connection pool to shrink."

So, after 10 min, connections were returned to database. But just after that, probably a bunch of http requests came into play with the web servers. Most of the case, it needs to establish connection to the database to serve the request. Since these requests were more than the initial connection pool value which is 10 (back to the initial connection numbers after shrinking), jdbc establishes a bunch of new connections again to serve those requests. This is how we had a flood of new connection request after about 10 min on avg.

If this does not improve the situation, please also try increasing the max size of your connection pool.

Solution 2 :

Apply Oracle Patch "11812911"

Desc of Patch:-(11812911)


Solution 1
a. Download the patch 11812911 if it is available.
b. Apply the patch in a test environment.
c. Check if the issue is solved.

Solution 2
This solution updates the weblogic-ra.xml from the adapter without redeploying it 
a. Modify the adapter from the weblogic administration console
b. Save the changes
c. Go to the Deployments page
d. Check the Adapter
e. Click on the Update button
f. Choose "Update this application in place with new deployment plan changes. (A deployment plan must be specified for this option)"
Do not use the default option: "Redeploy this application using the following deployment files"
g. Click finish

An adapter has the following structure:

   | - META-INF
   |       | - MANIFEST.MF
   |       | - weblogic-ra.xml
   |       | - ra.xml
   | - AdapterName.jar
   | - *.jar

Programming WebLogic Resource Adapters 
weblogic-ra.xml Schema 
- Table 9-13 default-connection-properties subelements 

- Table 9-14 pool-params subelements "

I hope this should work.

Happy Learning .....!!!!   Fun Sharing......!!!!!

Friday, 6 December 2013

Set and Get Preferences in Oracle SOA Suite 11G

Hello Folks.

Now we will learn how to set Preference Dynamically in SOA composite.
This will be usable to change the Filename or Email or whatever in any environment run-time. 

       Preference is like a variable, whose value can be changed from EM console requiring no code change. 
      Open "Composite.xml".
        Set the preference in the component tag as a property tag.

       Double click on BPEL process drop an assign activity.
      Double click on assign activity and set result in output as mentioned below.

           Complete the BPEL and Deploy it.

Changing Preferences from EM-Console

       In EM-Console right click on SOA-infra à
Administrator à system MBEAN Browser.

       Go to oracle.soa.configàServer : AdminServer à SCA Component à select your project à SCAComposite.SCAComponent.

    Double click on your BPEL process displayed à Go to the properties in attributes tab.

       In this, you can change the preferences whatever you want in run-time.
There is no code change, No server restart required.

If you restart the server the preference value reset to old one, To be on the same value even after your server restart, you can do one step below.

After clicking "Apply" click "Return".
       Go to the "Operations" tab and click on the "Save" operation. Click "Invoke" and "Return".

Now if you restart the server you will get the same old value.

In case if you are working in cluster environment you should change the preference value in both the Nodes and do the above step in both the nodes.

Happy Learning......!!!!!!!!!!!!      Fun Sharing..............!!!!!!!!!!!!!!

Truncated Error while starting the WebLogic server - Database error -ORA-01033: ORACLE initialization or shutdown in progress

Hi Folks .

Recently I had a problem while starting the webLogic server .Its repeating truncated error and I tried to connect the DB and it is showing the below error.

Environment is my Windows local box - Server SOA

From Log:- 
Errors in file C:\ORACLEXE\APP\ORACLE\diag\rdbms\xe\xe\trace\xe_ora_8020.trc  (incident=60191):
ORA-00600: internal error code, arguments: [kcrfr_resize2], [4093640192], [67100672], [], [], [], [], [], [], [], [], []
Incident details in: C:\ORACLEXE\APP\ORACLE\diag\rdbms\xe\xe\incident\incdir_60191\xe_ora_8020_i60191.trc
Use ADRCI or Support Workbench to package the incident.
See Note 411.1 at My Oracle Support for error and packaging details. 
ora-00600 internal error code

While connecting DB below exception:- 

ORA-01033: ORACLE initialization or shutdown in progress.

I had struggled and found the issue with the WL_LLR_ADMINSERVER table in SOAINFRA schema.
When you start the server without nohup you should shutdown the server before closing the server screen(CMD screen) ,If you directly close the CMD window without shutting down the server .it will create some dead threads in the mentioned table in SOAINFRA schema.

Description of  WL_LLR_ADMINSERVER is as follows the below screen.

So Run the script in DB or execute these lines in DB then problem will be solved.



JDBC LLR Domain//Server
JDBC LLR Domain//Server

JDBC LLR Version
JDBC LLR Version


2 rows deleted.

SQL> select * from WL_LLR_ADMINSERVER;
no rows selected

SQL> commit;
Commit complete.

Now start you server .It will be working fine this time.

Remember don't close the server start up screen without shutdown.

Happy Learning......!!!!!!!!!!!!!!!     Fun sharing......!!!!!!!!!!!!!!!!