Threads getting BLOCKED in Weblogic 12c

by user222776   Last Updated July 12, 2019 09:03 AM - source

We have upgraded to Weblogic12 from Weblogic10.3.6 and also upgrade Java 1.6 to Java1.8. Our application is using Oracle 12.1 as the backend DB Our application uses default WebLogic JPA implementation which has changed to TopLink in 12c implementation. After the application runs for few hours and when subjected to production load we get lot of STUCK threads in the server and eventually stops responding. We also find many threads are BLOCKED on oracle.jdbc.driver.T4CConnection

I am attaching a reference of thread dump during the issue period

"[ACTIVE] ExecuteThread: '89' for queue: 'weblogic.kernel.Default (self-tuning)'" Id=774 BLOCKED on [email protected] owned by "[ACTIVE] ExecuteThread: '51' for queue: 'weblogic.kernel.Default (self-tuning)'" Id=652

            at oracle.jdbc.xa.client.OracleXAResource.end(OracleXAResource.java:388)

            -  blocked on [email protected]

            at weblogic.jdbc.jta.DataSource.end(DataSource.java:965)

            at weblogic.transaction.internal.XAServerResourceInfo.end(XAServerResourceInfo.java:1451)

            at weblogic.transaction.internal.XAServerResourceInfo.internalDelist(XAServerResourceInfo.java:430)

            at weblogic.transaction.internal.XAServerResourceInfo.delist(XAServerResourceInfo.java:350)

            at weblogic.transaction.internal.ServerTransactionImpl.delistAll(ServerTransactionImpl.java:2032)

            at weblogic.transaction.internal.ServerTransactionImpl.localRollback(ServerTransactionImpl.java:2423)

            at weblogic.transaction.internal.ServerTransactionImpl.globalRetryRollback(ServerTransactionImpl.java:3857)

            at weblogic.transaction.internal.ServerTransactionImpl.access$100(ServerTransactionImpl.java:60)

            at weblogic.transaction.internal.ServerTransactionImpl$1.run(ServerTransactionImpl.java:4127)

            at weblogic.transaction.internal.PlatformHelperImpl$4.run(PlatformHelperImpl.java:1436)

            at weblogic.invocation.ComponentInvocationContextManager._runAs(ComponentInvocationContextManager.java:352)

            at weblogic.invocation.ComponentInvocationContextManager.runAs(ComponentInvocationContextManager.java:337)

            at weblogic.work.LivePartitionUtility.doRunWorkUnderContext(LivePartitionUtility.java:57)

            at weblogic.work.PartitionUtility.runWorkUnderContext(PartitionUtility.java:41)

            at weblogic.work.SelfTuningWorkManagerImpl.runWorkUnderContext(SelfTuningWorkManagerImpl.java:652)

            at weblogic.work.ExecuteThread.execute(ExecuteThread.java:420)

            at weblogic.work.ExecuteThread.run(ExecuteThread.java:360)

        "[ACTIVE] ExecuteThread: '90' for queue: 'weblogic.kernel.Default (self-tuning)'" Id=775 BLOCKED on [email protected] owned by "[ACTIVE] ExecuteThread: '251' for queue: 'weblogic.kernel.Default (self-tuning)'" Id=936

            at oracle.jdbc.xa.client.OracleXAResource.end(OracleXAResource.java:388)

            -  blocked on [email protected]

            at weblogic.jdbc.jta.DataSource.end(DataSource.java:965)

            at weblogic.transaction.internal.XAServerResourceInfo.end(XAServerResourceInfo.java:1451)

            at weblogic.transaction.internal.XAServerResourceInfo.internalDelist(XAServerResourceInfo.java:430)

            at weblogic.transaction.internal.XAServerResourceInfo.delist(XAServerResourceInfo.java:350)

            at weblogic.transaction.internal.ServerTransactionImpl.delistAll(ServerTransactionImpl.java:2032)

            at weblogic.transaction.internal.ServerTransactionImpl.localRollback(ServerTransactionImpl.java:2423)

            at weblogic.transaction.internal.ServerTransactionImpl.globalRetryRollback(ServerTransactionImpl.java:3857)

            at weblogic.transaction.internal.ServerTransactionImpl.access$100(ServerTransactionImpl.java:60)

            at weblogic.transaction.internal.ServerTransactionImpl$1.run(ServerTransactionImpl.java:4127)

            at weblogic.transaction.internal.PlatformHelperImpl$4.run(PlatformHelperImpl.java:1436)

            at weblogic.invocation.ComponentInvocationContextManager._runAs(ComponentInvocationContextManager.java:352)

            at weblogic.invocation.ComponentInvocationContextManager.runAs(ComponentInvocationContextManager.java:337)

            at weblogic.work.LivePartitionUtility.doRunWorkUnderContext(LivePartitionUtility.java:57)

            at weblogic.work.PartitionUtility.runWorkUnderContext(PartitionUtility.java:41)

            at weblogic.work.SelfTuningWorkManagerImpl.runWorkUnderContext(SelfTuningWorkManagerImpl.java:652)

            at weblogic.work.ExecuteThread.execute(ExecuteThread.java:420)

            at weblogic.work.ExecuteThread.run(ExecuteThread.java:360)

        "[ACTIVE] ExecuteThread: '91' for queue: 'weblogic.kernel.Default (self-tuning)'" Id=776 BLOCKED on [email protected] owned by "[ACTIVE] ExecuteThread: '398' for queue: 'weblogic.kernel.Default (self-tuning)'" Id=1084

            at oracle.jdbc.xa.client.OracleXAResource.end(OracleXAResource.java:388)

            -  blocked on [email protected]

            at weblogic.jdbc.jta.DataSource.end(DataSource.java:965)

            at weblogic.transaction.internal.XAServerResourceInfo.end(XAServerResourceInfo.java:1451)

            at weblogic.transaction.internal.XAServerResourceInfo.internalDelist(XAServerResourceInfo.java:430)

            at weblogic.transaction.internal.XAServerResourceInfo.delist(XAServerResourceInfo.java:350)

            at weblogic.transaction.internal.ServerTransactionImpl.delistAll(ServerTransactionImpl.java:2032)

            at weblogic.transaction.internal.ServerTransactionImpl.localRollback(ServerTransactionImpl.java:2423)

            at weblogic.transaction.internal.ServerTransactionImpl.globalRetryRollback(ServerTransactionImpl.java:3857)

            at weblogic.transaction.internal.ServerTransactionImpl.access$100(ServerTransactionImpl.java:60)

            at weblogic.transaction.internal.ServerTransactionImpl$1.run(ServerTransactionImpl.java:4127)

            at weblogic.transaction.internal.PlatformHelperImpl$4.run(PlatformHelperImpl.java:1436)

            at weblogic.invocation.ComponentInvocationContextManager._runAs(ComponentInvocationContextManager.java:352)

            at weblogic.invocation.ComponentInvocationContextManager.runAs(ComponentInvocationContextManager.java:337)

            at weblogic.work.LivePartitionUtility.doRunWorkUnderContext(LivePartitionUtility.java:57)

            at weblogic.work.PartitionUtility.runWorkUnderContext(PartitionUtility.java:41)

            at weblogic.work.SelfTuningWorkManagerImpl.runWorkUnderContext(SelfTuningWorkManagerImpl.java:652)

            at weblogic.work.ExecuteThread.execute(ExecuteThread.java:420)

            at weblogic.work.ExecuteThread.run(ExecuteThread.java:360)

        "[ACTIVE] ExecuteThread: '92' for queue: 'weblogic.kernel.Default (self-tuning)'" Id=777 BLOCKED on [email protected] owned by "[ACTIVE] ExecuteThread: '24' for queue: 'weblogic.kernel.Default (self-tuning)'" Id=308

            at oracle.jdbc.xa.client.OracleXAResource.end(OracleXAResource.java:388)

            -  blocked on [email protected]

            at weblogic.jdbc.jta.DataSource.end(DataSource.java:965)

            at weblogic.transaction.internal.XAServerResourceInfo.end(XAServerResourceInfo.java:1451)

++++++++++++++++++++++++++++++++++++++++++++

If any one has faced similar issue, please advice

Tags : website


Related Questions



Determining if Heroku app is loading quickly

Updated April 16, 2015 21:01 PM



Hilex Framework not Showing properly

Updated June 13, 2017 14:03 PM