You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
create connection hangs inside pool entry creator. 17 active connection adders are in unknown state
driver issue, if it reuses connections inside and does not care of dead connections somehow.
Logs (with translation of localized messages)
FIRST STRIKE
2024-05-01 06:32:47.161 |T| WARN | scheduling-1 | hikari.pool.PoolBase | isConnectionDead | 179 | NmaHikariCP - Failed to validate connection ConnectionID:12233 ClientConnectionId: 4cfe22cd-8675-4d65-8c29-ed3948c97ac9 (Соединение закрыто. <--**Connection closed**). Possibly consider using a shorter maxLifetime value.
2024-05-01 06:32:47.171 |T| WARN | 65-8c29-ed3948c97ac9 | rver.jdbc.TDSCommand | log | 7505 | TDSCommand@11052571 (SQLServerStatement:208895 executeXXX): Command could not be timed out. Reason: Socket closed
2024-05-01 06:32:52.537 |T| WARN | scheduling-1 | hikari.pool.PoolBase | isConnectionDead | 179 | NmaHikariCP - Failed to validate connection ConnectionID:12235 ClientConnectionId: ba201e2b-2bdf-4fb8-b4b6-d48f708b678c (Соединение закрыто.). Possibly consider using a shorter maxLifetime value.
2024-05-01 06:32:57.539 |T| WARN | scheduling-1 | hikari.pool.PoolBase | isConnectionDead | 179 | NmaHikariCP - Failed to validate connection ConnectionID:12236 ClientConnectionId: dc432869-e1e8-4bad-8253-58b6e96f291d (Соединение закрыто.). Possibly consider using a shorter maxLifetime value.
2024-05-01 06:33:02.585 |T| WARN | scheduling-1 | hikari.pool.PoolBase | isConnectionDead | 179 | NmaHikariCP - Failed to validate connection ConnectionID:12237 ClientConnectionId: 6f011ed0-ad77-413c-ac88-00cd3c72b0c3 (Соединение закрыто.). Possibly consider using a shorter maxLifetime value.
2024-05-01 06:33:02.621 |T| WARN | 3c-ac88-00cd3c72b0c3 | rver.jdbc.TDSCommand | log | 7505 | TDSCommand@bf2e1c5 (SQLServerStatement:208898 executeXXX): Command could not be timed out. Reason: Socket closed
2024-05-01 06:33:07.763 |T| WARN | scheduling-1 | hikari.pool.PoolBase | isConnectionDead | 179 | NmaHikariCP - Failed to validate connection ConnectionID:12240 ClientConnectionId: 6ee307d4-aaba-4184-9784-456dd375d095 (Соединение закрыто.). Possibly consider using a shorter maxLifetime value.
2024-05-01 06:33:12.903 |T| WARN | scheduling-1 | hikari.pool.PoolBase | isConnectionDead | 179 | NmaHikariCP - Failed to validate connection ConnectionID:12241 ClientConnectionId: a271b289-d3cd-41bf-87c5-b0287e9dcaa0 (Соединение закрыто.). Possibly consider using a shorter maxLifetime value.
2024-05-01 06:33:12.982 |T| WARN | scheduling-1 HERE IS MY CODE ERROR LOG
com.microsoft.sqlserver.jdbc.SQLServerException: Соединение закрыто. <--**Connection closed**
at com.microsoft.sqlserver.jdbc.SQLServerException.makeFromDriverError(SQLServerException.java:231)
at com.microsoft.sqlserver.jdbc.SQLServerConnection.checkClosed(SQLServerConnection.java:1728)
at com.microsoft.sqlserver.jdbc.SQLServerConnection.setNetworkTimeout(SQLServerConnection.java:6959)
at com.zaxxer.hikari.pool.PoolBase.setNetworkTimeout(PoolBase.java:561)
at com.zaxxer.hikari.pool.PoolBase.isConnectionDead(PoolBase.java:168)
at com.zaxxer.hikari.pool.HikariPool.getConnection(HikariPool.java:170)
... 56 common frames omitted
Wrapped by: java.sql.SQLTransientConnectionException: NmaHikariCP - Connection is not available, request timed out after 30822ms.
at com.zaxxer.hikari.pool.HikariPool.createTimeoutException(HikariPool.java:696)
at com.zaxxer.hikari.pool.HikariPool.getConnection(HikariPool.java:181)
at com.zaxxer.hikari.pool.HikariPool.getConnection(HikariPool.java:146)
at com.zaxxer.hikari.HikariDataSource.getConnection(HikariDataSource.java:128)
at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160)
at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118)
at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81)
... 51 common frames omitted
Wrapped by: org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection
at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84)
at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:388)
at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:476)
at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:486)
*****
STACK MASKED
*****
OTHER LOG LINES
2024-05-01 06:33:19.655 |T| WARN | 17000-exec-37-[.bEq] | hikari.pool.PoolBase | isConnectionDead | 179 | NmaHikariCP - Failed to validate connection ConnectionID:12242 ClientConnectionId: 43d2c5d5-7b5b-4695-9f67-af9291abc2ca (Соединение закрыто. <--**Connection closed**). Possibly consider using a shorter maxLifetime value.
2024-05-01 06:33:21.030 |T| WARN | 17000-exec-17-[.CLB] | hikari.pool.PoolBase | isConnectionDead | 179 | NmaHikariCP - Failed to validate connection ConnectionID:12243 ClientConnectionId: dbe64df2-5967-4324-9478-e72c9c219b5d (Соединение закрыто.). Possibly consider using a shorter maxLifetime value.
2024-05-01 06:33:21.055 |T| WARN | 24-9478-e72c9c219b5d | rver.jdbc.TDSCommand | log | 7505 | TDSCommand@4417bfbc (SQLServerStatement:208902 executeXXX): Command could not be timed out. Reason: Socket closed
2024-05-01 06:33:24.706 |T| WARN | 17000-exec-37-[.bEq] | hikari.pool.PoolBase | isConnectionDead | 179 | NmaHikariCP - Failed to validate connection ConnectionID:12244 ClientConnectionId: c11601b2-8be8-43f3-b535-76e59b758b4a (Соединение закрыто.). Possibly consider using a shorter maxLifetime value.
2024-05-01 06:33:44.568 |T| WARN | 17000-exec-37-[.bEq] | i.SqlExceptionHelper | logExceptions | 145 | SQL Error: 0, SQLState: 08S01
2024-05-01 06:33:44.573 |T| ERROR | 17000-exec-37-[.bEq] | i.SqlExceptionHelper | logExceptions | 150 | NmaHikariCP - Connection is not available, request timed out after 30000ms.
2024-05-01 06:33:44.574 |T| ERROR | 17000-exec-37-[.bEq] | i.SqlExceptionHelper | logExceptions | 150 | Соединение закрыто. <--**Connection closed**
2024-05-01 06:33:44.591 |T| ERROR | 17000-exec-37-[.bEq] | e.app.utils.LogUtils | logResponse | 35 | ->-> Exception class: org.springframework.transaction.CannotCreateTransactionException ->-> Generated by request POST *******
{}
com.microsoft.sqlserver.jdbc.SQLServerException: Соединение закрыто. <--**Connection closed**
at com.microsoft.sqlserver.jdbc.SQLServerException.makeFromDriverError(SQLServerException.java:231)
at com.microsoft.sqlserver.jdbc.SQLServerConnection.checkClosed(SQLServerConnection.java:1728)
at com.microsoft.sqlserver.jdbc.SQLServerConnection.setNetworkTimeout(SQLServerConnection.java:6959)
at com.zaxxer.hikari.pool.PoolBase.setNetworkTimeout(PoolBase.java:561)
at com.zaxxer.hikari.pool.PoolBase.isConnectionDead(PoolBase.java:168)
at com.zaxxer.hikari.pool.HikariPool.getConnection(HikariPool.java:170)
... 106 common frames omitted
Wrapped by: java.sql.SQLTransientConnectionException: NmaHikariCP - Connection is not available, request timed out after 30000ms.
at com.zaxxer.hikari.pool.HikariPool.createTimeoutException(HikariPool.java:696)
at com.zaxxer.hikari.pool.HikariPool.getConnection(HikariPool.java:181)
at com.zaxxer.hikari.pool.HikariPool.getConnection(HikariPool.java:146)
at com.zaxxer.hikari.HikariDataSource.getConnection(HikariDataSource.java:128)
at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122)
at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38)
at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:113)
... 101 common frames omitted
Wrapped by: org.hibernate.exception.JDBCConnectionException: Unable to acquire JDBC Connection [NmaHikariCP - Connection is not available, request timed out after 30000ms.] [n/a]
at org.hibernate.exception.internal.SQLExceptionTypeDelegate.convert(SQLExceptionTypeDelegate.java:51)
at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:58)
at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:108)
at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:94)
at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:116)
at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:143)
at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164)
at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:420)
... 98 common frames omitted
Wrapped by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction
at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:466)
at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:531)
at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:405)
at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:610)
at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:379)
at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:184)
at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:184)
at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:164)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:184)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:184)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:249)
at jdk.proxy2/jdk.proxy2.$Proxy175.findById(Unknown Source)
*****
STACK MASKED
*****
OTHER LINES
2024-05-01 06:33:46.033 |T| WARN | 17000-exec-17-[.CLB] | tractHealthIndicator | logExceptionIfPresent | 94 | DataSource health check failed
com.microsoft.sqlserver.jdbc.SQLServerException: Соединение закрыто. <--**Connection closed**
at com.microsoft.sqlserver.jdbc.SQLServerException.makeFromDriverError(SQLServerException.java:231)
at com.microsoft.sqlserver.jdbc.SQLServerConnection.checkClosed(SQLServerConnection.java:1728)
at com.microsoft.sqlserver.jdbc.SQLServerConnection.setNetworkTimeout(SQLServerConnection.java:6959)
at com.zaxxer.hikari.pool.PoolBase.setNetworkTimeout(PoolBase.java:561)
at com.zaxxer.hikari.pool.PoolBase.isConnectionDead(PoolBase.java:168)
at com.zaxxer.hikari.pool.HikariPool.getConnection(HikariPool.java:170)
at com.zaxxer.hikari.pool.HikariPool.getConnection(HikariPool.java:146)
at com.zaxxer.hikari.HikariDataSource.getConnection(HikariDataSource.java:128)
at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122)
at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38)
at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:113)
at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:143)
at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164)
at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:420)
at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:531)
at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:405)
at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:610)
at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:379)
at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:184)
at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:184)
at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:164)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:184)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:184)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:249)
*****
STACK MASKED
*****
... 39 common frames omitted
Wrapped by: java.sql.SQLTransientConnectionException: NmaHikariCP - Connection is not available, request timed out after 30001ms.
at com.zaxxer.hikari.pool.HikariPool.createTimeoutException(HikariPool.java:696)
at com.zaxxer.hikari.pool.HikariPool.getConnection(HikariPool.java:181)
at com.zaxxer.hikari.pool.HikariPool.getConnection(HikariPool.java:146)
at com.zaxxer.hikari.HikariDataSource.getConnection(HikariDataSource.java:128)
at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160)
at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118)
at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81)
... 101 common frames omitted
Wrapped by: org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection
at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84)
at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:342)
at org.springframework.boot.actuate.jdbc.DataSourceHealthIndicator.getProduct(DataSourceHealthIndicator.java:122)
at org.springframework.boot.actuate.jdbc.DataSourceHealthIndicator.doDataSourceHealthCheck(DataSourceHealthIndicator.java:105)
at org.springframework.boot.actuate.jdbc.DataSourceHealthIndicator.doHealthCheck(DataSourceHealthIndicator.java:100)
at org.springframework.boot.actuate.health.AbstractHealthIndicator.health(AbstractHealthIndicator.java:82)
at org.springframework.boot.actuate.health.HealthIndicator.getHealth(HealthIndicator.java:37)
at org.springframework.boot.actuate.health.HealthEndpointWebExtension.getHealth(HealthEndpointWebExtension.java:94)
at org.springframework.boot.actuate.health.HealthEndpointWebExtension.getHealth(HealthEndpointWebExtension.java:47)
at org.springframework.boot.actuate.health.HealthEndpointSupport.getLoggedHealth(HealthEndpointSupport.java:172)
at org.springframework.boot.actuate.health.HealthEndpointSupport.getContribution(HealthEndpointSupport.java:145)
at org.springframework.boot.actuate.health.HealthEndpointSupport.getAggregateContribution(HealthEndpointSupport.java:156)
at org.springframework.boot.actuate.health.HealthEndpointSupport.getContribution(HealthEndpointSupport.java:141)
at org.springframework.boot.actuate.health.HealthEndpointSupport.getHealth(HealthEndpointSupport.java:110)
at org.springframework.boot.actuate.health.HealthEndpointSupport.getHealth(HealthEndpointSupport.java:81)
at org.springframework.boot.actuate.health.HealthEndpointWebExtension.health(HealthEndpointWebExtension.java:80)
at org.springframework.boot.actuate.health.HealthEndpointWebExtension.health(HealthEndpointWebExtension.java:69)
at jdk.internal.reflect.GeneratedMethodAccessor502.invoke(Unknown Source)
*****
STACK MASKED
*****
at java.base/java.lang.Thread.run(Thread.java:833)
2024-05-01 06:33:46.056 |T| WARN | 17000-exec-17-[.CLB] | ealthEndpointSupport | getLoggedHealth | 181 | Health contributor org.springframework.boot.actuate.jdbc.DataSourceHealthIndicator (db) took 30009ms to respond
*** A LOT OF OTHER LINES WITH EXCEPTIONS
*** DEBUG LEVEL FOR HIKARI SET
Once again, after VM was touched by administrators , connection pool become invalid. All connections are gone, new connections could not be created.
com.zaxxer:HikariCP:jar:5.0.1
com.microsoft.sqlserver:mssql-jdbc:jar:12.4.2.jre11
Here are the logs, my guesses is
Logs (with translation of localized messages)
FIRST STRIKE
OTHER LOG LINES
OTHER LINES
*** A LOT OF OTHER LINES WITH EXCEPTIONS
*** DEBUG LEVEL FOR HIKARI SET
***** SO ON
***** APP RESTART
The text was updated successfully, but these errors were encountered: