11 Replies Latest reply on Oct 15, 2013 9:00 AM by Pravin Reddy

    Bladelogic unable to access database

      Hi Team,

       

      I frequently get the below exceptions in Bladelogic appserver :

       

       

       

      [08 Oct 2013 23:17:45,458] [Client-Connections-Thread-5] [WARN] [Anonymous:Anonymous:10.152.19.198] [Client] An error occurred while attempting to access the database:

      Message : The TCP/IP connection to the host QAN-TCS-WIN05, port 1433 has failed. Error: "No buffer space available (maximum connections reached?): connect. Verify the connection properties, check that an instance of SQL Server is running on the host and accepting TCP/IP connections at the port, and that no firewall is blocking TCP connections to the port.". SQLState: null ErrorCode: 0

       

       

      com.bladelogic.om.infra.app.db.DBException: An error occurred while attempting to access the database:

      Message : The TCP/IP connection to the host QAN-TCS-WIN05, port 1433 has failed. Error: "No buffer space available (maximum connections reached?): connect. Verify the connection properties, check that an instance of SQL Server is running on the host and accepting TCP/IP connections at the port, and that no firewall is blocking TCP connections to the port.". SQLState: null ErrorCode: 0

       

       

        at com.bladelogic.om.infra.app.util.ServerUtil.throwDBException(ServerUtil.java:171)

        at com.bladelogic.om.infra.model.rbac.RBACUserFactory.loadUsersList(RBACUserFactory.java:426)

        at com.bladelogic.om.infra.model.rbac.RBACUserFactory.findByName(RBACUserFactory.java:136)

        at com.bladelogic.om.infra.app.service.authentication.user.RBACUserServiceAdapter.findUser(RBACUserServiceAdapter.java:49)

        at com.bladelogic.om.infra.mfw.auth.UserAuth.<init>(UserAuth.java:37)

        at com.bladelogic.om.infra.mfw.auth.UserAuth.<init>(UserAuth.java:45)

        at com.bladelogic.om.infra.mfw.auth.DBPasswordManager.getUserInfo(DBPasswordManager.java:291)

        at com.bladelogic.sso.session.SessionSvcStateMachine.isUserRecordValid(SessionSvcStateMachine.java:379)

        at com.bladelogic.sso.session.SessionSvcStateMachine.processInputToken(SessionSvcStateMachine.java:232)

        at com.bladelogic.om.infra.mfw.net.BlSessionServerConnection.authenticate(BlSessionServerConnection.java:173)

        at com.bladelogic.om.infra.mfw.net.BlSessionServerConnection.doHandshake(BlSessionServerConnection.java:102)

        at com.bladelogic.om.infra.mfw.net.ClientWorkerThread.handleNewConnection(ClientWorkerThread.java:144)

        at com.bladelogic.om.infra.mfw.net.ClientWorkerThread.execute(ClientWorkerThread.java:97)

        at com.bladelogic.om.infra.mfw.net.ClientWorkerThread.execute(ClientWorkerThread.java:27)

        at com.bladelogic.om.infra.app.service.thread.BlBlockingThread.run(BlBlockingThread.java:95)

      Caused by: java.sql.SQLException: The TCP/IP connection to the host QAN-TCS-WIN05, port 1433 has failed. Error: "No buffer space available (maximum connections reached?): connect. Verify the connection properties, check that an instance of SQL Server is running on the host and accepting TCP/IP connections at the port, and that no firewall is blocking TCP connections to the port.".

        at com.bladelogic.om.infra.shared.db.BlDbConnectionFactory.createConnection(BlDbConnectionFactory.java:61)

        at com.bladelogic.om.infra.shared.db.BlDbConnectionFactory.createConnection(BlDbConnectionFactory.java:23)

        at com.bladelogic.om.infra.shared.db.pool.BlDbDbCpConnectionFactory.createConnection(BlDbDbCpConnectionFactory.java:22)

        at org.apache.commons.dbcp.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:582)

        at com.bladelogic.om.infra.app.service.db.BlDbPoolableConnectionFactory.makeObject(BlDbPoolableConnectionFactory.java:51)

        at org.apache.commons.pool.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:1148)

        at com.bladelogic.om.infra.shared.db.pool.BlConnObjectPool$BlDbObjectPool.borrowObject(BlConnObjectPool.java:55)

        at com.bladelogic.om.infra.shared.db.pool.BlConnObjectPool.borrowObject(BlConnObjectPool.java:94)

        at org.apache.commons.dbcp.PoolingDataSource.getConnection(PoolingDataSource.java:106)

        at com.bladelogic.om.infra.shared.db.pool.BlDbcpConnPool.getNewConnection(BlDbcpConnPool.java:180)

        at com.bladelogic.om.infra.shared.db.pool.BlPooledDbDataSource.getConnection(BlPooledDbDataSource.java:87)

        at com.bladelogic.om.infra.app.service.db.BlAsDbDataSource.getConnection(BlAsDbDataSource.java:79)

        at com.bladelogic.om.infra.app.service.db.DefaultDatabaseServiceImpl.getConnection(DefaultDatabaseServiceImpl.java:451)

        at com.bladelogic.om.infra.app.service.db.DefaultDatabaseServiceImpl.execute(DefaultDatabaseServiceImpl.java:638)

        at com.bladelogic.om.infra.app.service.db.DefaultDatabaseServiceImpl.execute(DefaultDatabaseServiceImpl.java:626)

        at com.bladelogic.om.infra.app.db.DBServiceImpl.execute(DBServiceImpl.java:99)

        at com.bladelogic.om.infra.app.db.DBServiceImpl.execute(DBServiceImpl.java:82)

        at com.bladelogic.om.infra.app.db.DBServiceImpl.execute(DBServiceImpl.java:76)

        at com.bladelogic.om.infra.model.rbac.RBACUserFactory.loadUsersList(RBACUserFactory.java:418)

        ... 13 more

      [08 Oct 2013 23:17:45,458] [Client-Connections-Thread-5] [WARN] [Anonymous:Anonymous:10.152.19.198] [Client] Error authorizing the connection

      [08 Oct 2013 23:17:45,458] [Client-Connections-Thread-5] [INFO] [Anonymous:Anonymous:10.152.19.198] [Client] Connection disconnecting: id = 898

      [08 Oct 2013 23:17:45,490] [Client-Connections-Thread-7] [WARN] [Anonymous:Anonymous:10.152.19.198] [Client] An error occurred while attempting to access the database:

      Message : The TCP/IP connection to the host QAN-TCS-WIN05, port 1433 has failed. Error: "No buffer space available (maximum connections reached?): connect. Verify the connection properties, check that an instance of SQL Server is running on the host and accepting TCP/IP connections at the port, and that no firewall is blocking TCP connections to the port.". SQLState: null ErrorCode: 0

       

       

      com.bladelogic.om.infra.app.db.DBException: An error occurred while attempting to access the database:

      Message : The TCP/IP connection to the host QAN-TCS-WIN05, port 1433 has failed. Error: "No buffer space available (maximum connections reached?): connect. Verify the connection properties, check that an instance of SQL Server is running on the host and accepting TCP/IP connections at the port, and that no firewall is blocking TCP connections to the port.". SQLState: null ErrorCode: 0

       

       

        at com.bladelogic.om.infra.app.util.ServerUtil.throwDBException(ServerUtil.java:171)

        at com.bladelogic.om.infra.model.rbac.RBACUserFactory.loadUsersList(RBACUserFactory.java:426)

        at com.bladelogic.om.infra.model.rbac.RBACUserFactory.findByName(RBACUserFactory.java:136)

        at com.bladelogic.om.infra.app.service.authentication.user.RBACUserServiceAdapter.findUser(RBACUserServiceAdapter.java:49)

        at com.bladelogic.om.infra.mfw.auth.UserAuth.<init>(UserAuth.java:37)

        at com.bladelogic.om.infra.mfw.auth.UserAuth.<init>(UserAuth.java:45)

        at com.bladelogic.om.infra.mfw.auth.DBPasswordManager.getUserInfo(DBPasswordManager.java:291)

        at com.bladelogic.sso.session.SessionSvcStateMachine.isUserRecordValid(SessionSvcStateMachine.java:379)

        at com.bladelogic.sso.session.SessionSvcStateMachine.processInputToken(SessionSvcStateMachine.java:232)

        at com.bladelogic.om.infra.mfw.net.BlSessionServerConnection.authenticate(BlSessionServerConnection.java:173)

        at com.bladelogic.om.infra.mfw.net.BlSessionServerConnection.doHandshake(BlSessionServerConnection.java:102)

        at com.bladelogic.om.infra.mfw.net.ClientWorkerThread.handleNewConnection(ClientWorkerThread.java:144)

        at com.bladelogic.om.infra.mfw.net.ClientWorkerThread.execute(ClientWorkerThread.java:97)

        at com.bladelogic.om.infra.mfw.net.ClientWorkerThread.execute(ClientWorkerThread.java:27)

        at com.bladelogic.om.infra.app.service.thread.BlBlockingThread.run(BlBlockingThread.java:95)

      Caused by: java.sql.SQLException: The TCP/IP connection to the host QAN-TCS-WIN05, port 1433 has failed. Error: "No buffer space available (maximum connections reached?): connect. Verify the connection properties, check that an instance of SQL Server is running on the host and accepting TCP/IP connections at the port, and that no firewall is blocking TCP connections to the port.".

        at com.bladelogic.om.infra.shared.db.BlDbConnectionFactory.createConnection(BlDbConnectionFactory.java:61)

        at com.bladelogic.om.infra.shared.db.BlDbConnectionFactory.createConnection(BlDbConnectionFactory.java:23)

        at com.bladelogic.om.infra.shared.db.pool.BlDbDbCpConnectionFactory.createConnection(BlDbDbCpConnectionFactory.java:22)

        at org.apache.commons.dbcp.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:582)

        at com.bladelogic.om.infra.app.service.db.BlDbPoolableConnectionFactory.makeObject(BlDbPoolableConnectionFactory.java:51)

        at org.apache.commons.pool.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:1148)

        at com.bladelogic.om.infra.shared.db.pool.BlConnObjectPool$BlDbObjectPool.borrowObject(BlConnObjectPool.java:55)

        at com.bladelogic.om.infra.shared.db.pool.BlConnObjectPool.borrowObject(BlConnObjectPool.java:94)

        at org.apache.commons.dbcp.PoolingDataSource.getConnection(PoolingDataSource.java:106)

        at com.bladelogic.om.infra.shared.db.pool.BlDbcpConnPool.getNewConnection(BlDbcpConnPool.java:180)

        at com.bladelogic.om.infra.shared.db.pool.BlPooledDbDataSource.getConnection(BlPooledDbDataSource.java:87)

        at com.bladelogic.om.infra.app.service.db.BlAsDbDataSource.getConnection(BlAsDbDataSource.java:79)

        at com.bladelogic.om.infra.app.service.db.DefaultDatabaseServiceImpl.getConnection(DefaultDatabaseServiceImpl.java:451)

        at com.bladelogic.om.infra.app.service.db.DefaultDatabaseServiceImpl.execute(DefaultDatabaseServiceImpl.java:638)

        at com.bladelogic.om.infra.app.service.db.DefaultDatabaseServiceImpl.execute(DefaultDatabaseServiceImpl.java:626)

        at com.bladelogic.om.infra.app.db.DBServiceImpl.execute(DBServiceImpl.java:99)

        at com.bladelogic.om.infra.app.db.DBServiceImpl.execute(DBServiceImpl.java:82)

        at com.bladelogic.om.infra.app.db.DBServiceImpl.execute(DBServiceImpl.java:76)

        at com.bladelogic.om.infra.model.rbac.RBACUserFactory.loadUsersList(RBACUserFactory.java:418)

        ... 13 more

       

      Below is the configs as part of DB :

       

      BSA configs :

      =============

       

       

      Client-Connection-Pool connection pool

      =======================================

       

       

      Number of connections = 3

      Available connections = 3

      Used connections = 0

      Maximum connections = 100

      Database name = Microsoft SQL Server

      Database version = 9.00.4035

      Connection info = jdbc:sqlserver://QAN-TCS-WIN05:1433;DatabaseName=BSAPROD;SelectMethod=cursor

      User = bsaprod

      Driver class = com.microsoft.sqlserver.jdbc.SQLServerDriver

      Driver version = 3.0.1301.101

       

       

      Job-Connection-Pool connection pool

      ====================================

       

       

      Number of connections = 0

      Available connections = 0

      Used connections = 0

      Maximum connections = 100

      Database name = Microsoft SQL Server

      Database version = 9.00.4035

      Connection info = jdbc:sqlserver://QAN-TCS-WIN05:1433;DatabaseName=BSAPROD;SelectMethod=cursor

      User = bsaprod

      Driver class = com.microsoft.sqlserver.jdbc.SQLServerDriver

      Driver version = 3.0.1301.101

       

       

      General-Connection-Pool connection pool

      ========================================

       

       

      Number of connections = 1

      Available connections = 1

      Used connections = 0

      Maximum connections = 100

      Database name = Microsoft SQL Server

      Database version = 9.00.4035

      Connection info = jdbc:sqlserver://QAN-TCS-WIN05:1433;DatabaseName=BSAPROD;SelectMethod=cursor

      User = bsaprod

      Driver class = com.microsoft.sqlserver.jdbc.SQLServerDriver

      Driver version = 3.0.1301.101

       

       

       

       

      SQL Server Configs :

      =======================

      maximum number of concurrent connections = 0 (unlimited)

       

       

      Let me know if I need to tune anything in my BSA or DB to have maximum connections available....

       

      Thanks,

      Tamil