8 Replies Latest reply on Feb 28, 2012 11:01 AM by Nick Rawlins

    Unable to start application server

    Nick Rawlins

      Hi,

       

      On RedHat. when starting the application server using "/init.d/blappserv start" it seems to fail starting.

       

      I can't see any errors, but in the appserver.log file it seems to start all the services and then stop them all straight after.

       

      I obviously get connection refused when trying to connect using the console.

       

       

      Does anyone have any idea's?

       

      Thanks

        • 1. Re: Unable to start application server
          Bill Robinson

          can you attach the appserver log?  also, if you go up through the shutdown messages you should eventually reach a java stack trace, that should indicate the issue.

          • 2. Unable to start application server
            Nick Rawlins

            Hi Bill,

             

            Yes here is the appserver.log, any help would be great. Thanks

             

            [18 Aug 2011 20:19:57,159] [main] [INFO] [::] [] Starting Agent Service...

            [18 Aug 2011 20:19:57,168] [main] [WARN] [::] [] Trouble processing secureFilePath

            [18 Aug 2011 20:19:57,359] [main] [INFO] [::] [] Starting Configuration Service...

            [18 Aug 2011 20:19:57,707] [main] [INFO] [::] [] Configuration Service started.

            [18 Aug 2011 20:19:57,809] [main] [INFO] [::] [] Loading JNI libaries...

            [18 Aug 2011 20:19:57,842] [main] [INFO] [::] [] Loaded JNI library BlAsJni

            [18 Aug 2011 20:19:57,845] [main] [INFO] [::] [] Loaded JNI library XJNIService

            [18 Aug 2011 20:19:57,846] [main] [INFO] [::] [] Loaded JNI library Atrium Core

            [18 Aug 2011 20:19:57,847] [main] [INFO] [::] [] Initializing JNI Configuration...

            [18 Aug 2011 20:19:57,848] [main] [INFO] [::] [] Initialized JNI library BlAsJni

            [18 Aug 2011 20:19:57,852] [main] [INFO] [::] [] Initialized JNI library XJNIService

            [18 Aug 2011 20:19:57,853] [main] [INFO] [::] [] Initialized JNI library Atrium Core

            [18 Aug 2011 20:19:57,853] [main] [INFO] [::] [] JNI Configuration complete.

            [18 Aug 2011 20:19:57,870] [main] [INFO] [::] [] Starting Model Graph Service...

            [18 Aug 2011 20:20:03,897] [main] [INFO] [::] [] Model Graph Service started.

            [18 Aug 2011 20:20:03,910] [main] [INFO] [::] [] Starting Non-Network Directory Service...

            [18 Aug 2011 20:20:03,911] [main] [INFO] [::] [] Non-Network Directory Service started.

            [18 Aug 2011 20:20:03,917] [main] [INFO] [::] [] Starting Non-Network Management Service...

            [18 Aug 2011 20:20:03,918] [main] [INFO] [::] [] Non-Network Management Service started.

            [18 Aug 2011 20:20:03,956] [main] [INFO] [::] [] Starting Port Provider...

            [18 Aug 2011 20:20:03,956] [main] [INFO] [::] [] Port Provider started.

            [18 Aug 2011 20:20:04,011] [main] [INFO] [::] [] Starting Sizing Service...

            [18 Aug 2011 20:20:04,012] [main] [INFO] [::] [] Sizing Service started.

            [18 Aug 2011 20:20:04,018] [main] [INFO] [::] [] Starting Caching Service...

            [18 Aug 2011 20:20:04,021] [main] [INFO] [::] [] Caching Service started.

            [18 Aug 2011 20:20:04,028] [main] [INFO] [::] [] Starting Session Service...

            [18 Aug 2011 20:20:04,053] [main] [INFO] [::] [] Session Service started.

            [18 Aug 2011 20:20:04,066] [main] [INFO] [::] [] Starting App Server Data Source...

            [18 Aug 2011 20:20:04,979] [main] [INFO] [::] [] Initialized connection pool General-Connection-Pool with url = jdbc:oracle:thin:@clm-db2:1521:BLADE and user = bladelogic

            [18 Aug 2011 20:20:05,141] [main] [INFO] [::] [] Initialized connection pool Job-Connection-Pool with url = jdbc:oracle:thin:@clm-db2:1521:BLADE and user = bladelogic

            [18 Aug 2011 20:20:05,304] [main] [INFO] [::] [] Initialized connection pool Client-Connection-Pool with url = jdbc:oracle:thin:@clm-db2:1521:BLADE and user = bladelogic

            [18 Aug 2011 20:20:05,304] [main] [INFO] [::] [] App Server Data Source started.

            [18 Aug 2011 20:20:05,509] [main] [INFO] [::] [] Starting Database Service...

            [18 Aug 2011 20:20:05,511] [main] [INFO] [::] [] Loaded /opt/bmc/bladelogic/8.1/operationsManager/NSH/br/deployments/_util/sql/blas-sqlmap.properties

            [18 Aug 2011 20:20:05,641] [main] [INFO] [::] [] Loaded /opt/bmc/bladelogic/8.1/operationsManager/NSH/br/deployments/_util/sql/sqlmap.properties

            [18 Aug 2011 20:20:05,739] [main] [INFO] [::] [] Loaded /opt/bmc/bladelogic/8.1/operationsManager/NSH/br/deployments/_util/sql/streamable_sqlmap.properties

            [18 Aug 2011 20:20:05,740] [main] [INFO] [::] [] Loaded /opt/bmc/bladelogic/8.1/operationsManager/NSH/br/deployments/_util/sql/reports-sqlmap.properties

            [18 Aug 2011 20:20:05,778] [main] [INFO] [::] [] Database service loaded 4 mapping files.

            [18 Aug 2011 20:20:05,778] [main] [INFO] [::] [] Database Service started.

            [18 Aug 2011 20:20:06,078] [main] [INFO] [::] [] Starting SRP Authentication Service...

            [18 Aug 2011 20:20:06,084] [main] [INFO] [::] [] Creating primary numbers file

            [18 Aug 2011 20:20:06,128] [main] [INFO] [::] [] SRP Authentication Service started.

            [18 Aug 2011 20:20:06,129] [main] [INFO] [::] [] Starting Notification Service...

            [18 Aug 2011 20:20:06,133] [main] [INFO] [::] [] Notification Service started.

            [18 Aug 2011 20:20:06,134] [main] [INFO] [::] [] Verifying object deleters...

            [18 Aug 2011 20:20:06,142] [main] [INFO] [::] [] Object deleters verified.

            [18 Aug 2011 20:20:06,142] [main] [INFO] [::] [] Verifying object soft deleters...

            [18 Aug 2011 20:20:06,172] [main] [INFO] [::] [] Object soft deleters verified.

            [18 Aug 2011 20:20:06,173] [main] [INFO] [::] [] Verifying object purgers...

            [18 Aug 2011 20:20:06,174] [main] [INFO] [::] [] Object purgers verified.

            [18 Aug 2011 20:20:06,179] [main] [INFO] [::] [] Starting RBAC User Service...

            [18 Aug 2011 20:20:06,180] [main] [INFO] [::] [] RBAC User Service started.

            [18 Aug 2011 20:20:06,180] [main] [INFO] [::] [] Starting RBAC Role Service...

            [18 Aug 2011 20:20:06,181] [main] [INFO] [::] [] RBAC Role Service started.

            [18 Aug 2011 20:20:06,191] [main] [INFO] [::] [] Starting Task Scheduling Service...

            [18 Aug 2011 20:20:06,203] [main] [INFO] [::] [] Task Scheduling Service started.

            [18 Aug 2011 20:20:06,217] [main] [INFO] [::] [] Starting RBAC Service...

            [18 Aug 2011 20:20:06,217] [main] [INFO] [::] [] Registering Security checkers...

            [18 Aug 2011 20:20:06,229] [main] [INFO] [::] [] Security checkers registered.

            [18 Aug 2011 20:20:06,230] [main] [INFO] [::] [] RBAC Service started.

            [18 Aug 2011 20:20:06,230] [main] [INFO] [::] [] Starting App Server Service...

            [18 Aug 2011 20:20:06,428] [main] [INFO] [::] [] App Server Service started.

            [18 Aug 2011 20:20:06,436] [main] [INFO] [::] [] Starting Event Service...

            [18 Aug 2011 20:20:06,481] [Event-Processor-Thread-0] [INFO] [::] [] Event processor thread started.

            [18 Aug 2011 20:20:06,484] [Event-Processor-Thread-3] [INFO] [::] [] Event processor thread started.

            [18 Aug 2011 20:20:06,494] [Event-Processor-Thread-4] [INFO] [::] [] Event processor thread started.

            [18 Aug 2011 20:20:06,488] [Event-Processor-Thread-1] [INFO] [::] [] Event processor thread started.

            [18 Aug 2011 20:20:06,484] [Event-Processor-Thread-2] [INFO] [::] [] Event processor thread started.

            [18 Aug 2011 20:20:06,515] [Event-Transfer-Thread-0] [INFO] [::] [] Event transfer thread started.

            [18 Aug 2011 20:20:06,517] [Event-Transfer-Thread-1] [INFO] [::] [] Event transfer thread started.

            [18 Aug 2011 20:20:06,523] [Event-Transfer-Thread-2] [INFO] [::] [] Event transfer thread started.

            [18 Aug 2011 20:20:06,525] [Event-Transfer-Thread-3] [INFO] [::] [] Event transfer thread started.

            [18 Aug 2011 20:20:06,529] [Event-Transfer-Thread-4] [INFO] [::] [] Event transfer thread started.

            [18 Aug 2011 20:20:06,532] [main] [INFO] [::] [] Event Service started.

            [18 Aug 2011 20:20:06,533] [main] [INFO] [::] [] Starting File Manager Service...

            [18 Aug 2011 20:20:06,534] [Event-Dispatcher-Thread] [INFO] [::] [] Event dispatcher thread started.

            [18 Aug 2011 20:20:06,756] [main] [INFO] [::] [] Validating file server host (clm-bbsa)...

            [18 Aug 2011 20:20:11,552] [main] [INFO] [::] [] Validating file server path (//clm-bbsa/opt/bmc/bladelogic/storage/)...

            [18 Aug 2011 20:20:11,556] [main] [INFO] [::] [] Cleaning up application server temp directory: /opt/bmc/rscd/NSH/tmp/_util

            [18 Aug 2011 20:20:11,557] [main] [INFO] [::] [] Cleaning up file server temp directory: //clm-bbsa/opt/bmc/bladelogic/storage/tmp/_util

            [18 Aug 2011 20:20:11,560] [main] [INFO] [::] [] Cleaning up temp zip files in: /opt/bmc/bladelogic/8.1/operationsManager/NSH/br

            [18 Aug 2011 20:20:11,580] [main] [INFO] [::] [] File Manager Service started.

            [18 Aug 2011 20:20:11,632] [main] [INFO] [::] [] Starting Cleanup Service...

            [18 Aug 2011 20:20:43,627] [main] [INFO] [::] [] Cleanup Service started.

            [18 Aug 2011 20:20:43,676] [main] [INFO] [::] [] Registering remote services...

            [18 Aug 2011 20:20:43,765] [main] [INFO] [::] [] Remote services registered.

            [18 Aug 2011 20:20:43,766] [main] [INFO] [::] [] Registering mbean services...

            [18 Aug 2011 20:20:43,767] [main] [INFO] [::] [] MBean services registered.

            [18 Aug 2011 20:20:43,767] [main] [INFO] [::] [] Performing post-deployment operations...

            [18 Aug 2011 20:20:43,768] [main] [INFO] [::] [] Post-deployment operations completed.

            [18 Aug 2011 20:20:43,768] [main] [INFO] [::] [] Performing post-startup deployment operations...

            [18 Aug 2011 20:20:43,769] [main] [INFO] [::] [] Post-startup deployment operations complete.

            [18 Aug 2011 20:20:47,964] [Thread-0] [INFO] [::] [] Undeploying

            [18 Aug 2011 20:20:48,012] [Thread-0] [INFO] [::] [] Stopping Event Service...

            [18 Aug 2011 20:20:48,013] [Thread-0] [INFO] [::] [] Shutting down thread pool Event-Processor-Thread-

            [18 Aug 2011 20:20:48,014] [Event-Processor-Thread-0] [INFO] [::] [] Event processor thread shutdown.

            [18 Aug 2011 20:20:48,015] [Event-Processor-Thread-4] [INFO] [::] [] Event processor thread shutdown.

            [18 Aug 2011 20:20:48,019] [Event-Processor-Thread-3] [INFO] [::] [] Event processor thread shutdown.

            [18 Aug 2011 20:20:48,019] [Event-Processor-Thread-2] [INFO] [::] [] Event processor thread shutdown.

            [18 Aug 2011 20:20:48,019] [Event-Processor-Thread-1] [INFO] [::] [] Event processor thread shutdown.

            [18 Aug 2011 20:20:48,020] [Thread-0] [INFO] [::] [] Finished shutting down thread pool Event-Processor-Thread-

            [18 Aug 2011 20:20:48,020] [Thread-0] [INFO] [::] [] Shutting down thread pool Event-Transfer-Thread-

            [18 Aug 2011 20:20:48,020] [Event-Transfer-Thread-0] [INFO] [::] [] Event transfer thread shutdown.

            [18 Aug 2011 20:20:48,029] [Event-Transfer-Thread-2] [INFO] [::] [] Event transfer thread shutdown.

            [18 Aug 2011 20:20:48,029] [Event-Transfer-Thread-1] [INFO] [::] [] Event transfer thread shutdown.

            [18 Aug 2011 20:20:48,035] [Event-Transfer-Thread-4] [INFO] [::] [] Event transfer thread shutdown.

            [18 Aug 2011 20:20:48,035] [Event-Transfer-Thread-3] [INFO] [::] [] Event transfer thread shutdown.

            [18 Aug 2011 20:20:48,039] [Thread-0] [INFO] [::] [] Finished shutting down thread pool Event-Transfer-Thread-

            [18 Aug 2011 20:20:48,039] [Event-Dispatcher-Thread] [INFO] [::] [] Event dispatching thread is shutting down.

            [18 Aug 2011 20:20:48,040] [Thread-0] [INFO] [::] [] Event Service stopped.

            [18 Aug 2011 20:20:48,044] [Thread-0] [INFO] [::] [] Stopping Cleanup Service...

            [18 Aug 2011 20:20:48,044] [Thread-0] [INFO] [::] [] Cleanup Service stopped.

            [18 Aug 2011 20:20:48,048] [Thread-0] [INFO] [::] [] File Manager Service stopping...

            [18 Aug 2011 20:20:48,049] [Thread-0] [INFO] [::] [] File Manager Service stopped.

            [18 Aug 2011 20:20:48,051] [Thread-0] [INFO] [::] [] Stopping App Server Service...

            [18 Aug 2011 20:20:48,051] [Thread-0] [INFO] [::] [] App Server Service stopped.

            [18 Aug 2011 20:20:48,053] [Thread-0] [INFO] [::] [] Stopping RBAC Service...

            [18 Aug 2011 20:20:48,053] [Thread-0] [INFO] [::] [] RBAC Service stopped.

            [18 Aug 2011 20:20:48,055] [Thread-0] [INFO] [::] [] Stopping task scheduling service...

            [18 Aug 2011 20:20:48,062] [Thread-0] [INFO] [::] [] Task scheduling service stopped.

            [18 Aug 2011 20:20:48,065] [Thread-0] [INFO] [::] [] Stopping RBAC Role Service...

            [18 Aug 2011 20:20:48,065] [Thread-0] [INFO] [::] [] RBAC Role Service stopped.

            [18 Aug 2011 20:20:48,066] [Thread-0] [INFO] [::] [] Stopping RBAC User Service...

            [18 Aug 2011 20:20:48,066] [Thread-0] [INFO] [::] [] RBAC User Service stopped.

            [18 Aug 2011 20:20:48,067] [Thread-0] [INFO] [::] [] Stopping SRP Authentication Service...

            [18 Aug 2011 20:20:48,067] [Thread-0] [INFO] [::] [] SRP Authentication Service stopped.

            [18 Aug 2011 20:20:48,068] [Thread-0] [INFO] [::] [] Notification Service stopped.

            [18 Aug 2011 20:20:48,110] [Thread-0] [INFO] [::] [] Stopping Session Service...

            [18 Aug 2011 20:20:48,110] [Thread-0] [INFO] [::] [] Session Service stopped.

            [18 Aug 2011 20:20:48,111] [Thread-0] [INFO] [::] [] Shutting down Caching Service...

            [18 Aug 2011 20:20:48,112] [Thread-0] [INFO] [::] [] Caching Service stopped.

            [18 Aug 2011 20:20:48,113] [Thread-0] [INFO] [::] [] Shutting down Sizing Service...

            [18 Aug 2011 20:20:48,114] [Thread-0] [INFO] [::] [] Caching Sizing stopped.

            [18 Aug 2011 20:20:48,115] [Thread-0] [INFO] [::] [] Stopping Port Provider...

            [18 Aug 2011 20:20:48,115] [Thread-0] [INFO] [::] [] Port Provider stopped.

            [18 Aug 2011 20:20:48,117] [Thread-0] [INFO] [::] [] Stopping Non-Network Management Service...

            [18 Aug 2011 20:20:48,117] [Thread-0] [INFO] [::] [] Non-Network Management Service Stopped.

            [18 Aug 2011 20:20:48,118] [Thread-0] [INFO] [::] [] Stopping Non-Network Directory Service...

            [18 Aug 2011 20:20:48,118] [Thread-0] [INFO] [::] [] Non-Network Directory Service Stopped.

            [18 Aug 2011 20:20:48,119] [Thread-0] [INFO] [::] [] Stopping Model Graph Service...

            [18 Aug 2011 20:20:48,120] [Thread-0] [INFO] [::] [] Model Graph Service stopped.

            [18 Aug 2011 20:20:48,122] [Thread-0] [INFO] [::] [] Stopping Configuration Service...

            [18 Aug 2011 20:20:48,122] [Thread-0] [INFO] [::] [] Configuration Service stopped.

            • 3. Unable to start application server
              Bill Robinson

              that is odd.  can you try a couple things -

               

              in the br directory create a console.log file, then edit the br/deployments/default/log4j.properties and change the

              log4j.rootLogger=INFO, R, C

              line to

              log4j.rootLogger=DEBUG, R, C

               

              then restart and post the log (maybe attach it since it will be quite large)

              • 4. Unable to start application server
                Nick Rawlins

                Hi Bill,

                 

                I have done as suggested but it didn't produce any different output in the log file to what it did before.

                 

                Do you have any other suggestions?

                 

                Thanks

                • 5. Unable to start application server
                  Nick Rawlins

                  I just had a thought bill, could this happen if the server was not licensed and ran out of time?

                   

                  Thanks

                  • 6. Re: Unable to start application server
                    Bill Robinson

                    Is this the only appserver in the env ?

                    • 7. Re: Unable to start application server
                      Bill Robinson

                      if the file server wasn’t licensed, the appserver would not start.

                      • 8. Unable to start application server
                        Nick Rawlins

                        I have now resolved this and was due to a database connectivity issue