I have to say it first. I absolutely hate Java Based apps...they are nothing but a pos.

With that out of the way, here is my issue.

Windows 2008 x64 with Remote install of BBMS running 5.01
Installation completed successfully, database created, and services started.
Unfortunately all I get is a page not found on the Monitoring console.
Spend hours going through logs and I find this link.
BlackBerry Monitoring Console Service Wont Start With “service-specific error code 0″ Deobfuscate

The Tomcat logs do indicate that the Jvm.dll is not found. I edit the registry with the full path of the jvm and in the tomcat logs I see the successful startup...

Unfortunately I am still getting a page not found and other then the BBMS-app logs stating error connecting to (UI), I have no idea what else to check...

I do see port 8443 listening but its not loading...anyone else have any idea's?

First off ... Welcome!

Are you running 2008 SP2? (a requirement of BMS)

Is the version of Java installed the one that came with BMS or has java auto-update done any updates?

Can you post the BBMS log file? or send it to me directly at hdawg@port3101.org?

I'll be honest, I've barely used BMS ... so this may be for naught.

__________________
http://blog.port3101.org/hdawg/

The views expressed by me on Port3101 and its affiliated sites are my own and do not necessarily reflect the views of my employer.

Thanks..I've been a lurker for a while now.

Windows 2008 x64 is SP2
Java has not completed any updates. It is the version installed with BMS.
here are the relavent part of the logs. Ps - I've changed servernames and domain names to be generic.

BBMS

(02/07 12:54:31:859):{Thread-0} [org.apache.catalina.core.AprLifecycleListener] [INFO] The Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: C:\Program Files (x86)\Research In Motion\BlackBerry Enterprise Server\Monitoring Service\dll
(02/07 12:54:31:937):{Thread-0} [org.apache.coyote.http11.Http11Protocol] [INFO] Initializing Coyote HTTP/1.1 on http-58180
(02/07 12:54:33:062):{Thread-0} [org.apache.coyote.http11.Http11Protocol] [INFO] Initializing Coyote HTTP/1.1 on http-8443
(02/07 12:54:33:062):{Thread-0} [org.apache.catalina.startup.Catalina] [INFO] Initialization processed in 2179 ms
(02/07 12:54:33:156):{Thread-0} [org.apache.catalina.core.StandardService] [INFO] Starting service Catalina
(02/07 12:54:33:156):{Thread-0} [org.apache.catalina.core.StandardEngine] [INFO] Starting Servlet Engine: Apache Tomcat/6.0.13
(02/07 12:54:35:359):{Thread-0} [com.rim.bes.bms.system.BMSManager] [WARN] [BBMS-2002] {unknown} Using default BIPP password
(02/07 12:54:38:041):{Thread-0} [com.rim.bes.bms.net.BASCredentialsManager] [INFO] [BBMS-1011] {unknown} CredentialsHandshake successful
(02/07 12:54:38:634):{Thread-0} [com.rim.bes.bms.system.BMSManager] [INFO] [BBMS-1014] {unknown} Using remote source for peer configuration
(02/07 12:54:38:634):{Thread-0} [com.rim.bes.bms.system.BMSManager] [INFO] [BBMS-1015] {unknown} Loaded peer configurations: {DCS=BMSSERVER.DOMAIN.LOCAL/10.0.1.104:55502, App=BMSSERVER.DOMAIN.LOCAL/10.0.1.104:55500, UI=BMSSERVER.DOMAIN.LOCAL/10.0.1.104:55503, Engine=BMSSERVER.DOMAIN.LOCAL/10.0.1.104:55501}
(02/07 12:54:38:681):{Peer(UI)} [com.rim.bes.bms.peer.EndPoint] [INFO] [BBMS-1004] {unknown} EndPoint (UI) started and bound to BMSSERVER.DOMAIN.LOCAL/10.0.1.104:55503
(02/07 12:54:39:447):{Thread-0} [org.apache.tapestry.ApplicationServlet] [INFO] Initialized application servlet 'bmsConsole': 4,822 millis to create HiveMind Registry, 5,494 millis overall.
(02/07 12:54:39:509):{Thread-0} [org.apache.coyote.http11.Http11Protocol] [INFO] Starting Coyote HTTP/1.1 on http-58180
(02/07 12:54:39:509):{Thread-0} [org.apache.coyote.http11.Http11Protocol] [INFO] Starting Coyote HTTP/1.1 on http-8443
(02/07 12:54:39:509):{Thread-0} [org.apache.catalina.startup.Catalina] [INFO] Server startup in 6680 ms
(02/07 12:54:40:228):{Timer-0} [com.rim.bes.bms.system.BMSManager] [INFO] [BBMS-1000] {unknown} Found monitorable services at BESSRV01, id=2
(02/07 12:54:40:228):{Timer-0} [com.rim.bes.bms.system.BMSManager] [INFO] [BBMS-1000] {unknown} Found monitorable services at BESSRV02, id=3
(02/07 12:54:40:650):{Timer-0} [com.rim.bes.bms.system.BMSManager] [INFO] [BBMS-1000] {unknown} Transmitting domain topology configuration: [2, 3, 10000]
(02/07 12:54:41:181):{http-58180-2} [com.rim.bes.bms.system.BMSManager] [WARN] [BBMS-2002] {unknown} Using default BIPP password
(02/07 13:03:40:067):{Timer-0} [com.rim.bes.bms.system.BMSManager] [INFO] [BBMS-1000] {unknown} Found monitorable services at BESSRV01, id=2
(02/07 13:03:40:067):{Timer-0} [com.rim.bes.bms.system.BMSManager] [INFO] [BBMS-1000] {unknown} Found monitorable services at BESSRV02, id=3


Here is the APP log
02/07 12:54:18:30):{Dummy-1} [db_connection_manager:__init__:97] [INFO] Database connection pool for [BMSDB] initialized. Min connections: 4. Max connections: 10. Available connections: 4
(02/07 12:54:18:125):{Dummy-1} [util:attemptToConnect:69] [INFO] Successfully connected to the database
(02/07 12:54:18:187):{Dummy-1} [db_connection_manager:__init__:97] [INFO] Database connection pool for [BMSDB] initialized. Min connections: 4. Max connections: 10. Available connections: 4
(02/07 12:54:18:296):{Dummy-1} [control:__init__:33] [INFO] Monitoring control component startup complete.
(02/07 12:54:18:296):{Dummy-1} [client_console:__init__:295] [INFO] Client console component startup complete.
(02/07 12:54:18:296):{Dummy-1} [state_cache:__init__:60] [INFO] StateCache startup complete.
(02/07 12:54:18:296):{Dummy-1} [service_definitions:__init__:20] [INFO] Service definitions component startup complete.
(02/07 12:54:18:296):{Dummy-1} [thresholds:__init__:35] [INFO] Threshold application component startup complete.
(02/07 12:54:18:296):{Dummy-1} [threshold_processor:__init__:415] [INFO] Threshold Processor startup complete.
(02/07 12:54:18:296):{Dummy-1} [alarm_panel:__init__:27] [INFO] Alarm Panel startup complete.
(02/07 12:54:18:296):{Dummy-1} [messaging:__init__:23] [INFO] Messaging startup complete.
(02/07 12:54:18:296):{Dummy-1} [config_panel:__init__:39] [INFO] Config Panel startup complete.
(02/07 12:54:18:296):{Dummy-1} [notifications:__init__:36] [INFO] Notifications startup complete.
(02/07 12:54:18:312):{Dummy-1} [reports:__init__:131] [INFO] Reports Component startup complete.
(02/07 12:54:18:312):{Dummy-1} [notifier:loadEmailHandler:60] [INFO] Loading Email handler
(02/07 12:54:18:312):{Dummy-1} [notifier:loadEmailHandler:66] [WARNING] No email handler config found. Load failed.
(02/07 12:54:18:312):{Dummy-1} [notifier:loadHandlers:73] [INFO] Load SNMP Trap handler
(02/07 12:54:18:421):{Dummy-1} [notifier:loadHandlers:77] [INFO] Load UI handler
(02/07 12:54:18:421):{Dummy-1} [notifier:loadHandlers:81] [INFO] Load SMS handler
(02/07 12:54:18:421):{Dummy-1} [notifier:loadHandlers:85] [INFO] Load PIN handler
(02/07 12:54:18:421):{Dummy-1} [charting:__init__:112] [INFO] Charting startup complete.
(02/07 12:54:18:437):{Dummy-1} [datarequestcomponent:__init__:41] [INFO] Data Request Component startup complete.
(02/07 12:54:18:437):{Dummy-1} [dd:__init__:97] [INFO] Device Diagnostics Component Started
(02/07 12:54:18:437):{Dummy-1} [aggregation:__init__:36] [INFO] Data aggregation component startup complete.
(02/07 12:54:18:483):{Peer(App)} [peer:run:1013] [INFO] EndPoint (App) started and bound to ('10.0.1.104', 55500)
(02/07 12:54:19:483):{Dummy-1} [peer:connection_failed:830] [WARNING] Connection failed for (Engine) at (u'BMSSERVERNAME.DOMAIN.LOCAL', 55501)
(02/07 12:54:20:546):{Dummy-1} [peer:connection_failed:830] [WARNING] Connection failed for (Engine) at (u'BMSSERVERNAME.DOMAIN.LOCAL', 55501)
(02/07 12:54:22:108):{Notifier:2} [smsutil:init:118] [ERROR] Init Failure (0): Operation timed out waiting for (OK)
(02/07 12:54:24:171):{Dummy-1} [peer:connection_failed:830] [WARNING] Connection failed for (UI) at (u'BMSSERVERNAME.DOMAIN.LOCAL', 55503)
(02/07 12:54:25:92):{PeerRecvQueue:2} [peer:connection_failed:830] [WARNING] Connection failed for (UI) at (u'BMSSERVERNAME.DOMAIN.LOCAL', 55503)
(02/07 12:54:25:515):{Notifier:2} [smsutil:init:118] [ERROR] Init Failure (1): Operation timed out waiting for (OK)
(02/07 12:54:25:515):{Notifier:2} [notifier_handlers:scanPorts:253] [INFO] Detected compatible SMS devices: []

ENGINE LOG

(02/07 12:54:19:937):{Dummy-1} [db_connection_manager:__init__:97] [INFO] Database connection pool for [BMSDB] initialized. Min connections: 4. Max connections: 10. Available connections: 4
(02/07 12:54:19:953):{Dummy-1} [util:attemptToConnect:69] [INFO] Successfully connected to the database
(02/07 12:54:20:0):{Dummy-1} [db_connection_manager:__init__:97] [INFO] Database connection pool for [BMSDB] initialized. Min connections: 4. Max connections: 10. Available connections: 4
(02/07 12:54:20:358):{Dummy-1} [oidutil:__init__:43] [INFO] MIBMap started
(02/07 12:54:20:358):{Dummy-1} [cycle_manager:__init__:39] [INFO] Cycle Manager startup complete
(02/07 12:54:20:358):{Dummy-1} [flow_controller:__init__:31] [INFO] Flow Controller startup complete
(02/07 12:54:20:358):{Dummy-1} [scheduler:__init__:33] [INFO] Scheduler startup complete
(02/07 12:54:20:358):{Dummy-1} [input_source_manager:__init__:24] [INFO] Input Source Manager startup complete
(02/07 12:54:20:578):{Dummy-1} [oidutil:__init__:43] [INFO] MIBMap started
(02/07 12:54:20:578):{Dummy-1} [short_request_handler:__init__:22] [INFO] Short Request Handler startup complete
(02/07 12:54:20:796):{Dummy-1} [oidutil:__init__:43] [INFO] MIBMap started
(02/07 12:54:20:796):{Dummy-1} [long_request_handler:__init__:22] [INFO] Long Request Handler startup complete
(02/07 12:54:20:796):{Dummy-1} [user_cache:__init__:23] [INFO] User Cache startup complete
(02/07 12:54:20:796):{Dummy-1}[list_manager:__init__:25] [INFO] List Manager startup complete
(02/07 12:54:20:796):{Dummy-1} [load_manager:__init__:25] [INFO] Load Manager startup complete
(02/07 12:54:20:796):{Dummy-1} [diagnostics_handler:__init__:41] [INFO] Diagnostics Handler startup complete
(02/07 12:54:20:796):{Dummy-1} [bas_handler:__init__:69] [INFO] Health Matrix Component startup complete
(02/07 12:54:20:796):{Dummy-1} [trap_receiver:__init__:57] [INFO] Trap Component startup complete
(02/07 12:54:20:796):{Dummy-1} [host_handler:__init__:37] [INFO] Host Handler startup complete
(02/07 12:54:20:905):{Peer(Engine)} [peer:run:1013] [INFO] EndPoint (Engine) started and bound to ('10.0.1.104', 55501)
(02/07 12:54:23:233):{PeerRecvQueue:1} [trap_receiver:srv_trapUpdate:76] [INFO] Trap update: {'ip_address': u'', 'enabled': 0, 'id': 1, 'community': u'', 'port': 162}
(02/07 12:54:23:937):{PeerRecvQueue:1} [flow_controller:__init__:432] [INFO] Creating OutputTarget instance
(02/07 12:54:23:937):{PeerRecvQueue:1} [flow_controller:srv_registerOutputTarget:50] [INFO] Register Output Target: App
(02/07 12:54:23:967):{PeerRecvQueue:1} [input_source_manager:srv_serverMonitoring:36] [INFO] Server monitoring call for {'monitoring_status_id': 3, 'maintenance_val': {}, 'machine_name': u'WEBDESKTOP.DOMAIN.LOCAL', 'snmp_community': u'', 'name': u'WEBDESKTOP (Non-SNMP)', 'domain_id': 1, 'snmp_port': 161, 'server_id': 1, 'domain_name': u'Domain', 'monitoring_status': True, 'maintenance_temp_val': [], 'bas_server_id': 10000, 'domain_org_id': 1, 'lurnum': 2011, 'ha_status_id': 1}
(02/07 12:54:23:967):{PeerRecvQueue:1} [trap_receiver:srv_trapUpdate:76] [INFO] Trap update: {'ip_address': u'', 'enabled': 0, 'id': 1, 'community': u'', 'port': 162}
(02/07 12:54:24:608):{PeerRecvQueue:1} [flow_controller:__init__:432] [INFO] Creating OutputTarget instance
(02/07 12:54:24:608):{PeerRecvQueue:1} [flow_controller:srv_registerOutputTarget:50] [INFO] Register Output Target: DCS
(02/07 12:54:51:190):{Timer Thread} [load_manager:collectMetrics:34] [INFO] Collecting load metrics
(02/07 12:55:11:322):{PeerConnRecv-None} [engine:disconnected:104] [INFO] Disconnect (remote: True): BAS-712581a3-0871-46dd-bc40-c2d28a58bcb0
(02/07 12:55:11:322):{PeerConnRecv-None} [peer:disconnected:815] [INFO] Endpoint(Engine) received disconnect from Peer(BAS-712581a3-0871-46dd-bc40-c2d28a58bcb0)
(02/07 12:55:21:536):{Timer Thread} [load_manager:collectMetrics:34] [INFO] Collecting load metrics



Funny part is it is clearly connected and listening

C:\Users\besadmin>netstat -an |find "555"
TCP 10.0.1.104:55500 0.0.0.0:0 LISTENING
TCP 10.0.1.104:55500 10.0.1.104:64935 ESTABLISHED
TCP 10.0.1.104:55500 10.0.1.104:64970 ESTABLISHED
TCP 10.0.1.104:55501 0.0.0.0:0 LISTENING
TCP 10.0.1.104:55501 10.0.1.104:64934 ESTABLISHED
TCP 10.0.1.104:55501 10.0.1.104:64971 ESTABLISHED
TCP 10.0.1.104:55502 0.0.0.0:0 LISTENING
TCP 10.0.1.104:55502 10.0.1.104:64946 ESTABLISHED
TCP 10.0.1.104:55503 0.0.0.0:0 LISTENING

ok...so now I am confused.



Let me preface this with a disclaimer that I've been working on systems a long time in enterprise environments and this problem has stumped me for about 8 hours.



While trying to get the console to load on the server I have been verifying DNS, TCP connectivity, etc on the server. While testing from my laptop using the IP and FQDN I was suddenly able to get the console to load...!!!?



Go back to the server and try the link in the startup menu...no dice. I reverify that the servername.domainname.local = IPv4 address on the server (IPv6 is disabled but wanted to make sure)



For the hell of it, I use the IP in the URL and it works on the server. I then try the Netbios name...and it works...



The POS can resolve the FQDN on the server but cannot load the page unless I change to netbios name or IP...

From anywhere else I can use the FQDN to load the page.



What the hell...

Only thing I found was from RIM's KB:

1. Disable IPv6 on the server hosting the BlackBerry Monitoring Service.
2. Configure the BlackBerry Monitoring Service to use the IPv4 protocol stack:
   
   1. For 32-bit Windows Server go to HKEY_LOCAL_MACHINE\SOFTWARE\Apache Software Foundation\Procrun 2.0\BBMonitoringConsole\Parameters\Java
   2. For 64-bit Windows Server go to HKEY_LOCAL_MACHINE\SOFTWARE\Wow6432Node\Apache Software Foundation\Procrun 2.0\BBMonitoringConsole\Parameters\Java
3. Modify the Options value and add the line: Djava.net.preferIPv4Stack=true
4. Restart the BlackBerry Monitoring Services.
   

... or dual NICs installed.

__________________
http://blog.port3101.org/hdawg/

The views expressed by me on Port3101 and its affiliated sites are my own and do not necessarily reflect the views of my employer.

Originally IPv6 was disabled before starting the install and that djava line was already part of the registry (they must have fixed it in the latest install package).

In the end it turned out that from the server you cannot load the FQDN url, but using IP or just netbios works just fine.

Beats the hell out of me WHY its doing that, but I am ok living with that result. I just edited the URL shortcut file to be netbios name...

what happens if you put the FQDN in the hosts file?

__________________
http://blog.port3101.org/hdawg/

The views expressed by me on Port3101 and its affiliated sites are my own and do not necessarily reflect the views of my employer.

At this point the project is closed and handed over to the client. Other then that anomoly, its all working great. Maybe will drop them a note and ask them to try...

glad to hear on both accounts.

__________________
http://blog.port3101.org/hdawg/

The views expressed by me on Port3101 and its affiliated sites are my own and do not necessarily reflect the views of my employer.

Thanks for the link, glad you got your client's BES going.