Hi
Please note, I have removed all http:// due to limitations.
I have upgraded my customers ServiceControl + ServicePulse. Things went fine until I noticed that ServiceControl API is not running. The service seems to work fine, but I cannot connect. Writes: CONNECTION FAILED
I got this in Eventvwr after the upgrade:
Faulting application name: ServiceControl.Audit.exe, version: 4.25.2.0, time stamp: 0xe03a588d
Faulting module name: KERNELBASE.dll, version: 6.3.9600.20369, time stamp: 0x626a18c2
Exception code: 0xe0434352
Fault offset: 0x0000000000008d5c
Faulting process id: 0xdc
Faulting application start time: 0x01d8c9c1fee94209
Faulting application path: C:\Program Files (x86)\Particular Software\Particular.Nservicebus.--removed--.Audit\ServiceControl.Audit.exe
Faulting module path: C:\Windows\system32\KERNELBASE.dll
Report Id: 3cfc914c-35b5-11ed-8135-005056a07aa1
Faulting package full name:
Faulting package-relative application ID:
And in the logfile.2022-09-16.txt I get
2022-09-16 14:40:36.1349|31|Info|Microsoft.Hosting.Lifetime|Application is shutting down...
2022-09-16 14:40:36.1459|27|Info|NServiceBus.Raw.StoppableRawEndpoint|Initiating shutdown.
2022-09-16 14:40:36.1699|27|Info|NServiceBus.Raw.StoppableRawEndpoint|Shutdown complete.
2022-09-16 14:40:36.1699|27|Info|NServiceBus.Raw.RunningRawEndpointInstance|Stopping receiver.
2022-09-16 14:40:36.1779|27|Info|NServiceBus.Raw.RunningRawEndpointInstance|Receiver stopped.
2022-09-16 14:40:36.1779|27|Info|NServiceBus.Raw.StoppableRawEndpoint|Initiating shutdown.
2022-09-16 14:40:36.1779|27|Info|NServiceBus.Raw.StoppableRawEndpoint|Shutdown complete.
2022-09-16 14:40:36.2119|44|Info|NServiceBus.RunningEndpointInstance|Initiating shutdown.
2022-09-16 14:40:36.2319|44|Info|NServiceBus.RunningEndpointInstance|Shutdown complete.
2022-09-16 14:40:36.2609|44|Info|ServiceControl.Infrastructure.RavenDB.Expiration.ExpiredDocumentsCleanerBundle|Expired documents cleanup process stopped.
2022-09-16 14:40:37.4313|1|Info|ServiceBus.Management.Infrastructure.Settings.Settings|No settings found for error log queue to import, default name will be used
2022-09-16 14:40:37.6343|1|Info|Particular.ServiceControl.Bootstrapper|
-------------------------------------------------------------
ServiceControl Version: 4.25.2+536242d40da312846d204e68975ecc9826ea4f1b
Audit Retention Period (optional): 3.00:57:36.2300000
Error Retention Period: 10.00:00:00
Ingest Error Messages: True
Forwarding Error Messages: False
Database Size: 849.49 MB
Database Folder Size: 1.21 GB
ServiceControl Logging Level: Info
RavenDB Logging Level: Warn
Selected Transport Customization: ServiceControl.Transports.RabbitMQ.RabbitMQClassicConventionalRoutingTransportCustomization, ServiceControl.Transports.RabbitMQ
-------------------------------------------------------------
2022-09-16 14:40:37.7914|1|Info|ServiceControl.Infrastructure.RavenDB.RavenBootstrapper|Loading Embedded RavenDB license
2022-09-16 14:40:42.7706|7|Info|ServiceControl.Infrastructure.RavenDB.Expiration.ExpiredDocumentsCleanerBundle|Running deletion of expired documents every 600 seconds
2022-09-16 14:40:42.7816|7|Info|ServiceControl.Infrastructure.RavenDB.Expiration.ExpiredDocumentsCleanerBundle|Deletion batch size set to 65512
2022-09-16 14:40:42.7816|7|Info|ServiceControl.Infrastructure.RavenDB.Expiration.ExpiredDocumentsCleanerBundle|Retention period for errors is 10.00:00:00
2022-09-16 14:40:42.7926|7|Info|ServiceControl.Infrastructure.RavenDB.Expiration.ExpiredDocumentsCleanerBundle|Retention period for audits and saga history is 3.00:57:36.2300000
2022-09-16 14:40:42.8066|7|Info|ServiceControl.Infrastructure.RavenDB.EmbeddedRavenDbHostedService|Initializing RavenDB instance
2022-09-16 14:40:42.8066|7|Info|ServiceControl.Infrastructure.RavenDB.EmbeddedRavenDbHostedService|Creating indexes if not present.
2022-09-16 14:40:42.8066|7|Info|ServiceControl.Infrastructure.RavenDB.EmbeddedRavenDbHostedService|Testing indexes
2022-09-16 14:40:42.8066|7|Info|ServiceControl.Infrastructure.RavenDB.EmbeddedRavenDbHostedService|Executing data migrations
2022-09-16 14:40:45.6169|4|Info|ServiceControl.Recoverability.RetryDocumentManager|Found 0 orphaned retry batches from previous sessions.
2022-09-16 14:40:45.6319|38|Info|Microsoft.Hosting.Lifetime|Application started. Hosting environment: Production; Content root path: C:\Program Files (x86)\Particular Software\NServiceBus.Nordjyske\
2022-09-16 14:40:45.6559|5|Info|ServiceControl.Recoverability.RetryProcessor|No batch found to forward.
2022-09-16 14:40:45.6789|49|Info|ServiceControl.Recoverability.RetryProcessor|No batch found to stage.
And in ravenlog.2022-09-16.txt I get
2022-09-16 13:41:39.8792|19|Warn|Raven.Client.Connection.Async.AsyncServerClient|Was unable to fetch topology from primary node localhost also there is no cached topology
2022-09-16 13:43:02.1043|22|Warn|Raven.Client.Connection.Async.AsyncServerClient|Was unable to fetch topology from primary node localhost also there is no cached topology
2022-09-16 13:43:04.1056|5|Warn|Raven.Database.Prefetching.PrefetchingBehavior|WASTE: Discarding future work item without using it, to reduce memory usage
2022-09-16 13:43:04.1056|23|Warn|Raven.Database.Prefetching.PrefetchingBehavior|WASTE: Discarding future work item without using it, to reduce memory usage
2022-09-16 13:43:04.1056|23|Warn|Raven.Database.Prefetching.PrefetchingBehavior|WASTE: Discarding future work item without using it, to reduce memory usage
2022-09-16 13:43:04.1056|23|Warn|Raven.Database.Prefetching.PrefetchingBehavior|WASTE: Discarding future work item without using it, to reduce memory usage
2022-09-16 13:43:04.1056|5|Warn|Raven.Database.Prefetching.PrefetchingBehavior|WASTE: Discarding future work item without using it, to reduce memory usage
2022-09-16 13:43:04.1056|5|Warn|Raven.Database.Prefetching.PrefetchingBehavior|WASTE: Discarding future work item without using it, to reduce memory usage
2022-09-16 13:43:54.5183|4|Warn|Raven.Database.Prefetching.PrefetchingBehavior|After early exit: Got 2048 documents, 2048 irrelevant for indexing (246 kb) in a future batch, starting from etag 01000000-0000-003D-0000-000000007C70 to etag 01000000-0000-003D-0000-00000001A3EA, took 122ms
2022-09-16 13:43:54.5183|6|Warn|Raven.Database.Prefetching.PrefetchingBehavior|After early exit: Got 2048 documents, 2048 irrelevant for indexing (246 kb) in a future batch, starting from etag 01000000-0000-003D-0000-00000002131F to etag 01000000-0000-003D-0000-00000002A3D8, took 115ms
2022-09-16 13:43:54.5513|7|Warn|Raven.Client.Connection.Async.AsyncServerClient|Was unable to fetch topology from primary node localhost also there is no cached topology
2022-09-16 13:43:54.5873|4|Warn|Raven.Database.Prefetching.PrefetchingBehavior|After early exit: Got 2048 documents, 2048 irrelevant for indexing (246 kb) in a future batch, starting from etag 01000000-0000-003D-0000-00000000EBC7 to etag 01000000-0000-003D-0000-00000001A3EA, took 64ms
2022-09-16 13:43:54.6353|6|Warn|Raven.Database.Prefetching.PrefetchingBehavior|After early exit: Got 2048 documents, 2048 irrelevant for indexing (245 kb) in a future batch, starting from etag 01000000-0000-003D-0000-0000000282A3 to etag 01000000-0000-003D-0000-00000002A3D8, took 112ms
2022-09-16 13:43:54.6563|7|Warn|Raven.Database.Prefetching.PrefetchingBehavior|After early exit: Got 1345 documents, 1344 irrelevant for indexing (177 kb) in a future batch, starting from etag 01000000-0000-003D-0000-000000015B22 to etag 01000000-0000-003D-0000-00000001A3EA, took 76ms
2022-09-16 13:43:54.6953|6|Warn|Raven.Database.Prefetching.PrefetchingBehavior|After early exit: Got 1345 documents, 1345 irrelevant for indexing (161 kb) in a future batch, starting from etag 01000000-0000-003D-0000-000000029AF8 to etag 01000000-0000-003D-0000-00000002A3D8, took 59ms
2022-09-16 13:43:54.8793|6|Warn|Raven.Database.Prefetching.PrefetchingBehavior|After early exit: Got 12 documents, 12 irrelevant for indexing (1 kb) in a future batch, starting from etag 01000000-0000-003E-0000-00000000012E to etag 01000000-0000-003E-0000-00000000013B, took 0ms
2022-09-16 13:43:54.9624|7|Warn|Raven.Database.Prefetching.PrefetchingBehavior|After early exit: Got 2048 documents, 2048 irrelevant for indexing (246 kb) in a future batch, starting from etag 01000000-0000-003D-0000-00000002EBB0 to etag 01000000-0000-003D-0000-00000003697B, took 94ms
2022-09-16 13:43:55.1504|7|Warn|Raven.Database.Prefetching.PrefetchingBehavior|After early exit: Got 3406 documents, 3405 irrelevant for indexing (424 kb) in a future batch, starting from etag 01000000-0000-003D-0000-00000002F780 to etag 01000000-0000-003D-0000-00000003697B, took 188ms
2022-09-16 13:48:22.8534|69|Error|Raven.Database.DocumentDatabase|Could not properly dispose of DatabaseDocument
System.AggregateException: Could not properly dispose of DatabaseDocument ---> System.ComponentModel.Win32Exception: The interface is unknown
at System.Diagnostics.EventLogInternal.InternalWriteEvent(UInt32 eventID, UInt16 category, EventLogEntryType type, String[] strings, Byte[] rawData, String currentMachineName)
at System.Diagnostics.EventLogInternal.WriteEvent(EventInstance instance, Byte[] data, Object[] values)
at System.Diagnostics.EventLog.WriteEvent(EventInstance instance, Object[] values)
at Microsoft.Extensions.Logging.EventLog.WindowsEventLog.WriteEntry(String message, EventLogEntryType type, Int32 eventID, Int16 category)
at Microsoft.Extensions.Logging.EventLog.EventLogLogger.WriteMessage(String message, EventLogEntryType eventLogEntryType, Int32 eventId)
at Microsoft.Extensions.Logging.EventLog.EventLogLogger.Log[TState](LogLevel logLevel, EventId eventId, TState state, Exception exception, Func`3 formatter)
at Microsoft.Extensions.Logging.Logger.<Log>g__LoggerLog|12_0[TState](LogLevel logLevel, EventId eventId, ILogger logger, Exception exception, Func`3 formatter, List`1& exceptions, TState& state)
--- End of inner exception stack trace ---
---> (Inner Exception #0) System.ComponentModel.Win32Exception (0x80004005): The interface is unknown
at System.Diagnostics.EventLogInternal.InternalWriteEvent(UInt32 eventID, UInt16 category, EventLogEntryType type, String[] strings, Byte[] rawData, String currentMachineName)
at System.Diagnostics.EventLogInternal.WriteEvent(EventInstance instance, Byte[] data, Object[] values)
at System.Diagnostics.EventLog.WriteEvent(EventInstance instance, Object[] values)
at Microsoft.Extensions.Logging.EventLog.WindowsEventLog.WriteEntry(String message, EventLogEntryType type, Int32 eventID, Int16 category)
at Microsoft.Extensions.Logging.EventLog.EventLogLogger.WriteMessage(String message, EventLogEntryType eventLogEntryType, Int32 eventId)
at Microsoft.Extensions.Logging.EventLog.EventLogLogger.Log[TState](LogLevel logLevel, EventId eventId, TState state, Exception exception, Func`3 formatter)
at Microsoft.Extensions.Logging.Logger.<Log>g__LoggerLog|12_0[TState](LogLevel logLevel, EventId eventId, ILogger logger, Exception exception, Func`3 formatter, List`1& exceptions, TState& state)<---
---> (Inner Exception #1) System.ComponentModel.Win32Exception (0x80004005): The interface is unknown
at System.Diagnostics.EventLogInternal.InternalWriteEvent(UInt32 eventID, UInt16 category, EventLogEntryType type, String[] strings, Byte[] rawData, String currentMachineName)
at System.Diagnostics.EventLogInternal.WriteEvent(EventInstance instance, Byte[] data, Object[] values)
at System.Diagnostics.EventLog.WriteEvent(EventInstance instance, Object[] values)
at Microsoft.Extensions.Logging.EventLog.WindowsEventLog.WriteEntry(String message, EventLogEntryType type, Int32 eventID, Int16 category)
at Microsoft.Extensions.Logging.EventLog.EventLogLogger.WriteMessage(String message, EventLogEntryType eventLogEntryType, Int32 eventId)
at Microsoft.Extensions.Logging.EventLog.EventLogLogger.Log[TState](LogLevel logLevel, EventId eventId, TState state, Exception exception, Func`3 formatter)
at Microsoft.Extensions.Logging.Logger.<Log>g__LoggerLog|12_0[TState](LogLevel logLevel, EventId eventId, ILogger logger, Exception exception, Func`3 formatter, List`1& exceptions, TState& state)<---
2022-09-16 13:49:07.1775|14|Warn|Raven.Client.Connection.Async.AsyncServerClient|Was unable to fetch topology from primary node localhost also there is no cached topology
2022-09-16 13:54:07.4695|64|Warn|Raven.Client.Connection.Async.AsyncServerClient|Was unable to fetch topology from primary node localhost also there is no cached topology
2022-09-16 13:59:07.4778|37|Warn|Raven.Client.Connection.Async.AsyncServerClient|Was unable to fetch topology from primary node localhost also there is no cached topology
2022-09-16 14:00:23.6597|7|Warn|Raven.Client.Connection.Async.AsyncServerClient|Was unable to fetch topology from primary node localhost also there is no cached topology
2022-09-16 14:00:47.9805|7|Warn|Raven.Client.Connection.Async.AsyncServerClient|Was unable to fetch topology from primary node localhost also there is no cached topology
2022-09-16 14:05:48.3427|62|Warn|Raven.Client.Connection.Async.AsyncServerClient|Was unable to fetch topology from primary node localhost also there is no cached topology
2022-09-16 14:10:48.6719|35|Warn|Raven.Client.Connection.Async.AsyncServerClient|Was unable to fetch topology from primary node localhost also there is no cached topology
2022-09-16 14:11:24.6517|6|Warn|Raven.Client.Connection.Async.AsyncServerClient|Was unable to fetch topology from primary node localhost also there is no cached topology
2022-09-16 14:16:24.7686|42|Warn|Raven.Client.Connection.Async.AsyncServerClient|Was unable to fetch topology from primary node localhost also there is no cached topology
2022-09-16 14:21:25.2046|24|Warn|Raven.Client.Connection.Async.AsyncServerClient|Was unable to fetch topology from primary node localhost also there is no cached topology
2022-09-16 14:26:26.0441|5|Warn|Raven.Client.Connection.Async.AsyncServerClient|Was unable to fetch topology from primary node localhost also there is no cached topology
2022-09-16 14:31:25.3074|49|Warn|Raven.Client.Connection.Async.AsyncServerClient|Was unable to fetch topology from primary node localhost also there is no cached topology
2022-09-16 14:32:23.5377|7|Warn|Raven.Client.Connection.Async.AsyncServerClient|Was unable to fetch topology from primary node localhost also there is no cached topology
2022-09-16 14:37:24.9146|28|Warn|Raven.Client.Connection.Async.AsyncServerClient|Was unable to fetch topology from primary node localhost also there is no cached topology
2022-09-16 14:40:36.2609|44|Warn|Raven.Database.Prefetching.PrefetchingBehavior|WASTE: Discarding future work item without using it, to reduce memory usage
2022-09-16 14:40:36.2609|20|Warn|Raven.Database.Prefetching.PrefetchingBehavior|WASTE: Discarding future work item without using it, to reduce memory usage
2022-09-16 14:40:41.7136|4|Warn|Raven.Client.Connection.Async.AsyncServerClient|Was unable to fetch topology from primary node localhost also there is no cached topology
2022-09-16 14:45:41.5495|43|Warn|Raven.Client.Connection.Async.AsyncServerClient|Was unable to fetch topology from primary node localhost also there is no cached topology
2022-09-16 14:50:41.6152|43|Warn|Raven.Client.Connection.Async.AsyncServerClient|Was unable to fetch topology from primary node localhost also there is no cached topology
Hopefully this can show what’s wrong. I have never used these products before.
Thanks a lot
Br.
Michael