Cloud Management Gateway Stuck on Starting

My Cloud Management Gateway is stuck on starting on it's status. My cmg is still deployed as Cloud Service (Classic). At first I suspected the Secret had expired and it had, and that has been renewed, but it still on stuck with the following errors from the CloudMgr.log

This also prevents me from upgrading to a newer version of Configuration Manager and we are on 2303.

ERROR: Exception occured for service XXXcmg1 : Microsoft.WindowsAzure.Storage.StorageException: The underlying connection was closed: An unexpected error occurred on a send. ---> System.Net.WebException: The underlying connection was closed: An unexpected error occurred on a send. ---> System.IO.IOException: Unable to read data from the transport connection: An existing connection was forcibly closed by the remote host. ---> System.Net.Sockets.SocketException: An existing connection was forcibly closed by the remote host~~ at System.Net.Sockets.NetworkStream.Read(Byte[] buffer, Int32 offset, Int32 size)~~ --- End of inner exception stack trace ---~~ at System.Net.Sockets.NetworkStream.Read(Byte[] buffer, Int32 offset, Int32 size)~~ at System.Net.FixedSizeReader.ReadPacket(Byte[] buffer, Int32 offset, Int32 count)~~ at System.Net.Security.SslState.StartReceiveBlob(Byte[] buffer, AsyncProtocolRequest asyncRequest)~~ at System.Net.Security.SslState.CheckCompletionBeforeNextReceive(ProtocolToken message, AsyncProtocolRequest asyncRequest)~~ at System.Net.Security.SslState.ForceAuthentication(Boolean receiveFirst, Byte[] buffer, AsyncProtocolRequest asyncRequest, Boolean renegotiation)~~ at System.Net.Security.SslState.ProcessAuthentication(LazyAsyncResult lazyResult)~~ at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)~~ at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)~~ at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state)~~ at System.Net.TlsStream.ProcessAuthentication(LazyAsyncResult result)~~ at System.Net.TlsStream.Write(Byte[] buffer, Int32 offset, Int32 size)~~ at System.Net.PooledStream.Write(Byte[] buffer, Int32 offset, Int32 size)~~ at System.Net.ConnectStream.WriteHeaders(Boolean async)~~ --- End of inner exception stack trace ---~~ at System.Net.HttpWebRequest.GetRequestStream(TransportContext& context)~~ at System.Net.HttpWebRequest.GetRequestStream()~~ at Microsoft.WindowsAzure.Storage.Core.Executor.Executor.ExecuteSyncT~~ --- End of inner exception stack trace ---~~ at Microsoft.WindowsAzure.Storage.Core.Executor.Executor.ExecuteSyncT~~ at Microsoft.ConfigurationManager.AzureManagement.AzureStorageOperation.GetTableOperationClient(StorageRetryPolicy storageRetryPolicy, StorageSettings storageSettings)~~ at Microsoft.ConfigurationManager.CloudServicesManager.AnalyticsCollectionTask.GetMetricsTransactionsEntities(AzureStorageOperation azureStorageOperation, String metricsTableName, DateTime startDate, DateTime endDate)~~ at Microsoft.ConfigurationManager.CloudServicesManager.AnalyticsCollecti