All systems are operational.
The latest status updates from the team. Updates provided on known and ongoing incidents.
The main website for the ATLAS Media Group Team
The ATLAS Media Group Ltd. Blog Platform
Service which hosts static content across a number of our parked and inactive domains.
The primary billing panel for the Superior Networks clients.
The VPS Control panel for Superior Networks Customers.
The main Superior Networks website.
Our servers in the French location.
Our new London Region for Superior Networks
The mastodonapp.uk site
The database service storing appropriate content for the service
Handles the processing of content both internally to our server as well as communicating with remote servers
Storage for all videos, pictures and other content on the site
Used to handle delivery of e-mails to users
Search capability for MastodonApp.UK
The Universeodon public website
Universeodon's Database
The Universeodon Queue and content processing service.
Universeodon Media Storage
Universeodon's Advanced / full text search service.
Universeodon e-mail service
The ActivityPub relay hosted on relay.universeodon.com
Located in the London Region | Legacy Server
Located in the France Region
Located in the London Region
We need to perform routine maintenance to our physical hardware located within the Redditch Data center. As part of this we will need to take all services offline for a short amount of time while we apply system and security updates to our shared storage pool and restart the underlying host. We will also be performing patching and upgrades to our application hosts during this time and will be failing over our applications across the nodes in the environment.
We expect the maintenance itself to take approx 3 hours with a short outage of up to 30 mins throughout this while we take the environment offline for full system restarts and hardware improvements.
We are fully back online with increased capacity on our content processing and operating as normal. No backlog on the queues at this time.
As part of re-balancing our infrastructure and in preparation for an upcoming hardware activity we need to move part of our content processing services, during this time there will be significant delays to content processing on Universeodon.com - We expect this to last no more than 30-60 mins.
No incidents reported.
We can confirm this issue was resolved last night, we've continued to monitor the situation overnight and this morning and are happy to confirm all queues are caught up.
We are continuing to see delays on content processing with around 80,000 items on our ingest queue however we currently lack the compute in our cluster to process these at a faster rate without causing major disruption to other services. We're tracking around 1 hour delay currently between events being entered into the queue and them being processed.
We are continuing to monitor the situation. We are currently tacking approx 2 hours behind on our ingest queues though all other queues at this time are showing clear.
Our content processing queues appear to have partially crashed at around 8AM UTC today resulting in no new ingress of posts and content. Limited other actions will have been maintained, we're currently catching up on the processing backlog and expect disruption to continue for the next 1-2 hours.
No incidents reported.
No incidents reported.
All systems fully operational.
We have performed restarts to fix a configuration error in our database server and restarted the streaming service, content processing is continue to catch up and is 5-10 mins behind live right now. We will continue to monitor for the rest of today.
There is currently a major outage on MastodonAppUK we believe caused by high load following an earlier failure of the content processing which was resolving. Support are investigating.
We can confirm full service has now been restored and we're back to normal operations.
Our queue and content processing service experienced a processing failure around 9AM UK time today (24th Feb). This has resulted in the vast majority of content being unable to be processed and significant delays on processing. We've been made aware of the issue now and are working to restore functionality. It is expected to take a couple of hours before we're fully caught up.