All systems are operational

About This Site

Real time service status from across the ATLAS Media Group portfolio

Past Incidents

8th March 2025

No incidents reported

7th March 2025

No incidents reported

6th March 2025

No incidents reported

5th March 2025

No incidents reported

4th March 2025

No incidents reported

3rd March 2025

No incidents reported

2nd March 2025

Queue & Content Processing Service Universeodon Media Migration

As part of re-balancing our infrastructure and in preparation for an upcoming hardware activity we need to move part of our content processing services, during this time there will be significant delays to content processing on Universeodon.com - We expect this to last no more than 30-60 mins.

  • We are fully back online with increased capacity on our content processing and operating as normal. No backlog on the queues at this time.

    • 1st March 2025

    No incidents reported

    28th February 2025

    Universeodon SideKiq Content Issues

    Our content processing queues appear to have partially crashed at around 8AM UTC today resulting in no new ingress of posts and content. Limited other actions will have been maintained, we're currently catching up on the processing backlog and expect disruption to continue for the next 1-2 hours.

  • We can confirm this issue was resolved last night, we've continued to monitor the situation overnight and this morning and are happy to confirm all queues are caught up.

  • We are continuing to see delays on content processing with around 80,000 items on our ingest queue however we currently lack the compute in our cluster to process these at a faster rate without causing major disruption to other services. We're tracking around 1 hour delay currently between events being entered into the queue and them being processed.

  • We are continuing to monitor the situation. We are currently tacking approx 2 hours behind on our ingest queues though all other queues at this time are showing clear.

    • 27th February 2025

    No incidents reported

    26th February 2025

    No incidents reported

    25th February 2025

    MastodonAppUK Outage & Disruption

    There is currently a major outage on MastodonAppUK we believe caused by high load following an earlier failure of the content processing which was resolving. Support are investigating.

  • All systems fully operational.

  • We have performed restarts to fix a configuration error in our database server and restarted the streaming service, content processing is continue to catch up and is 5-10 mins behind live right now. We will continue to monitor for the rest of today.

    • 24th February 2025

    Queue & Content Processing Service Universeodon Content Processing Crashed

    Our queue and content processing service experienced a processing failure around 9AM UK time today (24th Feb). This has resulted in the vast majority of content being unable to be processed and significant delays on processing. We've been made aware of the issue now and are working to restore functionality. It is expected to take a couple of hours before we're fully caught up.

  • We can confirm full service has now been restored and we're back to normal operations.