ATLAS Media Group Status Page

Some systems are under maintenance.

ATLAS Media Group Status Page

The latest status updates from the team. Updates provided on known and ongoing incidents.

Planned maintenance

  • In progress

    We will be updating MastodonAppUK to the latest version of Mastodon. During this time there will be a short outage while we restart the web server and run the relevant migrations.

    We expect the maintenance overall to take approx 1 hour with an outage of approx 10 mins to complete the switch over.

    Affected Components: MastodonApp.UK Website, MastodonAppUK Advanced / Full Text Search, MastodonAppUK Database Service, MastodonAppUK E-Mail Service, MastodonAppUK Media Storage and MastodonAppUK Queue & Content Processing Service
    32 minutes ago

    The maintenance is now underway. Due to other commitments the maintenance did start slightly later than planned. We expect the outage itself to be kept to a minimum.

  • We need to perform routine maintenance to our physical hardware located within the Redditch Data center. As part of this we will need to take all services offline for a short amount of time while we apply system and security updates to our shared storage pool and restart the underlying host. We will also be performing patching and upgrades to our application hosts during this time and will be failing over our applications across the nodes in the environment.

    We expect the maintenance itself to take approx 3 hours with a short outage of up to 30 mins throughout this while we take the environment offline for full system restarts and hardware improvements.

    Affected Components: VPS Control Panel, Universeodon Database, Universeodon Queue & Content Processing Service, Universeodon Website, Universeodon Relay, Billing Panel, Blog, MastodonApp.UK Website, MastodonAppUK Database Service and MastodonAppUK Queue & Content Processing Service

Past incidents

No incidents reported.

No incidents reported.

No incidents reported.

Fixed

3 years ago

Service restored.

Watching

3 years ago

We've reduced back the scale of our queue processing due to overloading the host that we were using. The surge in compute has reduced queue length back to a more manageable duration of around 60 seconds. We'll continue to monitor over the next few hours.

Identified

3 years ago

We've significantly scaled up our content processing for the queue that is backed up (Currently by around 5 times our previous processing scale) but we're still seeing around 20-25 mins delays on content being published.

Reported

3 years ago

We've identified an issue where our internal content processing for the Mastodon App service appears to be running slow and is currently suffering from around a 30 min queue. We're working to increase our content processing to cope with this increased demand.

Fixed

Fixed

3 years ago

We've managed to now restore full service

Identified

3 years ago

We've managed to resolve the disk issues with the content processing and are in the process of re-running a large number of jobs that had been failing. This may result in delays to content being displayed on our site and communication with the wider fediverse.

Reported

3 years ago

We've identified an issue where our content processing has ground to a halt. We've identified the issue being with a full disk due to our system logs filling up. We've cleaned up this and are in the process of restarting services.

Fixed

Fixed

3 years ago

We've now restored service to the application

Reported

3 years ago

We are seeing partial outages of the Mastodon site due to exceptionally high demand. Support are working to increase server capacity to cope with this increase in demand. Some users may be unable to reliably access the site, view messages or post content.

Mastodon Database Migration

3 years ago
Complete

We will be performing a major database migration of the Mastodon App database, this will result in us moving the current production database onto a new database server. During this time we will take the site offline to minimise risk to our migration. We expect the migration to take no more than 2 hours. We will update when service is restored.

No incidents reported.

No incidents reported.

No incidents reported.