ATLAS Media Group Status Page

Some systems are experiencing issues.

ATLAS Media Group Status Page

The latest status updates from the team. Updates provided on known and ongoing incidents.

Planned maintenance

  • We need to perform routine maintenance to our physical hardware located within the Redditch Data center. As part of this we will need to take all services offline for a short amount of time while we apply system and security updates to our shared storage pool and restart the underlying host. We will also be performing patching and upgrades to our application hosts during this time and will be failing over our applications across the nodes in the environment.

    We expect the maintenance itself to take approx 3 hours with a short outage of up to 30 mins throughout this while we take the environment offline for full system restarts and hardware improvements.

    Affected Components: VPS Control Panel, Universeodon Database, Universeodon Queue & Content Processing Service, Universeodon Website, Universeodon Relay, Billing Panel, Blog, MastodonApp.UK Website, MastodonAppUK Database Service and MastodonAppUK Queue & Content Processing Service

Past incidents

Universeodon & MastodonAppUK - Software Upgrade

6 months ago
Complete
Affected Components: MastodonApp.UK Website, MastodonAppUK Queue & Content Processing Service, Universeodon Website and Universeodon Queue & Content Processing Service
6 months ago

All nodes have now been updated and the maintenance is complete.

6 months ago

We have confirmed the first 50% of the instances upgraded are working as intended and sufficiently. We have now started the upgrade on the remaining nodes.

6 months ago

We have completed the work to upgrade all of the content processing nodes on both sites. We have now taken 50% of the web servers offline to perform the upgrades, once we're happy that the web servers are complete we will bring these back online and switch to upgrading the remaining 50%

No incidents reported.

Fixed
Affected Components: Universeodon Relay, MastodonApp.UK Website, MastodonAppUK Advanced / Full Text Search, MastodonAppUK Database Service, MastodonAppUK Queue & Content Processing Service, VPS Control Panel, Universeodon Advanced Search and Universeodon Website

Fixed

6 months ago

The service provider for our dedicated hardware have been able to fully restore service to the machine however have identified some hardware which is failing and will require further intervention. We will look at how best to handle this and if we can migrate / mitigate this somewhat.

Investigating

6 months ago

We are currently awaiting an update from our service provider responsible for our legacy environment. It looks like they are investigating the fault at this time. We have been unable to gain any level of access or connectivity into the host so are waiting for them to resolve these issues before we will be able to restore service.

Investigating

6 months ago

We have isolated the issue to a single server in our legacy cluster which currently hosts a number of key services related to our Mastodon environments and the Superior Networks VPSCP.

We have been unable to connect to the server using any methods and are working to gain access to resolve the situation.

Reported

6 months ago

We seem to have lost connectivity with the our legacy cluster and it is no longer responding to SSH commands. We are investigating.

This is currently impacting:

  • Universeodon Search
  • MastodonAppUK Website
  • MastodonappUK Content Processing
  • MastodonAppUK Database
  • Universeodon Relay

Affected Components: MastodonAppUK Queue & Content Processing Service and MastodonApp.UK Website

Fixed

6 months ago

It looks like this was a one time spike in traffic, service was restored.

Reported

6 months ago

We're seeing significant load on our content processing servers and a significantly out of the ordanary level of load. We are investigating at this time.

No incidents reported.

No incidents reported.

Fixed

Fixed

6 months ago

The upgrades at the DC today should now have resolved the performance issues we've been seeing, early indications suggest everything is now operating as normal.

Reported

6 months ago

We're seeing issues with the reliability on Universeodon and we believe this is related to DB Backups that are taking place. We're looking to see what we can do to improve the situation.