The Elasticsearch instance currently running for MastodonApp.UK is experiencing some sort of issue which is preventing search operations running. Support are investigating the issue.
We have deployed new infrastructure and re-build our search system from the ground up. Everything should now be working as expected.
We have not progressed the work to restore the full text search capability as of yet, we will re-build the required infrastructure shortly.
22nd December 2023
VPS Control PanelIssues with Primary Load Balancer
We are investigating an issue with one of our production fleet servers which appears to be causing major disruption across our services. We are working to identify and resolve the root cause.
The issue appears to be fully resolved.
We have localised the issue and it appears to be a fault with the primary load balancer server we currently use which manifested itself as a prod-lon-dedi-01 fault. Incident title updated.
21st December 2023
No incidents reported
20th December 2023
No incidents reported
19th December 2023
No incidents reported
18th December 2023
No incidents reported
17th December 2023
No incidents reported
16th December 2023
No incidents reported
15th December 2023
No incidents reported
14th December 2023
WebsiteUniverseodon Feeds not reliably updating
We are seeing issues with the Universeodon website not automatically updating some of the feed columns from the web UI. This is likely related to the earlier outages but we have yet to identify a root cause.
Service has been fully restored.
WebsiteUniverseodon Outage
We have identified an issue with our database server where one of the disk partitions has filled, this has caused a major outage across Universeodon. We are working to remedial the issue now.
We have increased the disk space on the Database host which has resolved the issue for the time being. We will be posting a full incident write up shortly.
