MastodonAppUK - Content Processing Delays Tuesday 16th September 2025 19:04:19

Queues continue to grow due to increasing latency with the Redis connection, unfortunately there is no obvious path forward at this point and issues with other aspects of the service are restricting my ability to properly resolve this issue.

All queues are currently backed up between 2 mins and 1 hour. We aren't processing events very quickly due to the issues with our Redis configuration. Depending on time We may attempt to migrate the Redis server onto the new infrastructure tonight however seeing the issues Universeodon had when we did this move it is not ideal. We will keep you updated.

We are continuing to work to minimise the queue lengths, unfortunately due to the connectivity constraints between our old environment and the new environment increasing our queue processing capacity has had a substantial and negative impact to Universeodon and as a result we've had to scale back our setup, we think the latency between our new cluster and old cluster is partially to blame for the reason the jobs are queueing and struggling to process however continue to investigate and will do what we can to minimise disruption.

We are seeing queues continue to grow and our content processing is struglging to keep up. We're rolling out some configuration changes which should increase capacity and we will continue to scale up our content processing until the backlog is back to a managable state.