High load average on serveral DUS7 cluster nodes

Resolved
Resolved

We have fixed the issues. Cluster environment is healthy. No cluster nodes are under High Load anymore. We are now checking the monitoring system and every vServers one-by-one.

Also, Virtuozzo technical support is investigating the cluster stability over the next days. We apologize for any inconveniences caused.

Avatar for
Recovering

Most chunk serves and services are up again. Load average is now on every node back to normal. Some singular vServer might be still affected, but the overall status of the cluster looks better now.

Avatar for
Recovering

Cluster has reached "healthy" status again, but we still see that some nodes are acting under High Load average. Therefore we are preparing to reboot several nodes one after one inside the cluster.

Avatar for
Recovering

The cluster is now in "self-healing" mode, by moving data chunks to less used chunk servers. At the moment, we consider the cluster data replication as "degraded", but being at 93% healthy (coming from 88% about 10-15 minutes ago).

Avatar for
Investigating

We are also checking, with the data center, if the cause can be related to attacks on the infrastructure and/or on single machines.

Avatar for
Investigating

We see that nodes are recovering now and are coming back to a normal Load Average.

Avatar for
Investigating

Sorry, but we are experiencing high load averages on various cluster nodes. We are looking into the issue with Virtuozzo technical support.

Avatar for
Began at:

Affected components
  • Cloud Cluster
  • Virtual Server
  • Network / Netzwerk