Outage (Outage)
  • Priority - Critical
  • Affecting System - NZ Data Center
  • Our monitors have picked up an high packet loss at our Auckland datacenter.

    This has been escalated to the datacenter staff.

    Update Fri, 26 Oct 2018 16:25 PM UTC: The datacenter network team have identified the issue and are working with their upstream provider to resolve the issue.
    Update Fri, 26 Oct 2018 18:05 PM UTC: We are still working on this issue.
    Update Fri, 26 Oct 2018 18:49 PM UTC: The datacenter team are working to resolve a second issue. They have multiple engineers on-site. There is no ETA at this time.
    Update Fri, 26 Oct 2018 19:21 PM UTC: The packet loss issue has been resolved. We are continuing to monitor the situation closely.
    Update Fri, 26 Oct 2018 21:44 PM UTC: There are some concerns about the stability of our upstreams network, and that we may have packet loss issues again unless we take urgent action. We are moving forward a planned migration to our upstreams new core network. This will happen at 11:30AM NZST. There is an expected 1-5 minute outage at this happens. Once complete we do not expect any further issues.
    Update Fri, 26 Oct 2018 22:46 PM UTC: The migration to the new core was completed as planned. There were a few subnets with routing issues that have now been resolved. We will be closely monitoring the network for further issues.
    Update Mon, 29 Oct 2018 00:13 AM UTC: The network has remained stable since the migration. Please open a ticket if you are seeing any issues at all.

  • Date - 27/10/2018 05:02
  • Last Updated - 29/10/2018 13:17