Update on agile Outage 11/10/2020
Tuesday our Dallas data center experienced a network outage involving the virtual switches connecting our agile application servers to the agile Database. This was an extremely rare type of issue that should not have occurred given the redundancy and resiliency we have built into our systems. While we could have rolled over the systems to our Chicago disaster recovery site, we believed we could work through the issues in Dallas faster than a full disaster recovery switch over and this proved to be true.
Tuesday night we completely rebuilt the virtual switches that enable our application servers to communicate. Wednesday morning we completed the configuration changes and moved the applications on to the new virtual switches to balance our network load.
We are also working with our vendor to better understand the root cause of our network failure so we can mitigate and prevent this from happening again.
We apologize for the impacts to your business and understand your frustration during an outage such as the one we experienced Tuesday and the period of slowness Wednesday morning.
Please be on the lookout next week for additional updates and communication on the work we are doing to upgrade our agile infrastructure and improve the performance you experience during normal daily operations. We will also update you on our plans to eliminate your dependency on IE11 (Internet Explorer).
Pat Quinn
CIO/SVP – Acuity Brands Lighting