Domain Service Status Archive
Domain Service is Online
The OpenSRS maintenance is complete. OpenSRS Domains services are available.
Domain Service is In Maintenance
We are scheduling a two hour network maintenance window starting now. (01:00 UTC) We are taking advantage of a VeriSign .com and .net maintenance window in order to conduct some of our own database optimizations.
=======================================================
Service Impact:
OpenSRS Services will be affected for approximately one hour within the two hour maintenance window.
Impact for Resellers:
The following services will be unavailable for approximately one hour within the two hour window:
* OpenSRS Provisioning and Management (includes the RWI and API: ordering, renewals, transfers, deletion and management of domain names)
* Domain look-ups
* Storefront Management (includes ordering, renewals, deletion and management of domain names)
* Provisioning of Digital Certificates (SSL), Managed DNS and Website Builder.
If you have queuing enabled, requests submitted prior to the window will be processed once the maintenance is complete.
The following will remain available: Whois services, Parked Pages and Managed DNS zone resolution. All domains will continue to resolve.
Impact for End-users:
Domains will continue to resolve. Domain Management will be unavailable temporarily.
Domain Service is Online
All OpenSRS services are online. Our technical support team can receive phone calls. Our ticketing system is accepting new requests and follow-up emails. We will provide more details when available.
Update: 21:00 UTC
Our technical teams are monitoring and all services remain online. Our Technical Support team can receive calls. All tickets will be queued until the power outage affecting downtown Toronto is resolved.
Update: 22:19 UTC
All OpenSRS services continue to be online. OpenSRS headquarters power was out from approximately 20:40 - 21:50 UTC. We closely monitored and confirmed that no services were affected. In addition, our Technical Support team was fully available to receive calls. All previously queued tickets are being processed as per our regular process.
This update is related to Incident 13362
Domain Service is Online
All OpenSRS Domains services are fully online.
Update: June 22, 2010: 16:16ET/20:13 UTC
Incident Summary:
Summary: A Database unit suffered a memory corruption resulting in a kernel panic. This caused OpenSRS Services to be offline (Domains, SSL and Storefront). We addressed the issue, restarted services, and tested. All services were fully available within the hour. We moved the database to a stand-by platform while the hardware problems on the original system are resolved.
Monday, June 21, 2010 19:20 ET/23:20 UTC
Our Network Monitoring system alerted of an issue with a core database unit. OpenSRS Domains, SSL and Storefront services were unavailable.
19:25 ET/23:25 UTC
Technical teams were engaged and identified the issue. A database unit suffered a hardware failure. OpenSRS services were restarted and teams began testing.
19:51 ET/23:51 UTC
Services were available. We changed the status to degraded while we continued to closely monitor availability and continue our testing regime.
20:02 ET/Tuesday, June 22, 2010 00:02 UTC
Services were working well.
20:20 ET/Tuesday, June 22, 2010 00:20 UTC
All OpenSRS services were online.
This update is related to Incident 13107
Domain Service is Degraded
OpenSRS Domains services are online. We continue to closely monitor and test services while we investigate the cause.
Update Tuesday 00:02 UTC
All services are working well. Our technical teams are testing functionality. We will continue to keep services in degraded status as a precaution.
This update is related to Incident 13107
Domain Service is Offline
We are investigating a database issue. At this time, all OpenSRS Domains services are unavailable. Our Technical teams are engaged and investigating. We will have more details shortly.
Update 23:35 UTC:
We restarted services and are testing.
This update is related to Incident 13107
Domain Service is Online
We are investigating an issue with contactprivacy.com. All other OpenSRS services are fully online.
Update:
We resolved the issue with Contactprivacy.com.
Domain Service is Online
All OpenSRS services are online.
Incident Summary
2010-06-13 15:45 UTC: Our monitoring systems first alerted our Network Operations Centre staff to the presence of slow connections to a number of services and network systems.
2010-06-13 16:00 UTC: Operations staff became involved and began investigating the cause of the incident.
2010-06-13 16:15 UTC: A large number of alerts continued to show that core network components were overloaded, affecting connections to Email Cluster A, Domains/SSL Provisioning and Management, Managed DNS, Storefront. Monitoring probes where registering significant spikes of abnormal traffic across a number of our services. This spike in traffic saturated a number of core network components. The incident was labeled Critical and was escalated to the Executive level.
2010-06-13 16:15 - 20:00 UTC: Using various traffic mitigation strategies, our Operations staff managed to balance all incoming data streams to our datacenter, easing pressure on a number of core network components. After identification and analysis, network elements were configured to drop unwanted traffic at the network edges.
2010-06-13 20:00 UTC: Email Cluster A service returning to normal operation.
2010-06-13 20:15 UTC: Domain Service was set to degraded status, while further traffic mitigation work was performed.
2010-06-13 21:00 UTC: All services online.
This update is related to Incident 12933
Domain Service is Degraded
OpenSRS SSL Services may continue to experience slowness or intermittent timeouts. Our technical teams continue to monitor and test the cause of the high loads which affected our service availability today. We will have another update within the hour.
We apologize for the inconvenience to you and your customers. We are working hard to resolve this as quickly as possible.
This update is related to Incident 12933
Domain Service is Degraded
OpenSRS Services may continue to experience slowness or intermittent timeouts. Our technical teams continue to monitor and test the cause of the high loads which affected our service availability today. We will have another update within the hour.
Affected services are:
Domains Provisioning and Management
SSL
Storefront
DNS
We apologize for the inconvenience to you and your customers. We are working hard to resolve this as quickly as possible.
This update is related to Incident 12933