Domain Service Status Archive
Domain Service is Offline
OpenSRS services are currently unavailable. We have been experiencing a high traffic load for approximately 3 hours and 30 minutes. All of our technical teams are fully engaged and investigating.
Services affected include:
Domains Provisioning and Management
Managed DNS
SSL
Storefront
The following services were affected, but are now working well. We will post these as degraded as a precaution while we closely monitor services.
Email Cluster A
If you are using our DNS for your email services, you may experience degraded services. Provisioning may also be affected. Email Cluster B is unaffected.
Our senior executive team is engaged and working to obtain details. We apologize for the inconvenience to you and your customers.
PLEASE NOTE: Our main communication channels, including http://status.opensrs.com, were affected. We will be providing messages via email and our twitter account http://twitter.com/@opensrsstatus will have regular updates.
The OpenSRS Team
Update 19:48 UTC
Technical teams continue to work on the issue. We will be getting our next full update at 20:00 UTC and be posting shortly after with more details.
This update is related to Incident 12933
Domain Service is Online
OpenSRS Domains Service is now fully restored.
Incident Summary:
2010-06-05 17:15 UTC: Our monitoring systems first alerted our Network
Operations Centre staff to the presence of slow connections to a
number of services and network systems .
2010-06-05 17:30 UTC: Operations staff become involved and started
working on the incident.
2010-06-05 17:45 UTC: A large number of alerts continued to show that
core network components were overloaded. Incoming traffic to our
Canadian datacenter location was more than quadruple the normal peak
traffic level. This spike in traffic saturated our upstream links. The
incident was labeled Critical and was escalated to the Executive
level.
2010-06-05 18:00 - 20:00 UTC: Using various traffic routing strategies
over primary and backup data links, our Operations staff managed to
balance all incoming data streams to our datacenter, easing pressure
on a number of core network components. After identification and
analysis, network elements were configured to drop unwanted traffic at
the network edges.
2010-06-05 20:00 - 22:00 UTC: Services delivered out of our Canadian
Toronto Datacenter were returning to normal.
2010-06-05 22:00 - 00:00 EDT: Operations staff noted that the
intensity of the unwanted incoming traffic was decreasing.
2010-06-06 01:00 UTC: Operations staff noted that the attack signature
disappeared completely from incoming data streams.
This update is related to Incident 12784
Domain Service is Degraded
OpenSRS Domains Service is now restored with the exception of Domain Forwarding.
We are keeping service Status at Degraded at this time while we work on fully restoring the complete service.
An incident report will be provided by 21:00 UTC Monday.
This update is related to Incident 12784
Domain Service is Degraded
Beginning on 2010-06-05 at 17:51 UTC UTC the OpenSRS network experienced extremely high load that overloaded our network and one of our upstream providers. Since then we have re-distributed load across a number of providers and we believe we have identified the cause of the load and mitigated its impact.
We have restored intermittent service at this time but are keeping service Status at Degraded at this time while we continue to monitor and make adjustments to fully restore service.
An incident report will be provided by 21:00 UTC Monday.
This update is related to Incident 12784
Domain Service is Offline
Beginning on 2010-06-05 at 17:51 UTC UTC the OpenSRS network experienced extremely high load that overloaded our network and one of our upstream providers. Since then we have re-distributed load across a number of providers and we believe we have identified the cause of the load and mitigated its impact.
We have restored intermittent service at this time but are keeping service Status at Offline at this time while we continue to monitor and make adjustments to fully restore service.
An incident report will be provided by 21:00 UTC Monday.
This update is related to Incident 12784
Domain Service is Offline
Our OpenSRS domains service is currently unavailable. We are currently investigating the issue.
This update is related to Incident 12784
Domain Service is Online
The OpenSRS Domains Service maintenance is complete.
Domain Service is In Maintenance
There is a four hour network maintenance window starting now (02:00 UTC). During this window, we will be conducting hardware upgrades to our main database server. The upgrade will provide us with capacity improvements as well as reduce our power footprint.
Service Impact:
OpenSRS Services will be affected approximately two hours within the four hour maintenance window.
Impact for Resellers:
The following services will be unavailable for approximately two hours within the four hour window:
* OpenSRS Provisioning and Management (includes the RWI and API: ordering, renewals, transfers, deletion and management of domain names.)
* Domain look-ups will also be unavailable.
* If you have queuing enabled, your requests will be processed once the window is complete.
The following will remain available: Whois services, Parked Pages and Managed DNS zone resolution. All domains will continue to resolve.
Impact for End-users:
Domains will continue to resolve. Domain Management will be unavailable temporarily.
Domain Service is Online
The OpenSRS Domains Service maintenance is complete.
Our technical teams advised that customers would not have experienced any service interruption during this window.
Domain Service is In Maintenance
We have an unplanned 30-minute OpenSRS Domain Service maintenance window starting now (21:30 UTC). This time will be used to further optimize the improved domain look-up code we recently released. Our technical teams will conduct preemptive, diagnostic work during this window. We are scheduling it as a precaution.
Service Impact:
While the maintenance window is scheduled to be 30 minutes, there will likely be no service interruption. Should we experience an interruption it will be less than 5 minutes.
Impact for Resellers:
Domain look-ups will be unavailable for between zero to 5 minutes during the maintenance window. All other services will be available.
Impact for End-users:
Domains will continue to resolve and WHOIS services will be available.
We apologize for the short notice and for any inconvenience for your and your customers.