Friday, July 31, 2009

Resolved -- Level3 Network Issue

At approximately 01:10 PDT we noticed a sharp decline in traffic on our Level3 connection.  Traffic returned at approximately 01:30 PDT and we are currently investigating the cause.

RFO
Level 3 was performing a scheduled maintenance in their internal network during which they inadvertently black-holed all our inbound and outbound traffic for around 20 minutes.  Our traffic didn’t get automatically re-routed through other carriers because our BGP session with our next-hop router at Level 3 stayed up.

Wednesday, July 29, 2009

GoGrid API Upgrade

We are doing an upgrade of our API infrastructure today at 6PM PST.  There should  be no interruption to your API service as a result

Tuesday, July 28, 2009

Completed -- GoGrid Emergency Border Router Maintenance

We've discovered a failed power supply on our second border router which will be replaced tonight at 21:00 PDT.

No downtime is expected.

Wednesday, July 22, 2009

Resolved -- Issues Starting Servers

The issue with starting servers has been resolved.  The handful of affected customers will receive further information in an official Reason for Outage.

Completed -- Emergency GoGrid System Maintenance

Maintenance Window:
Wednesday, July 22, 2009 10:00 - 10:30 PDT
(Wednesday, July 22, 2009 17:00 - 17:30 GMT)


Customer Impact:
Servers on the affected node will be rebooted during the emergency maintenance. Email notifications have been sent to the affected customers.


Maintenance Details:
GoGrid has discovered a problem with the hardware you are hosted on. In order to resolve the issue and to avoid further instability, we will need to reboot the node.


=== IMPORTANT ===
In order for GoGrid to perform this maintenance, please take a moment to update the "Password" section of the https://my.gogrid.com portal (in the "Support" tab) with the current username and password for each affected system listed. If no valid credentials are provided then GoGrid staff will be unable to gracefully shutdown your system.


If there are any additional questions before, during or following the maintenance, please direct them to the GoGrid Support Center at 877-9-GOGRID (877-946-4743). You may also reply to the email notification you received. We apologize for the short notice.

Tuesday, July 21, 2009

Completed -- UPS Maintenance

*** Update 7/29 @ 16:00 PDT ***
The UPS maintenance has been extended to 19:00 PDT.

Maintenance Windows:
Monday, July, 27 2009 10:00 - 17:00 PDT
(Monday, July, 27 2009 17:00  - 00:00 GMT)

Tuesday, July, 28 2009 10:00 - 17:00 PDT
(Tuesday, July, 28 2009 17:00  - 00:00 GMT)

Wednesday, July, 29 2009 10:00 - 17:00 PDT
(Wednesday, July, 29 2009 17:00  - 00:00 GMT)

Customer Impact:
There should be no impact to the power in the facility and no down time is expected.  This is an advisory notice

Maintenance Details:
UPS systems will be undergoing standard quarterly maintenance.

If there are any additional questions before, during, or following the maintenance please direct them to GoGrid Support at 1-866-946-4743 or 415-869-7444 option 2.  You may also open a support case at http://my.gogrid.com.

Thursday, July 9, 2009

Resolved -- GoGrid API

** Update @ 19:00 PDT **
API hotfix was successfully applied at 19:00 PDT. The API behavior is now correct and the expected delete response is returning.

Our most recent release introduced a minor bug in API functionality. API Delete operations are currently not returning the correct response. This is affecting all output formats: JSON, XML, and CSV. API delete calls will delete objects properly, but not send a complete API response back. This may affect API code that parses delete responses and expects the documented API response. We expect a hot fix will be scheduled shortly. This entry will be updated when we have more details.

Tuesday, July 7, 2009

Resolved -- GoGrid API

** Update @ 18:30 PDT **
An API hotfix was successfully applied at 18:30 PDT.  API behavior is now correct and all listed items are returned for all API calls returning data sets over 100 items in length.

Our most recent release introduced a minor bug in API functionality.  Returned data lists greater than 100 entries may be truncated.  This will usually occur when listing private IP addresses via the API.  You will not be impacted unless using the API to return lists larger than 100 entries (such as Private IPs or Jobs history).  We expect a hotfix to be scheduled shortly.  We will update this post again when we have more details.

Friday, July 3, 2009

Resolved -- Online orders on hold

Currently, orders made through www.gogrid.com are being put on hold due to an outage authorize.net, our credit card transaction provider, is having. The orders are in the system though, so we will process the orders manually as soon as possible.

Wednesday, July 1, 2009

GoGrid Portal and API Maintenance

Maintenance is complete, thank you for your co-operation.

**Update @ 1:30 AM PDT
Maintenance window has been extended till 01:45 am PDT.

**Update @ 12:58 AM PDT

Maintenance window has been extended till 01:30 am PDT.

**Update @ 11:58 PM PDT
Maintenance window has been extended till 01:00 am PDT.

Maintenance Window:


Wednesday, July 1st, 19:00 - 23:59 PDT
(Thursday, July 2nd, 02:00 - 06:59 GMT )


Customer Impact:

The GoGrid "my.gogrid.com" customer portal and API will be unavailable for up to 5 hours while we upgrade our infrastructure. There will be no impact to existing GoGrid VMs, load balancers or cloud storage during this time.


Maintenance Details:

GoGrid is making software improvements to the GoGrid customer portal and API.


Inquiries:


If there are any additional questions before, during or following the maintenance, please direct them to the GoGrid Support Center at 1-415-869-7444 or 1-877-9Go-Grid (877-946-4743).

For the latest details on GoGrid systems & Data Center status, please visit our blog:
http://www.GoGridStatus.com

Sincerely,
The GoGrid Team