Region Outages

This topic explains regional outages and your options for dealing with them.

Overview

Zencoder transcodes using Amazon Elastic Compute Cloud (EC2). The service hosts virtual machine (VM) instances in multiple regions and you can select the service/region using the region option.

There are many reasons you may want to select a specific service or region, but perhaps the most important is transfer costs. Our customers commonly use Amazon Simple Storage Service (S3) or Google Cloud Storage (GCS) to store files. Transferring files into S3 and GCS (ingress) is free. Transferring files out of these services (egress), however, depends on the destination. In both services egress is free if the file is transferred to a VM instance in the same region. This means that transfers from US-East S3 buckets to US-East EC2 instances are free. Transfer costs to other destinations vary by service, but in both cases costs can add up quickly so selecting an appropriate service and region for transcoding is important.

Every service suffers outages from time to time. Sometimes networks are spotty and we have to retry requests or transfers. Sometimes VM instances fail and we have to move the work assigned to them to better-behaved instances. We even provide a guide on what to do in case Zencoder itself is broken. Some things are out of our control, however, such as an entire EC2 region going down for hours. In times like these we would love nothing more than to automatically fail over to another service or region for our customers, but due to potential transfer costs we have decided not to.

Options

What should I do when a region is down?

  • Wait. Region outages are often partial or last for a short period of time. If you can wait, you should.
  • Submit to another region. If you can afford the transfer costs on EC2 you can submit your outstanding jobs to another region. Be sure to cancel the jobs submitted for the region that is down.
  • Submit to another service. There may be cases, however rare, where more than a single region is down. Again, if you can afford the transfer costs you can submit your outstanding jobs to another service. As with submitting to another region, be sure to cancel the jobs submitted for the service that is down.