Another update:
We don't have an official word from AWS but all the builds are back to normal. Our fallback infrastructure is performing normally as well.
All the previously queued builds have also completed executing.
An update on this issue:
1. We increased the capacity of our primary infrastructure to reduce the chances of a fallback.
2. We heard back from AWS that the root cause will be fixed in an hour or two.