Repository navigation
Serve 100% of tag-page-rendering PROD from ECS - #16908
Merged
Merged
Conversation
SiAdcock
approved these changes
Oct 9, 2026
At 3 tasks and 100% traffic, ECS latecy averaged 300ms. This is quite high compared to EC2 which averages around 40ms. This change over-provisions to 12 tasks in an attempt to mitigate high latency. Co-authored-by: Connor O'Malley<connoromalleyatwork@users.noreply.github.com>
akash1810
force-pushed
the
tag-page-rendering-ecs-100-try-2
branch
from
October 9, 2026 13:01
3670585 to
082bc93
Compare
🚀 Image pushed to AWS ECRImage digest: 🐛 Run the image locallyThe following can be used to run the image locally: # Refer to image using the immutable digest. Find alternatives below.
IMAGE_IDENTIFIER="@sha256:345db3e723a3fab88f92e76545e54b76fb92cdada65be814b8239255614ea3f5"
# Refer to image using branch tag
# IMAGE_IDENTIFIER=":branch-tag-page-rendering-ecs-100-try-2"
# Refer to image using build tag
# IMAGE_IDENTIFIER=":build-32222"
# Set environment variables for the AWS CLI
AWS_PROFILE="<A_PROFILE_FROM_JANUS>"
AWS_DEFAULT_REGION="eu-west-1"
IMAGE_ACCOUNT_ID=$(aws ssm get-parameter --name /organisation/accounts/artifacts --query "Parameter.Value" --output text)
REGISTRY="${IMAGE_ACCOUNT_ID}.dkr.ecr.${AWS_DEFAULT_REGION}.amazonaws.com"
IMAGE="${REGISTRY}/guardian/dotcom-rendering/dotcom-rendering${IMAGE_IDENTIFIER}"
# Login to AWS ECR https://docs.aws.amazon.com/AmazonECR/latest/userguide/registry_auth.html
aws ecr get-login-password | docker login --username AWS --password-stdin $REGISTRY
# Pull the image
docker pull $IMAGE
# Run the image. You'll likely need to set additional flags. See https://docs.docker.com/reference/cli/docker/container/run.
docker run $IMAGEFrom guardian/actions-ecr. |
|
Seen on PROD (merged by @akash1810 6 minutes and 43 seconds ago) Please check your changes! |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.

What does this change?
This change routes all traffic for tag-page-rendering in PROD to ECS. Previous attempts at this (#16774) were reverted (#16776) due to an issue with assets on the CDN (see also #16808). The root cause of that issue has now been addressed (#16821) so let's try again!
This change also increases the minimum tasks to 12. At 3 tasks and 100% traffic, ECS latency averaged 300ms. This is quite high compared to EC2 which averages around 40ms. This change over-provisions to 12 tasks in an attempt to mitigate high latency; we'll tune this once we have data for how its performing.
How has this change been tested?
Not possible, as this changes PROD infrastructure.
After deploying, things to check are:
Co-authored by: @connoromalleyatwork.