Skip to content

Running Gitlab jobs based on upstream pipeline existence #700

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
rithikanarayan merged 15 commits into from
Dec 16, 2025
Merged

Running Gitlab jobs based on upstream pipeline existence #700

Show file tree
Hide file tree
Changes from 12 commits
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
1e5bd20
Running Gitlab jobs based on upstream pipeline existence
rithikanarayan Dec 11, 2025
092d5df
check value of env var
rithikanarayan Dec 11, 2025
230f9d0
more prints
rithikanarayan Dec 12, 2025
ead0a9a
removing gate on e2e tests
rithikanarayan Dec 12, 2025
1e53455
another print
rithikanarayan Dec 12, 2025
d18c5cd
print
rithikanarayan Dec 12, 2025
490944f
using upstream project name variable
rithikanarayan Dec 12, 2025
50e9421
colons
rithikanarayan Dec 12, 2025
14e4cae
when on success
rithikanarayan Dec 12, 2025
021eb23
Replace commit branch with project name
rithikanarayan Dec 12, 2025
b1632a2
force fail
rithikanarayan Dec 12, 2025
93d9191
remove force fail
rithikanarayan Dec 16, 2025
c8555e9
Use skip e2e tests global variable
rithikanarayan Dec 16, 2025
a70aaf6
check skip_e2e_test=true explicitly
rithikanarayan Dec 16, 2025
62f63e9
make variable a string
rithikanarayan Dec 16, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 3 additions & 1 deletion .gitlab-ci.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -25,5 +25,7 @@ build-layers:
- artifact: ci/build-pipeline.yaml
job: generator
strategy: depend
forward:
pipeline_variables: true
rules:
- when: on_success
- when: on_success
20 changes: 20 additions & 0 deletions ci/input_files/build.yaml.tpl
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -111,6 +111,8 @@ sign-layer ({{ $runtime.name }}-{{ $runtime.arch }}):
tags: ["arch:amd64"]
image: registry.ddbuild.io/images/docker:20.10-py3
rules:
- if: $UPSTREAM_PROJECT_NAME == "dd-trace-py"
when: never
- if: '$CI_COMMIT_TAG =~ /^v.*/'
when: manual
needs:
Expand Down Expand Up @@ -142,6 +144,8 @@ publish-layer-{{ $environment_name }} ({{ $runtime.name }}-{{ $runtime.arch }}):
tags: ["arch:amd64"]
image: registry.ddbuild.io/images/docker:20.10-py3
rules:
- if: $UPSTREAM_PROJECT_NAME == "dd-trace-py"
when: never
- if: '"{{ $environment_name }}" == "sandbox" && $REGION == "{{ $e2e_region }}" && "{{ $runtime.arch }}" == "amd64"'
when: on_success
- if: '"{{ $environment_name }}" == "sandbox"'
Expand Down Expand Up @@ -188,6 +192,8 @@ publish-pypi-package:
before_script: *python-before-script
cache: []
rules:
- if: $UPSTREAM_PROJECT_NAME == "dd-trace-py"
when: never
- if: '$CI_COMMIT_TAG =~ /^v.*/'
when: manual
needs: {{ range $runtime := (ds "runtimes").runtimes }}
Expand All @@ -200,6 +206,10 @@ layer bundle:
stage: build
tags: ["arch:amd64"]
image: registry.ddbuild.io/images/docker:20.10
rules:
- if: $UPSTREAM_PROJECT_NAME == "dd-trace-py"
when: never
- when: on_success
needs:
{{ range (ds "runtimes").runtimes }}
- build-layer ({{ .name }}-{{ .arch }})
Expand All @@ -223,6 +233,8 @@ signed layer bundle:
image: registry.ddbuild.io/images/docker:20.10-py3
tags: ["arch:amd64"]
rules:
- if: $UPSTREAM_PROJECT_NAME == "dd-trace-py"
when: never
- if: '$CI_COMMIT_TAG =~ /^v.*/'
needs:
{{ range (ds "runtimes").runtimes }}
Expand All @@ -247,6 +259,10 @@ e2e-test:
trigger:
project: DataDog/serverless-e2e-tests
strategy: depend
rules:
- if: $UPSTREAM_PROJECT_NAME == "dd-trace-py"
when: never
- when: on_success
variables:
LANGUAGES_SUBSET: python
# These env vars are inherited from the dotenv reports of the publish-layer jobs
Expand All @@ -267,6 +283,10 @@ e2e-test-status:
image: registry.ddbuild.io/images/docker:20.10-py3
tags: ["arch:amd64"]
timeout: 3h
rules:
- if: $UPSTREAM_PROJECT_NAME == "dd-trace-py"
when: never
- when: on_success
script: |
GITLAB_API_TOKEN=$(aws ssm get-parameter --region us-east-1 --name "ci.${CI_PROJECT_NAME}.serverless-e2e-gitlab-token" --with-decryption --query "Parameter.Value" --out text)
URL="${CI_API_V4_URL}/projects/${CI_PROJECT_ID}/pipelines/${CI_PIPELINE_ID}/bridges"
Expand Down
Loading