Skip to content

feat: add release 0.0.0 version substitution to run configuration and updat…#163

Open
omkargaikwad23 wants to merge 6 commits intomainfrom
release-please--ci_evals_test
Open

feat: add release 0.0.0 version substitution to run configuration and updat…#163
omkargaikwad23 wants to merge 6 commits intomainfrom
release-please--ci_evals_test

Conversation

@omkargaikwad23
Copy link
Copy Markdown
Contributor

…e cloudbuild environment variables

@omkargaikwad23 omkargaikwad23 requested review from a team as code owners April 24, 2026 06:59
@github-actions github-actions Bot requested a review from isaurabhuttam April 24, 2026 06:59
@omkargaikwad23 omkargaikwad23 added autorelease: triggered Release please has triggered a release for this. and removed autorelease: triggered Release please has triggered a release for this. labels Apr 24, 2026
@omkargaikwad23 omkargaikwad23 changed the title feat: add release version substitution to run configuration and updat… feat: add release 0.0.0 version substitution to run configuration and updat… Apr 24, 2026
Comment thread evals/run_config.yaml
# limitations under the License.

extension_id: cloud-sql-postgresql
release_version: ${RELEASE_VERSION}
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we should use separate yaml file this can be confusing we want to have standard config files across evalbench

Comment thread cloudbuild.yaml
- versionName: projects/$PROJECT_ID/secrets/daily-ci-evals-db-password/versions/latest
env: 'DB_PASSWORD'
- versionName: projects/$PROJECT_ID/secrets/GITHUB_TOKEN/versions/latest
env: 'GITHUB_TOKEN' No newline at end of file
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit add a new line

Comment thread cloudbuild.yaml

# Fetch PR data using curl approach
PR_DATA=$(curl -s -H "Authorization: token $$GITHUB_TOKEN" \
"https://api.github.com/repos/$REPO_FULL_NAME/pulls/$_PR_NUMBER")
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

if the curl call fails (e.g., bad token, rate limit), PR_DATA will be empty and RELEASE_VERSION silently becomes "unknown". Consider adding a check on the HTTP status.

Comment thread cloudbuild.yaml
"https://api.github.com/repos/$REPO_FULL_NAME/pulls/$_PR_NUMBER")

# Extract labels and title from PR data (Use $$ to escape bash variables)
PR_LABELS=$(echo "$$PR_DATA" | jq -r '.labels[].name' | paste -sd ',')
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Behavior might differ on some linux machines for: paste -sd ','

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

autorelease: triggered Release please has triggered a release for this.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants