Skip to content

Pin Dataproc 2.2 Ubuntu presubmit image#1393

Closed
nvliyuan wants to merge 2 commits into
GoogleCloudDataproc:mainfrom
nvliyuan:fix-pin-dataproc-2-2-ubuntu22-image-main
Closed

Pin Dataproc 2.2 Ubuntu presubmit image#1393
nvliyuan wants to merge 2 commits into
GoogleCloudDataproc:mainfrom
nvliyuan:fix-pin-dataproc-2-2-ubuntu22-image-main

Conversation

@nvliyuan
Copy link
Copy Markdown
Contributor

Summary

  • Pins the Dataproc 2.2 Ubuntu presubmit job to 2.2.81-ubuntu22 to avoid the current 2.2.82-ubuntu22 DKMS failure with nvidia-driver-550-open on 6.8.0-1058-gcp.
  • Updates the test helper to treat patch-level 2.2 images such as 2.2.81-ubuntu22 as 2.2 images for the existing public IP behavior.

Test plan

  • IDE lint check for edited files
  • Running bazel test --jobs=1 --local_test_jobs=1 --flaky_test_attempts=1 --action_env=INTERNAL_IP_SSH=true --test_output=errors --test_arg=--image_version=2.2.81-ubuntu22 rapids:test_rapids on yuanli@spark-yuanli:~/work/csps/dataproc/ci-fix-validation/initialization-actions

Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request pins the Dataproc 2.2 Ubuntu image version to 2.2.81-ubuntu22 in the Cloud Build configuration to bypass a DKMS issue with nvidia-driver-550-open on the 6.8.0-1058-gcp kernel. To support this specific version pinning in integration tests, the exact list match for IMAGE_VERSION_2_2 is replaced with a regular expression pattern (IMAGE_VERSION_2_2_PATTERN) that matches both minor and patch versions of Dataproc 2.2 images. There are no review comments, and I have no feedback to provide.

@nvliyuan
Copy link
Copy Markdown
Contributor Author

Closing this workaround PR. The fix should be made in spark-rapids.sh instead of pinning the presubmit image.

@nvliyuan nvliyuan closed this May 28, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant