Skip to content

Bump io.delta:delta-spark_2.12 from 3.3.2 to 3.3.3 - #13075

Open
dependabot[bot] wants to merge 1 commit into
mainfrom
dependabot/maven/io.delta-delta-spark_2.12-3.3.3
Open

dependabot[bot] wants to merge 1 commit into
mainfrom
dependabot/maven/io.delta-delta-spark_2.12-3.3.3

Conversation

@dependabot

@dependabot dependabot Bot commented on behalf of github Sep 21, 2026

Copy link
Copy Markdown
Contributor

Bumps io.delta:delta-spark_2.12 from 3.3.2 to 3.3.3.

Release notes

Sourced from io.delta:delta-spark_2.12's releases.

Delta Lake 3.3.3

We are pleased to announce the release of Delta Lake 3.3.3, a patch release on top of 3.3.2 with targeted fixes for Delta Sharing cache correctness, transaction log retention safety, and a Kernel Parquet-reader configuration bug, plus a Delta Sharing client upgrade.

Note: this patch release does not publish delta-iceberg (UniForm/Iceberg support) — see Delta UniForm below for details and follow-up plan.

Highlights

  • [Spark] Fix transaction log retention during metadata cleanup: Log cleanup could previously delete transaction log files still needed to reconstruct table versions within the retention window on tables with infrequent commits/checkpoints, breaking time travel and CDF reads.
  • [Delta Sharing] Fix deletion vector cache refresh bug: Cache refresh could drop deletion-vector fileId→URL mappings, causing long-running queries against shared DV tables to fail with "file id not found" errors.
  • [Delta Sharing] Upgrade delta-sharing-client 1.2.2 → 1.2.8: Picks up more resilient OAuth token parsing and improved retry/error-reporting behavior.
  • [Spark] Add RANDOMIZE_FILE_PREFIXES support: Wires up the previously-declared delta.randomizeFilePrefixes / delta.randomPrefixLength table properties on the write path, to spread S3 object keys for high-throughput workloads. Opt-in; default behavior unchanged.
  • [Spark] Fix Spark 3.5.6 compatibility for TRUNCATE TABLE: Spark 3.5.6 tightened V2Writes validation; Delta tables now correctly declare TRUNCATE/OVERWRITE_BY_FILTER capability.
  • [Kernel] Fix missing Hadoop configuration in Parquet reader: The Hadoop Configuration was not being passed when Kernel opened Parquet footers, so custom filesystem/credential settings could be silently ignored.

Delta Spark

Delta Spark 3.3.3 is built on Apache Spark 3.5.6. Maven artifacts are published for both Scala 2.12 and 2.13.

Fixes and changes in this release:

  • Fix transaction log retention during metadata cleanup: Delete eligible log files only if a newer checkpoint exists before the retention cutoff, so time travel and CDF reads to retained versions keep working. Tables with a low commit/checkpoint rate may retain log files slightly beyond the nominal cutoff as a result.
  • Add RANDOMIZE_FILE_PREFIXES support: delta.randomizeFilePrefixes / delta.randomPrefixLength table properties are now honored on writes, placing new data files under a random subdirectory prefix to spread S3 request load. Opt-in; default write path is unchanged.
  • Fix Spark 3.5.6 compatibility for TRUNCATE TABLE: StagedDeltaTableV2 now implements SupportsTruncate and declares TRUNCATE/OVERWRITE_BY_FILTER capabilities, fixing TRUNCATE TABLE under Spark 3.5.6's stricter V2Writes validation.

Delta Kernel

The Delta Kernel project is a set of Java libraries for building Delta connectors without needing to implement the Delta protocol directly.

Fixes in this release:

  • Fix missing Hadoop configuration parameter when creating the Parquet reader: A follow-up to an earlier IllegalAccessError fix had dropped the Hadoop Configuration when constructing the ParquetReader used to read footers, so custom Hadoop filesystem settings could be ignored during Kernel reads.

Delta UniForm

Delta UniForm's delta-iceberg and delta-hudi modules keep Apache Iceberg and Apache Hudi metadata in sync with Delta commits.

  • delta-iceberg is not published in 3.3.3. There will be no delta-iceberg artifact in this release. There are no changes to delta-iceberg from the previous version. Existing delta-iceberg_2.12/delta-iceberg_2.13 v3.3.2 artifacts remain available and are forward-compatible with delta-spark 3.3.3.
  • Maven artifacts:

... (truncated)

Commits
  • 0ce5dd9 [Release] Bump version to 3.3.3 for release (#7424)
  • 6cba1d7 [Branch-3.3] Fix javadoc HTML errors + add -DskipDeltaIceberg build flag (#7411)
  • 73cc8cb [Branch-3.3][Delta Sharing] Upgrade delta-sharing-client to 1.2.8 (#7419)
  • 7e7b8ce [Branch-3.3] Bump build dependency versions for JDK 17 and Maven Central comp...
  • 8643554 [Spark][CherryPick][3.3] Fix metadata cleanup by retaining files required for...
  • 23609ba [Branch-3.3][Delta Sharing] Ensure deletion vector fileId-URL entries are pre...
  • 37f4f36 [CI] Add branch filter to branch-3.3 workflows (#6418)
  • a7f222c [Spark][CherryPick][3.3] Support RANDOMIZE_FILE_PREFIXES (#5263)
  • 80b9ad9 Fix Spark 3.5.6 compatibility: Add truncate with overwrite support to StagedD...
  • 4070076 [Spark] [Test] [3.3] Fix curl call to follow redirects (#5133)
  • Additional commits viewable in compare view

Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Bumps [io.delta:delta-spark_2.12](https://github.com/delta-io/delta) from 3.3.2 to 3.3.3.
- [Release notes](https://github.com/delta-io/delta/releases)
- [Commits](delta-io/delta@v3.3.2...v3.3.3)

---
updated-dependencies:
- dependency-name: io.delta:delta-spark_2.12
  dependency-version: 3.3.3
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
@dependabot dependabot Bot added dependencies Pull requests that update a dependency file java Pull requests that update java code labels Sep 21, 2026
@github-actions github-actions Bot added the CORE works for Gluten Core label Sep 21, 2026
@github-actions

Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CORE works for Gluten Core dependencies Pull requests that update a dependency file java Pull requests that update java code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants