[SPARK-59599][SQL] Pre-size the ArrowConverters.serializeBatch output buffer to avoid repeated reallocation - #58876

Open

david-mollitor-db wants to merge 2 commits into

apache:masterfrom

david-mollitor-db:arrow-serializebatch-presize

Commits on Sep 17, 2026

[SPARK-59599][SQL] Pre-size the ArrowConverters.serializeBatch output buffer to avoid repeated reallocation

david-mollitor-db
and
Isaac
committed
0acd7fe
[SPARK-59599][SQL] Reuse the pre-sized serializeBatch in the Arrow columnar cache serializer

david-mollitor-db
and
Isaac
committed
3f6e5c6