Spark 4.1 upgrade#7422

Draft

junmuz wants to merge 3 commits intoapache:masterfrom

junmuz:spark_upgrade

Commits on Mar 13, 2026

Initial implementation of the Spark 4.1 functionality

junmuz
authored and
ymuzammil
committed

Commits on Mar 16, 2026

Spark 4.1 test changes made

junmuz
authored and
ymuzammil
committed
Updating Scala lib version and test signature fixes

junmuz
authored and
ymuzammil
committed