Remove redundant closeOperation for abandoned executions#54924

Closed

terana wants to merge 65 commits intoapache:masterfrom

terana:remove-redundant-closeop

Commits on Mar 20, 2026

Remove redundant closeOperation for abandoned executions
terana
committed

Commits on Mar 23, 2026

[SPARK-55728][SS] Introduce conf for file checksum threadpool size and support disabling the threadpool

gnanda-db
authored and
terana
committed
[SPARK-55645][SQL][FOLLOWUP] Move serdeName to last parameter and filter empty strings

cloud-fan
authored and
terana
committed
[SPARK-56031][SQL] Make Natural Join column matching respect case sensitivity conf

stefankandic
authored and
terana
committed
[SPARK-55056][SQL][PYTHON][TEST] Add tests using Arrow to deserialize nested array with empty outer array

Yicong-Huang
authored and
terana
committed
[SPARK-56043][SQL] Wrap NullPointerException from Avro 1.12.x ParseContext.resolve() in SchemaParseException

jerrypeng
authored and
terana
committed
[SPARK-55948][SQL] Add DSv2 CDC connector API, analyzer resolution, and SQL CHANGES clause

gengliangwang
authored and
terana
committed
[SPARK-47997][PS] Add errors parameter to DataFrame.drop and Series.drop

devin-petersohn
authored and
terana
committed
[SPARK-50111][PYTHON] Add subplots support for pie charts in Plotly backend

RishbhaJain
authored and
terana
committed
[SPARK-53675][PYTHON] Add str support in withColumn and withColumns in PySpark

ZoeyeoZ
authored and
terana
committed
[SPARK-50284][PYTHON] Change docs for parseJson function

judycheung-piaopiao
authored and
terana
committed
[SPARK-56011][PYTHON][INFRA] Add python/asv wrapper script for running benchmarks from repo root

Yicong-Huang
authored and
terana
committed
[SPARK-56023][SS] Better load balance in LowLatencyMemoryStream

eason-yuchen-liu
authored and
terana
committed
[SPARK-56062][PYTHON] Isolate memory_profiler to improve import time

gaogaotiantian
authored and
terana
committed
[SPARK-55577][PYTHON] Refactor SQL_SCALAR_ARROW_ITER_UDF wrapper, mapper, and serializer logic

Yicong-Huang
authored and
terana
committed
[SPARK-56060][PS] Handle pandas 3 null string conversion in describe() for empty timestamp frames

ueshin
authored and
terana
committed
[SPARK-56049][UI] Add search/filter for metrics in SQL plan viz side panel

yaooqinn
authored and
terana
committed
[SPARK-56056][PYTHON] Support simpler worker profiling with viztracer

gaogaotiantian
authored and
terana
committed
Revert "[SPARK-53675][PYTHON] Add str support in withColumn and withColumns in PySpark"

HyukjinKwon
authored and
terana
committed
[SPARK-55059][PYTHON] Remove empty table workaround in toPandas

Yicong-Huang
authored and
terana
committed
[SPARK-56020][SQL] Improve `GroupPartitions` Spark UI

szehon-ho
authored and
terana
committed
[SPARK-56073][PYTHON][SQL] Simplify the build of `PythonRunnerConfMap`

zhengruifeng
authored and
terana
committed
[SPARK-55723][PYTHON] Generalize enforce_schema error to PySparkTypeError

Yicong-Huang
authored and
terana
committed
[SPARK-56048][UI] Add copy plan text and share link buttons to SQL execution page

yaooqinn
authored and
terana
committed
[SPARK-55983][SQL][FOLLOW-UP] New single-pass analyzer functionality and bugfixes

mihailotim-db
authored and
terana
committed
[SPARK-56075][PYTHON] Remove a batch of dead python error classes

zhengruifeng
authored and
terana
committed
[SPARK-55887][CONNECT][FOLLOWUP] Fix flaky SparkConnectServiceSuite limit/tail tests

LuciferYang
authored and
terana
committed
[SPARK-55147][SS] Scope timestamp range for time-interval join retrieval in V4 state format

nicholaschew11
authored and
terana
committed
[SPARK-55145][SS] Support Avro for timestamp based RocksDB state key encoders

HeartSaVioR
authored and
terana
committed
[SPARK-56018][PYTHON] Use ruff as formatter

gaogaotiantian
authored and
terana
committed
[SPARK-56050][SQL] Eagerly resolve IDENTIFIER() with string literals at parse time

cloud-fan
authored and
terana
committed
[SPARK-55667][PYTHON][CONNECT][FOLLOWUP] Detect REPL for doctest check

gaogaotiantian
authored and
terana
committed
[SPARK-56081][PS] Align idxmax and idxmin NA handling with pandas 3

ueshin
authored and
terana
committed
[SPARK-56080][PS] Align Series.argmax/argmin with pandas 3.0 NA handling

ueshin
authored and
terana
committed
[SPARK-55949][SQL][CONNECT] Add DataFrame API and Spark Connect support for CDC queries

gengliangwang
authored and
terana
committed
[SPARK-56044][CORE] HistoryServerDiskManager does not delete app store on release when app is not in active map

Shuai Lu
authored and
terana
committed
[SPARK-56047][SQL] Propagate `distinctCount` through Union in CBO statistics estimation

LuciferYang
authored and
terana
committed
[SPARK-55686][CORE] SizeEstimator takes care of Compact Object Headers

pan3793
authored and
terana
committed
[SPARK-55751][SS] Add metrics on state store loads from DFS

gnanda-db
authored and
terana
committed
[SPARK-55799][PYTHON][TESTS][FOLLOW-UP] Disable some expensive tests for data source simple worker

gaogaotiantian
authored and
terana
committed
[SPARK-56035][SQL] Introduce `AggregationValidator ` for single-pass resolver `Aggregate` validation

mihailoale-db
authored and
terana
committed
[SPARK-55848][SQL][TESTS] Add regression tests for SPJ partial clustering dedup

naveenp2708
authored and
terana
committed
[SPARK-56098][BUILD] Upgrade `mockito-core` to 5.23.0 and use `mockito-5-18`

dongjoon-hyun
authored and
terana
committed
[SPARK-56032][SQL] Support subexpression elimination in `FilterExec` whole-stage codegen

LuciferYang
authored and
terana
committed
[SPARK-56101][INFRA] Upgrade `flatted` to 3.4.2

LuciferYang
authored and
terana
committed
[SPARK-55809][CORE] HeapHistogram uses DiagnosticCommandMBean instead of jmap subprocess

pan3793
authored and
terana
committed
[SPARK-56102][SQL] `UnionEstimation` code cleanup

peter-toth
authored and
terana
committed
[SPARK-56104][BUILD] Upgrade `junit` to 6.0.3

dongjoon-hyun
authored and
terana
committed
[SPARK-55719][SQL] Remove deprecation warning for spark.sql.hive.convertCTAS

allisonwang-db
authored and
terana
committed
[SPARK-56020][SQL][FOLLOW-UP] Use `Reducer.displayName()` in `GroupPartitions` textual representation

peter-toth
authored and
terana
committed
[SPARK-55999][SS] Enable forceSnapshotUploadOnLag by default

zifeif2
authored and
terana
committed
[SPARK-56126][INFRA] Sync `docker`-related GitHub Actions versions to the ASF approved patterns

dongjoon-hyun
authored and
terana
committed
[SPARK-56111][CORE] Add SparkContext.isDriver() and use it across the codebase

cloud-fan
authored and
terana
committed
[SPARK-56018][PYTHON][FOLLOW-UP] Disable black check by default

ueshin
authored and
terana
committed
[SPARK-56118][PS] Match pandas 3.0 bool handling in GroupBy.quantile

ueshin
authored and
terana
committed
[SPARK-56122][PS] Use pandas-aware numeric dtype check in Series.cov

ueshin
authored and
terana
committed
[SPARK-56089][SQL] Align asinh/acosh with fdlibm algorithm for cross-engine compatibility

xiaoxuandev
authored and
terana
committed
[SPARK-56046][SQL] Typed SPJ partition key `Reducer`s

peter-toth
authored and
terana
committed
[SPARK-55806][DOCS] add section for running `pyspark` with `uv` inline dependencies

markjm
authored and
terana
committed
[SPARK-56113][PS] Improve pandas 3 string restoration in pandas-on-Spark

ueshin
authored and
terana
committed
[SPARK-56128][K8S] Use Java `21-jre` instead of `21` image in K8s Dockerfile

dongjoon-hyun
authored and
terana
committed
[SPARK-55610][PYTHON] Add getExecutorInfos to StatusTracker in Python

WweiL
authored and
terana
committed
[SPARK-55875][UI] Switch SQL tab query listing to client-side DataTables

yaooqinn
authored and
terana
committed
[SPARK-56143][WEBIUI] Remove `jquery.cookies`

sarutak
authored and
terana
committed
[SPARK-56135][DOCS] Add option to use venv in PySpark docs

Yicong-Huang
authored and
terana
committed