Search results

[SPARK-52539][CONNECT] Introduce session hooks

CONNECT

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51233

#51233 In apache/spark;

· niklasmohrin opened on Jun 20, 2025

[SPARK-52534][ML][CONNECT] Make MLCache and MLHandler thread-safe

CONNECT

ML

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51226

#51226 In apache/spark;

· WeichenXu123 opened on Jun 20, 2025

[DRAFT][PYTHON] Improve Python UDF Arrow Serializer Performance

CORE

DOCS

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51225

#51225 In apache/spark;

· asl3 opened on Jun 19, 2025

[Test]

CONNECT

DOCS

ML

MLLIB

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51221

#51221 In apache/spark;

· WeichenXu123 opened on Jun 19, 2025

[SPARK-52528][PS] Enable divide-by-zero for numeric mod with ANSI enabled

PANDAS API ON SPARK

PYTHON

Status: Open (in progress).

apache/sparknumber 51219

#51219 In apache/spark;

· xinrong-meng opened on Jun 18, 2025

[SPARK-52444][SQL][Connect] Add support for Variant/Char/Varchar Literal

CONNECT

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51215

#51215 In apache/spark;

· dengziming opened on Jun 18, 2025

[SPARK-52503][SQL][CONNECT] Fix <code>drop</code> when the input column is not existent

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51196

#51196 In apache/spark;

· zhengruifeng opened on Jun 17, 2025

[WIP][SPARK-52394][PS] Fix autocorr divide-by-zero error under ANSI mode

PANDAS API ON SPARK

PYTHON

Status: Open (in progress).

apache/sparknumber 51192

#51192 In apache/spark;

· xinrong-meng opened on Jun 16, 2025

Better do idle python workers cleanup

CORE

PYTHON

Status: Draft (not ready).

apache/sparknumber 51143

#51143 In apache/spark;

· antban opened on Jun 10, 2025

[SPARK-52424][TESTS] Add unit test to verify in Spark Connect, Column object defined outside of a function can be referenced properly.

PYTHON

STRUCTURED STREAMING

Status: Open (in progress).

apache/sparknumber 51101

#51101 In apache/spark;

· haoyangeng-db opened on Jun 5, 2025

[MINOR] Improve documentation of concat functions in pyspark

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51086

#51086 In apache/spark;

· frapa opened on Jun 4, 2025

[WIP][PS] Enable divide-by-zero for boolean floordiv with ANSI enabled

PANDAS API ON SPARK

PYTHON

Status: Open (in progress).

apache/sparknumber 51079

#51079 In apache/spark;

· xinrong-meng opened on Jun 3, 2025