Skip to content

Pull requests: apache/spark

New pull request New
Clear current search query, filters, and sorts
219 Open 52,551 Closed
219 Open 52,551 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[SPARK-54135][INFRA][4.1] Add GitHub Action jobs for branch-4.1 INFRA
#52834 opened Nov 2, 2025 by dongjoon-hyun Loading… updated Nov 2, 2025
1
[SDP][SPARK-52463] Add support for cluster_by in Python Pipelines APIs CONNECT PYTHON SQL
#52831 opened Nov 2, 2025 by sryza • Draft updated Nov 2, 2025
[SPARK-54134][SQL] Optimize Arrow memory usage BUILD PYTHON SQL
#52747 opened Oct 27, 2025 by viirya Loading… updated Nov 2, 2025
11
[SPARK-51359][CORE][SQL] Set INT64 as the default timestamp type for Parquet files SQL Stale
#50215 opened Mar 8, 2025 by ganeshashree Loading… updated Nov 2, 2025
11
[SPARK-52617][SQL] Cast TIME to/from TIMESTAMP_NTZ SQL Stale
#51381 opened Jul 5, 2025 by SubhamSinghal Loading… updated Nov 2, 2025
42
approx_top_k_combine SQL Stale
#51393 opened Jul 7, 2025 by yhuang-db • Draft updated Nov 2, 2025
1
[SPARK-54110][Geo][SQL] Introduce type encoders for Geography and Geometry types SQL
#52813 opened Oct 31, 2025 by uros-db Loading… updated Nov 1, 2025
6
Feature/spark 47230 add posexplode support BUILD SQL
#52598 opened Oct 13, 2025 by IgorBerman • Draft updated Nov 1, 2025
[SPARK-54132][SQL][TESTS] Cover HashedRelation#close in HashedRelationSuite SQL
#52830 opened Nov 1, 2025 by zhztheplayer Loading… updated Nov 1, 2025
[SPARK-54106][SS] Recheckin State store row checksum implementation SQL STRUCTURED STREAMING
#52829 opened Nov 1, 2025 by micheal-o Loading… updated Nov 1, 2025
[SPARK-54131][PYTHON] Update Pandas version 2.3.3 BUILD INFRA PANDAS API ON SPARK PYTHON
#52828 opened Nov 1, 2025 by bjornjorgensen Loading… updated Nov 1, 2025
[SPARK-54079][Geo][SQL][FOLLOWUP] Fix catalyst expressions ST package and imports SQL
#52807 opened Oct 31, 2025 by uros-db Loading… updated Nov 1, 2025
1
[SPARK-54128][CONNECT][SQL] Convert IllegalArgumentException to SparkException with proper error classes in Spark Connect server CONNECT SQL
#52818 opened Oct 31, 2025 by grundprinzip Loading… updated Nov 1, 2025
[SPARK-54049][BUILD] Shade com.google.thirdparty package to fix Guava class conflicts in spark 4.0 BUILD
#52767 opened Oct 28, 2025 by vinodkc Loading… updated Nov 1, 2025
11
[SPARK-54130][SQL] Add detailed error messages for catalog assertion failures SQL
#52826 opened Nov 1, 2025 by ganeshashree Loading… updated Nov 1, 2025
[SPARK-54056][SQL] resolve substitution for SQLConf settings in Catalogs SQL
#52759 opened Oct 28, 2025 by EugeneYushin Loading… updated Nov 1, 2025
5
[SPARK-54088][CORE] When TaskSchedulerImpl searches for an executor to schedule an unschedulable task, it should exclude executors that are pending to remove CORE
#52793 opened Oct 30, 2025 by AngersZhuuuu Loading… updated Nov 1, 2025
5
[SPARK-54122] Implement TwsTester SQL STRUCTURED STREAMING
#52824 opened Nov 1, 2025 by fedimser • Draft updated Nov 1, 2025
[SPARK-53898][CORE] Shuffle cleanup should not clean MapOutputTrackerMaster.shuffleStatuses in local cluster CORE SQL
#52606 opened Oct 14, 2025 by Ngone51 Loading… updated Nov 1, 2025
21
[SPARK-53448][PYTHON] Conversion of a pyspark DataFrame with a Variant column to pandas fails with an error PYTHON SQL
#52260 opened Sep 8, 2025 by VindhyaG Loading… updated Nov 1, 2025
1
[SPARK-54121][SS] Automatic Snapshot Repair for State store CONNECT SQL STRUCTURED STREAMING
#52821 opened Oct 31, 2025 by micheal-o Loading… updated Nov 1, 2025
3
[SPARK-54127][BUILD] Fix sbt inconsistent shading package BUILD
#52825 opened Nov 1, 2025 by pan3793 Loading… updated Nov 1, 2025
[SPARK-54112][CONNECT] Support getSchemas for SparkConnectDatabaseMetaData CONNECT SQL
#52819 opened Oct 31, 2025 by pan3793 • Draft updated Nov 1, 2025
1
[SPARK-54117] Throw better error to indicate that TWS is only supported with RocksDB state store provider PYTHON SQL STRUCTURED STREAMING
#52822 opened Oct 31, 2025 by fedimser Loading… updated Oct 31, 2025
1
[SPARK-53991][SQL] Add SQL support for KLL quantiles functions based on DataSketches SQL
#52800 opened Oct 30, 2025 by dtenedor Loading… updated Oct 31, 2025
30
ProTip! Adding no:label will show everything without a label.