Skip to content

[SPARK-52428] Add SparkSession::add_artifact() for uploading files to the cluster#36

Open
rafafrdz wants to merge 1 commit intoapache:masterfrom
rafafrdz:add-session-add-artifact
Open

[SPARK-52428] Add SparkSession::add_artifact() for uploading files to the cluster#36
rafafrdz wants to merge 1 commit intoapache:masterfrom
rafafrdz:add-session-add-artifact

Conversation

@rafafrdz
Copy link
Copy Markdown

Summary

  • Add SparkConnectClient::add_artifacts() using the `AddArtifacts` streaming gRPC RPC with `SingleChunkArtifact` batch payload
  • Add `SparkSession::add_artifact(local_path, remote_name)` for single file upload
  • Add `SparkSession::add_artifacts(artifacts)` for batch upload of multiple files

Test plan

  • `cargo build` passes
  • `cargo fmt -- --check` passes

@rafafrdz rafafrdz force-pushed the add-session-add-artifact branch from 8800dd0 to 50c92aa Compare March 29, 2026 08:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant