Skip to content

Docs: Add new Spark version support skill - #17877

Draft
manuzhang wants to merge 1 commit into
apache:mainfrom
manuzhang:codex/add-spark-version-skill
Draft

Docs: Add new Spark version support skill#17877
manuzhang wants to merge 1 commit into
apache:mainfrom
manuzhang:codex/add-spark-version-skill

Conversation

@manuzhang

@manuzhang manuzhang commented Aug 29, 2026

Copy link
Copy Markdown
Member

About this PR

Adds a repo-local, agent-neutral skill for introducing support for a new Spark minor version in Iceberg.

The skill generalizes the Spark 4.2 preview workflow and documents how to:

  • preserve source history with separate move and copy-back commits;
  • back up an existing target branch before rewriting its history;
  • update the current Gradle, CI, benchmark, and publication integration points;
  • keep preview source support separate from default build and release publication decisions; and
  • validate the new modules and an older Spark line when shared resolution logic changes.

Testing

  • quick_validate.py .agents/skills/add-spark-version
  • git diff --check upstream/main...HEAD

AI Disclosure

  • Model: GPT-5
  • Platform/Tool: OpenAI Codex
  • Human Oversight: partially reviewed
  • Prompt Summary: Create a reusable, agent-neutral Iceberg skill based on the Spark 4.2 preview workflow for adding support for new Spark versions, including backup of an existing target branch.

@manuzhang
manuzhang force-pushed the codex/add-spark-version-skill branch from 70c3d83 to 7918ffd Compare August 30, 2026 03:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant