Skip to content

TIKA-5001: step 1 - #3436

Merged
tballison merged 1 commit into
apache:mainfrom
tballison:configstore-runtime-only
Oct 27, 2026
Merged

tballison merged 1 commit into
apache:mainfrom
tballison:configstore-runtime-only

Conversation

@tballison

Copy link
Copy Markdown
Contributor

Thanks for your contribution to Apache Tika! Your help is appreciated!

Before opening the pull request, please verify that

  • there is an open issue on the Tika issue tracker which describes the problem or the improvement. We cannot accept pull requests without an issue because the change wouldn't be listed in the release notes.
  • the issue ID (TIKA-XXXX)
    • is referenced in the title of the pull request
    • and placed in front of your commit messages surrounded by square brackets ([TIKA-XXXX] Issue or pull request title)
  • commits are squashed into a single one (or few commits for larger changes)
  • Tika builds and unit tests pass with ./mvnw clean install (clean test alone cannot resolve the pipes plugin zips)
  • if you used a generative AI tool: follow the ASF Generative Tooling Guidance (Generated-by: <tool> in the commit message), and consider running the pre-flight in .skills/devs/pr-review/SKILL.md — fix what it finds; don't paste its report here
  • there should be no conflicts when merging the pull request branch into the recent main branch. If there are conflicts, please try to rebase the pull request branch on top of a freshly pulled main branch
  • if you add new module that downstream users will depend upon add it to relevant group in tika-bom/pom.xml.

We will be able to faster integrate your pull request if these conditions are met. If you have any questions how to fix your problem or about using Tika in general, please sign up for the Tika mailing list. Thanks!

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔵 Needs a closer look

Cross-process persistence and legacy-store precedence need integration-test confirmation and human review before approval.

No open issues 🎉

What changed in this PR

This first step of TIKA-5001 separates server-configured components from runtime registrations in Tika’s pipes infrastructure, keeping resolved config-file secrets out of persistent stores.

Changes:

  • Preserve config-file components separately, give them precedence over stored copies, and prevent runtime replacement or deletion.
  • Update manager and gRPC tests to cover runtime changes, persistence separation, and forked-worker access.
  • Document the revised persistence and mutation rules.
File Description
tika-pipes/​tika-pipes-integration-tests/​src/​test/​java/​org/​apache/​tika/​pipes/​core/​fetcher/​FetcherManagerTest.java Tests configured-fetcher protection, persistence separation, and legacy-store precedence.
tika-pipes/​tika-pipes-integration-tests/​src/​test/​java/​org/​apache/​tika/​pipes/​core/​emitter/​EmitterManagerTest.java Tests runtime updates and configured-emitter protection.
tika-pipes/​tika-pipes-core/​src/​main/​java/​org/​apache/​tika/​pipes/​core/​fetcher/​FetcherManager.java Documents the configured-fetcher replacement restriction.
tika-pipes/​tika-pipes-core/​src/​main/​java/​org/​apache/​tika/​pipes/​core/​emitter/​EmitterManager.java Documents the configured-emitter replacement restriction.
tika-pipes/​tika-pipes-core/​src/​main/​java/​org/​apache/​tika/​pipes/​core/​AbstractComponentManager.java Separates configured components from runtime storage and updates lookup, listing, and mutation handling.
tika-grpc/​src/​test/​java/​org/​apache/​tika/​pipes/​grpc/​TikaGrpcServerTest.java Adjusts runtime-registration tests and adds file-store coverage for forked workers.
docs/​modules/​ROOT/​pages/​using-tika/​grpc/​index.adoc Explains restrictions on modifying configured fetchers.
docs/​modules/​ROOT/​pages/​pipes/​configuration.adoc Clarifies runtime-only storage and the file backend.
docs/​modules/​ROOT/​pages/​configuration/​index.adoc Explains that resolved config-file references are not persisted.

Review effort: Balanced

@tballison
tballison merged commit 9288477 into apache:main Oct 27, 2026
4 checks passed
@tballison
tballison deleted the configstore-runtime-only branch October 27, 2026 16:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants