Skip to content

[FLINK-38973][runtime] Job ID assignment and matching based on name#27475

Merged
zhuzhurk merged 2 commits intoapache:masterfrom
eemario:FLIP560-1
Feb 26, 2026
Merged

[FLINK-38973][runtime] Job ID assignment and matching based on name#27475
zhuzhurk merged 2 commits intoapache:masterfrom
eemario:FLIP560-1

Conversation

@eemario
Copy link
Copy Markdown
Contributor

@eemario eemario commented Jan 27, 2026

What is the purpose of the change

This pull request introduces job ID assignment and matching based on job name, which is typically used to match jobs correctly during HA recovery.

Brief change log

  • Add job name info in JobResult
  • Gather name and id from recovered jobs to build the context required for the job ID assignment and matching
  • Introduce a JobIdManager interface and a JobNameBasedJobIdManager implementation to support job ID assignment based on names

Verifying this change

This change added tests and can be verified as follows:

  • Added tests that validate the behavior of JobNameBasedJobIdManager

Does this pull request potentially affect one of the following parts:

  • Dependencies (does it add or upgrade a dependency): (no)
  • The public API, i.e., is any changed class annotated with @Public(Evolving): (no)
  • The serializers: (no)
  • The runtime per-record code paths (performance sensitive): (no)
  • Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: (no)
  • The S3 file system connector: (no)

Documentation

  • Does this pull request introduce a new feature? (no)
  • If yes, how is the feature documented? (not applicable)

@flinkbot
Copy link
Copy Markdown
Collaborator

flinkbot commented Jan 27, 2026

CI report:

Bot commands The @flinkbot bot supports the following commands:
  • @flinkbot run azure re-run the last Azure build

@eemario eemario marked this pull request as ready for review January 27, 2026 03:42
Copy link
Copy Markdown
Contributor

@zhuzhurk zhuzhurk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice work! Just 2 minor comments.

@eemario eemario force-pushed the FLIP560-1 branch 7 times, most recently from e9b4e8b to 54c00d5 Compare February 13, 2026 06:07
@eemario eemario force-pushed the FLIP560-1 branch 2 times, most recently from 92696b6 to 806f897 Compare February 24, 2026 06:49
Copy link
Copy Markdown
Contributor

@zhuzhurk zhuzhurk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

@zhuzhurk zhuzhurk merged commit 197c7b9 into apache:master Feb 26, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants