KEP-976: Support Groups of Pods Where Driver Generates Workers in Pod Integration

[everpeace]

What type of PR is this?

/kind feature

What this PR does / why we need it:

• Add Driver Generated Pods Support in Pod Integration
• KEP
  • https://github.com/kubernetes-sigs/kueue/tree/main/keps/976-plain-pods#groups-of-pods-where-driver-generates-workers
  • https://github.com/kubernetes-sigs/kueue/tree/main/keps/976-plain-pods#story-3

Which issue(s) this PR fixes:

Fixes #1656

Special notes for your reviewer:

• I'm not regular contributor of Kueue. Thus, I'm not so confident my PR is the relevant impelmentation for the KEP. Please feel free to correct me 🙇
• I will support Kubeflow Spark Operator integration for the next step (SparkApplication integration)

Does this PR introduce a user-facing change?

KEP-976: Support Groups of Pods Where Driver Generates Workers in Pod Integration

[k8s-ci-robot]

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: everpeace
Once this PR has been reviewed and has the lgtm label, please assign mimowo for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[netlify]

✅ Deploy Preview for kubernetes-sigs-kueue canceled.

Name	Link
🔨 Latest commit	f0d2aac
🔍 Latest deploy log	https://app.netlify.com/sites/kubernetes-sigs-kueue/deploys/67bf1e1d9a854b000800073b

[everpeace]

/test all

[everpeace]

Hi, altghouth docs are not paved yet for this feature, I'd like to get a review for the implementation before I proceed to write user docs.

Thanks, in advance.

[k8s-ci-robot]

PR needs rebase.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.