Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(queue): provide a way for pipeline stages to specify a backoff period #4841

Merged
merged 4 commits into from
Feb 17, 2025

Conversation

dbyron-sf
Copy link
Contributor

@dbyron-sf dbyron-sf commented Feb 17, 2025

via a new backoffPeriodMs stage configuration property. Before this, pipeline authors had no control over the backoff period. It came from either spinnaker configuration properties or implementations of RetryableTask.getDynamicBackoffPeriod.

This makes it possible for pipeline authors to, for example, control the delay between attempts when webhook stages retry. The actual backoff used is the largest of:

  • backoffPeriodMs in the stage
  • tasks.global.backOffPeriod
  • tasks.<cloud provider>.backOffPeriod
  • tasks.<cloud provider>.<account name>.backOffPeriod

@@ -316,6 +316,9 @@ class RunTaskHandler(
* `tasks.aws.backOffPeriod = 80000`
* `tasks.aws.someAccount.backoffPeriod = 60000`
* `tasks.aws.backoffPeriod` will be used (given the criteria matches and unless the default dynamicBackOffPeriod is greater).
*
* This function also considers the `backoffPeriodMs` property in a stage
* configuration. If it's larger than the above, it's used.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Im not following this comment. Where is the logic to determine what is used by magnitude?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nvm. I see it in the code below that needed expanding in gh

…eriod

via a new backoffPeriodMs stage configuration property.  Before this, pipeline authors had
no control over the backoff period.  It came from either spinnaker configuration properties or
implementations of RetryableTask.getDynamicBackoffPeriod.

This makes it possible for pipeline authors to, for example, control the delay between
attempts when webhook stages retry.  The actual backoff used is the largest of:

- backoffPeriodMs in the stage
- tasks.global.backOffPeriod
- tasks.<cloud provider>.backOffPeriod
- tasks.<cloud provider>.<account name>.backOffPeriod
since getTimeout and getBackoffPeriod were basically the same.
since Integer, Long and Double all extend from Number.  Also, Optional.map isn't necessary
since instanceof returns false when value is null.
@dbyron-sf dbyron-sf force-pushed the configurable-backoff branch from af3d288 to 7d00b21 Compare February 17, 2025 03:16
@dbyron-sf dbyron-sf added the ready to merge Approved and ready for merge label Feb 17, 2025
@mergify mergify bot added the auto merged Merged automatically by a bot label Feb 17, 2025
@mergify mergify bot merged commit ebaf829 into spinnaker:master Feb 17, 2025
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
auto merged Merged automatically by a bot ready to merge Approved and ready for merge target-release/1.37
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants