Skip to content

Throw VerificationException for build verification failures #45187

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed

Conversation

erichaagdev
Copy link
Contributor

Verification failures are generally failures which verify correctness, e.g., failures caused by test, compilation, linting, etc. Non-verification failures are generally failures related to the build toolchain, e.g., failures caused by dependency resolution, build configuration, etc.

Develocity attempts to classify failures based on context, but it doesn't always classify correctly. By default, most failures are classified as non-verification. By explicitly throwing a VerificationException for verification task failures, the failures will be appropriately classified.

Here is a Build Scan showing the behavior with these changes. You'll notice these Architecture check failures are categorized as verification rather than non-verification, which is the case when you look in the Spring Develocity instance.

See also: https://docs.gradle.com/develocity/failure-classification

Verification failures are generally failures which verify correctness,
e.g., failures caused by test, compilation, linting, etc.
Non-verification failures are generally failures related to the
build toolchain, e.g., failures caused by dependency resolution, build
configuration, etc.

Develocity attempts to classify failures based on context, but it
doesn't always classify correctly. By default, most failures are
classified as non-verification. By explicitly throwing a
`VerificationException` for verification task failures, the failures
will be appropriately classified.

See also: https://docs.gradle.com/develocity/failure-classification

Signed-off-by: Eric Haag <[email protected]>
@spring-projects-issues spring-projects-issues added the status: waiting-for-triage An issue we've not yet triaged label Apr 14, 2025
@erichaagdev
Copy link
Contributor Author

erichaagdev commented Apr 14, 2025

I determined these as being verification failures given the task names and their failure messages include check.

To find these candidates, I checked the last 90 days of failures on ge.spring.io.

It's possible there could be additional verification failures that I missed.

@philwebb philwebb added type: task A general task and removed status: waiting-for-triage An issue we've not yet triaged labels Apr 14, 2025
@philwebb philwebb modified the milestones: 3.3.x, 3.3.11 Apr 14, 2025
@philwebb philwebb self-assigned this Apr 14, 2025
philwebb pushed a commit that referenced this pull request Apr 14, 2025
Verification failures are generally failures which verify correctness,
e.g., failures caused by test, compilation, linting, etc.
Non-verification failures are generally failures related to the
build toolchain, e.g., failures caused by dependency resolution, build
configuration, etc.

Develocity attempts to classify failures based on context, but it
doesn't always classify correctly. By default, most failures are
classified as non-verification. By explicitly throwing a
`VerificationException` for verification task failures, the failures
will be appropriately classified.

See gh-45187

See also: https://docs.gradle.com/develocity/failure-classification

Signed-off-by: Eric Haag <[email protected]>
@philwebb philwebb closed this in ce64f36 Apr 14, 2025
@philwebb
Copy link
Member

Thanks @erichaagdev!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type: task A general task
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants