Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cmd/vet: warn when errors.As target has type *error #47528

Closed
andig opened this issue Aug 4, 2021 · 22 comments
Closed

cmd/vet: warn when errors.As target has type *error #47528

andig opened this issue Aug 4, 2021 · 22 comments
Labels
Analysis Issues related to static analysis (vet, x/tools/go/analysis) FrozenDueToAge Proposal Proposal-Accepted Proposal-FinalCommentPeriod
Milestone

Comments

@andig
Copy link
Contributor

andig commented Aug 4, 2021

What version of Go are you using (go version)?

$ go version
go version go1.16.6 darwin/arm64

Does this issue reproduce with the latest release?

yes

What did you do?

Wrote this code https://play.golang.org/p/16cU0kc8Lku and wondered why the errors matched.

var Err = errors.New("sentinel")
err := errors.New("foo")
if errors.As(err, &Err) {
  fmt.Println("why?")
}

Discussion in https://groups.google.com/g/golang-nuts/c/MaYJy_IRbYA/m/uCHV6P87EQAJ?utm_medium=email&utm_source=footer

What did you expect to see?

Of course the code above is wrong, yet I didn't spot it. It would be nice if this kind of programming error could be detected:

  • add a govet check that flags using plain errors with errors.As or
  • @Merovius suggested errors.errorString should implement As() and return false, unless the pointers match.

I'm unsure if the latter is possible. It would strictly break BC (and the function's description). On the other hand ist should only change behaviour in cases that seem invalid from the start?

@Merovius
Copy link
Contributor

Merovius commented Aug 4, 2021

I'm unsure if the latter is possible. It would strictly break BC (and the function's description).

I don't think it break the functions description. It is the purview of any error type to implement As() the way it sees fit.

It does change the behavior of errors.New, but I don't think there is any API contract about the returned error implementing or not implementing other methods than Error. So, I would argue it changes behavior, but it doesn't break compatibility - if a user relies on the current behavior, they rely on undocumented implementation details.

Lastly, even if it was breaking compatibility, there is a clear exception in the Go 1 compatibility contract for fixing bugs. It is the clear intent of errors.New to return unique sentinel errors. The current behavior of errors.As when used with such an error is clearly a bug.

We can still have a vet check to warn about it, but I think the bug should be fixed either way.

@andig
Copy link
Contributor Author

andig commented Aug 4, 2021

I don't think it break the functions description.

I was referring to:

An error matches target if the error's concrete value is assignable to the value pointed to by target, or ...

The value here is assignable as types match. Having sentinel errors assignable in turn is more because we can't have const errors in Go...

@Merovius
Copy link
Contributor

Merovius commented Aug 4, 2021

But the complete paragraph is

An error matches target if the error's concrete value is assignable to the value pointed to by target, or if the error has a method As(interface{}) bool such that As(target) returns true. In the latter case, the As method is responsible for setting target.

The existence of the As optional interface is specifically for cases like this, so that error types can overwrite the pure "assignability" behavior.

@seankhliao seankhliao changed the title detect/prevent invalid uses of errors.As with plain sentinel errors proposal: errors: implement As for errorString Aug 4, 2021
@gopherbot gopherbot added this to the Proposal milestone Aug 4, 2021
@Merovius
Copy link
Contributor

Merovius commented Aug 4, 2021

Well, this is surprising behavior to me. I would've expected As to be tried first, but it seems it's only used as a fallback.
With errors.As as it is right now, implementing As actually doesn't do anything in this case. I wonder why it is written that way.

@andig
Copy link
Contributor Author

andig commented Aug 4, 2021

That does indeed seem to contradict the wording of errors.As.

@bcmills
Copy link
Contributor

bcmills commented Aug 4, 2021

Perhaps cmd/vet should be changed to warn when the second argument to errors.As is statically known to have type *error?

That is pretty much guaranteed to indicate a bug, because it is trivially true that the first argument (of type error) “is assignable to the value pointed to by” a second argument of type *error.

@bcmills
Copy link
Contributor

bcmills commented Aug 4, 2021

CC @timothy-king

@neild
Copy link
Contributor

neild commented Aug 4, 2021

That does indeed seem to contradict the wording of errors.As.

The relevant wording is: "An error matches target if the error's concrete value is assignable to the value pointed to by target"

In this case, the target has type *error so the concrete value is trivially assignable to *target. A vet check for this case seems like a good idea, since there is never a reason to pass an *error as the second parameter of errors.As.

@Merovius
Copy link
Contributor

Merovius commented Aug 4, 2021

@neild I'm not really trying to nitpick wording, but I think it is unexpected that an error might have an As method which is not called if the error is assignable. I would imagine it to work like json.Unmarshaler, where the default behavior is simply overwritten by the optional interface.

@Merovius
Copy link
Contributor

Merovius commented Aug 4, 2021

(If I were to nitpick wording, I'd argue that "X is the case if A or B. In the latter case, the method As is responsible…" seems to imply to me, that As should be called if B is true to determine the outcome of the conversion, regardless of whether or not A is also true)

@Merovius
Copy link
Contributor

Merovius commented Aug 4, 2021

@bcmills Yes, @andig also suggested that check, though I didn't understand what he was saying at first. I do think it's a good idea. I still find the current behavior of As surprising.

@bcmills
Copy link
Contributor

bcmills commented Aug 4, 2021

I think the current behavior is appropriate, if for no other reason than that pre-errors users of various APIs would use type-assertions to check whether an error is of a given type. Only falling back to the custom As method if the value is not assignable keeps As more consistent with those users, and makes it more of a drop-in replacement for a type assertion.

@neild
Copy link
Contributor

neild commented Aug 4, 2021

It was (for better or worse) an intentional choice that Is and As methods can't override the default behavior.

@Merovius
Copy link
Contributor

Merovius commented Aug 4, 2021

Fair enough. I find it very strange, but I guess I'm too late for that discussion.

Then perhaps the issue should be re-titled again, as the go vet check is apparently the only useful thing we can do here.

@gopherbot
Copy link
Contributor

Change https://golang.org/cl/339889 mentions this issue: go/analysis/passes/errorsas: warn if errors.As target is *error

@neild neild changed the title proposal: errors: implement As for errorString proposal: cmd/vet: warn when errors.As target has type *error Aug 4, 2021
@zpavlinovic zpavlinovic added the Analysis Issues related to static analysis (vet, x/tools/go/analysis) label Aug 4, 2021
@rsc
Copy link
Contributor

rsc commented Aug 4, 2021

This proposal has been added to the active column of the proposals project
and will now be reviewed at the weekly proposal review meetings.
— rsc for the proposal review group

@bcmills
Copy link
Contributor

bcmills commented Aug 4, 2021

Would it make sense to apply the same warning to pointers to empty interface types, too?
They are trivial in essentially the same way, in that they cause errors.As to decay to a nil-check.

@neild
Copy link
Contributor

neild commented Aug 4, 2021

Warning on *interface{} doesn't seem like it would have any false positives, but I suspect it's unlikely to show up in practice.

@rsc
Copy link
Contributor

rsc commented Aug 11, 2021

Based on the discussion above, this proposal seems like a likely accept.
— rsc for the proposal review group

@rsc
Copy link
Contributor

rsc commented Aug 18, 2021

No change in consensus, so accepted. 🎉
This issue now tracks the work of implementing the proposal.
— rsc for the proposal review group

@rsc rsc changed the title proposal: cmd/vet: warn when errors.As target has type *error cmd/vet: warn when errors.As target has type *error Aug 18, 2021
@rsc rsc modified the milestones: Proposal, Backlog Aug 18, 2021
@andig
Copy link
Contributor Author

andig commented Apr 6, 2022

The proposal is accepted and has an open CL. Any chance to move the CL forward?

@gopherbot
Copy link
Contributor

Change https://go.dev/cl/403034 mentions this issue: go/analysis/passes/errorsas: update testdata for new warning

gopherbot pushed a commit to golang/tools that referenced this issue Apr 29, 2022
A new testdata file was added since CL 339889 was authored.
Update it in the same way for the new warning.

Updates golang/go#47528.
Fixes golang/go#52613.

Change-Id: I17d06c602eeabcc4ddc8514d5e444acdb714ab94
Reviewed-on: https://go-review.googlesource.com/c/tools/+/403034
Auto-Submit: Dmitri Shuralyov <dmitshur@golang.org>
TryBot-Result: Gopher Robot <gobot@golang.org>
Reviewed-by: Dmitri Shuralyov <dmitshur@google.com>
Reviewed-by: Tim King <taking@google.com>
Run-TryBot: Dmitri Shuralyov <dmitshur@golang.org>
gopls-CI: kokoro <noreply+kokoro@google.com>
@golang golang locked and limited conversation to collaborators Apr 29, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Analysis Issues related to static analysis (vet, x/tools/go/analysis) FrozenDueToAge Proposal Proposal-Accepted Proposal-FinalCommentPeriod
Projects
None yet
Development

No branches or pull requests

8 participants