Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] Configure lints in Cargo.toml #5728

Closed
wants to merge 7 commits into from

Conversation

detrumi
Copy link
Member

@detrumi detrumi commented Jul 15, 2018

Implements #5034

This PR adds a [lints] section to Cargo.toml using the following format:

[lints]
allow_unused = "allow"
non_snake_case = "allow"

Progress

  • Add lints section to manifest
  • Pass -A/-W/-D/-F flags to rustc
  • Allow specifying lints in workspaces (workspace level lints take precedence over package level)
  • Support feature syntax: [lints.'cfg(feature = "clippy")']
  • Pass lints to rustdoc too, based on a feature flag
  • Unknown lints are a warning (currently flags are directly passed to rustc which results in an error)

@rust-highfive
Copy link

Thanks for the pull request, and welcome! The Rust team is excited to review your changes, and you should hear from @alexcrichton (or someone else) soon.

If any changes to this PR are deemed necessary, please add them as extra commits. This ensures that the reviewer can see what has changed since they last reviewed the code. Due to the way GitHub handles out-of-date commits, this should also make it reasonably obvious what issues have or haven't been addressed. Large or tricky changes may require several passes of review and changes.

Please see the contribution instructions for more information.

@ehuss
Copy link
Contributor

ehuss commented Jul 15, 2018

@detrumi I saw your message on Discord, did you figure out the virtual manifest distinction? There are two manifest types, Manifest and VirtualManifest. You can look at profiles as an example of something that can be specified in both. The virtual one is usually accessed via the Workspace.

I'd caution about having packages override the workspace, since that's the opposite precedence of other workspace settings. I'm not sure how that should work.

Also, just a heads up, rustdoc lint settings will probably be stabilized soon (rust-lang/rust#52354), and will probably want to reuse these for rustdoc. (Which will also probably need cap-lint support, but I imagine that will land separately.) One tricky bit is that rustdoc is used in two places (one for doc, and one for tests).

This will likely need a feature flag (see features.rs).

@bors
Copy link
Contributor

bors commented Jul 15, 2018

☔ The latest upstream changes (presumably #5726) made this pull request unmergeable. Please resolve the merge conflicts.

@detrumi detrumi force-pushed the lints-in-manifest branch from 49d2614 to 68ae5b1 Compare July 16, 2018 19:25
@detrumi
Copy link
Member Author

detrumi commented Jul 16, 2018

@ehuss Thanks for pointing me to profiles, seeing how that's done clears it up a lot.

The package override direction was taken from the proposal text in #5034, but maybe I read that wrong or there was a mistake in that, since you're right that having workspaces override packages makes more sense.

I'll look into the rustdoc flags.

@ehuss
Copy link
Contributor

ehuss commented Jul 16, 2018

I don't think you misread it, different people will have different expectations. I'm not sure which way is the right way. I'm just cautioning that it may not be clear how it should work, and that someone on the cargo team might want to clarify it.

@alexcrichton
Copy link
Member

ping @detrumi, have you had a chance to handle some of the follow up comments here?

@detrumi
Copy link
Member Author

detrumi commented Jul 31, 2018

@alexcrichton Yes, I'm slowly working my way through implementing it.

@detrumi detrumi force-pushed the lints-in-manifest branch 2 times, most recently from 69fb5a4 to 4652dca Compare August 6, 2018 20:20
@detrumi
Copy link
Member Author

detrumi commented Aug 7, 2018

Some questions:

  • How should -F (forbid) flags be handled? Workspace lints normally override package lints, but that seems kind of weird for forbidden lints. One option is to let -F flags in packages take priority over workspace lints too. However, this would mean that you can't override that lint in the workspace any more, which might be unpractical.
    Edit: after thinking about it some more, workspace lints should only override packages if they're stricter, as allowing lints while the package treats them as errors would mean that you can make changes to the package that compile while in the workspace, but don't compile for the package on its own.
  • There was an idea to warn if you specify an unknown lint name. However, I don't know how to check against that, as we don't have a list of known lints. At the moment, passing an unknown lint results in rustc erroring out when Cargo calls it with the lint flags.
  • Looking at the Appveyor build of my last commit, an import in the test file I added failed to resolve:
    use cargotest::support::{execs, project};
    This same line is also used in other test files, and locally I can run the test fine. Am I doing something wrong here?

@alexcrichton
Copy link
Member

Others may have a better idea how to handle the flags and such but for the test at least it's been tweaked I think since this started, you should be able to just drop the leading cargotest::

@@ -0,0 +1,177 @@
use cargotest::support::{execs, project};
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The cargotest::support module is now just support, as of #5762.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, didn't expect that not rebasing would cause such issues

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah it does because CI tests the merge of this PR branch with the (current) state of the target branch (where the merge has happened).

@detrumi detrumi force-pushed the lints-in-manifest branch 2 times, most recently from cd7dbf6 to 67ee176 Compare August 8, 2018 18:42
@@ -240,6 +241,9 @@ pub struct TomlManifest {
patch: Option<BTreeMap<String, BTreeMap<String, TomlDependency>>>,
workspace: Option<TomlWorkspace>,
badges: Option<BTreeMap<String, BTreeMap<String, String>>>,
lints: Option<BTreeMap<String, String>>,
#[serde(rename = "lints2")]
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not entirely clear on what the lints2 name is doing here, can you add a comment to the naming choice here?

Copy link
Member Author

@detrumi detrumi Aug 20, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah, I haven't figured out yet how to deserialize both [lints] and [lints.'cfg(...)'] correctly, so I just temporarily named it something else (sorry!). Just using #[serde(rename = "lints")] here doesn't work, so it probably needs a custom Deserialize impl.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hm ok, I'm not really sure we'd want to support cfg(..) for lint configurations though in the sense that it feels like it's a bit overkill for configuration that can otherwise be specific in the crate source anyway?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Right, let's simplify to just a [lints] section then.

pub fn set_lint_flags(&self, unit_cfg: &[Cfg], features: &HashSet<String>, cmd: &mut ProcessBuilder) {
match self.cfg {
None => self.set_flags(cmd),
Some(CfgExpr::Value(Cfg::KeyPair(ref key, ref value)))
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we've already got a number of #[cfg] matching functions throughout Cargo, could those be reused here?

Copy link
Member Author

@detrumi detrumi Aug 20, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't see one that could be used here, except maybe the CfgExpr::matches function that is used in the next line. The way I wrote it seems simpler than wrapping all feature strings inside Cfg::KeyPair, unless feature = foo keypairs can be nested inside other CfgExpr's?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we'll want to funnel everything through matches to ensure it's consistently appplied

tests/testsuite/lints.rs Show resolved Hide resolved
@azriel91
Copy link

Hiya @detrumi, are you still working on this?
It would be an awesome feature to have!

@alexcrichton
Copy link
Member

This is unfortunately pretty old at this point so I'm going to close this (and we also have a soft feature freeze right now with Cargo). The Cargo team, however, will hopefully be able to allocate resources for this in early 2019!

@phansch
Copy link
Member

phansch commented Dec 13, 2018

@detrumi Would you mind if I pick up this PR in the next days? I would really like to see this implemented in 2019. (I would probably start with a fresh PR)

@ehuss
Copy link
Contributor

ehuss commented Dec 13, 2018

@phansch We discussed lint configs at the Cargo meeting yesterday. We would like to see more discussion on the design before continuing. Would you be interested in helping to hash this out on IRLO? The following needs a closer look:

  • Need a clear description of the motivation and use cases.
  • Is there a more general solution? How does this relate to other tool configurations such as rustfmt.toml?
  • Is Cargo.toml really the best place? Need to clarify why to choose one approach over the others.
    • If the use case is for large organizations to share common settings, then this assumes they have a monolithic workspace which may not be true for everyone.
    • The counter argument for something like lints.toml is the proliferation of many config files for a Cargo project (rustfmt.toml, lints.toml, .cargo/config, etc.).
  • How does precedence work? Can packages override workspaces, or the other way around? Or maybe based on strictness (workspaces can make lints more restrictive, not less)?
  • How much of an issue is errors for unknown lints? My feeling is that it should be OK, but it does set a floor for the minimum supported rustc for something that is not really critical.
  • How important is it to report the location of the lint? Currently rustc will tell you it's in the command-line. Finding the correct location for the lint may be tricky in a large project. I personally think it would be good to have the intent to implement location reporting in rustc before stabilization.

We don't really feel this needs a full RFC process, but we would at least like to see the content/questions that arise during that process to be addressed.

@phansch
Copy link
Member

phansch commented Dec 13, 2018

@ehuss Makes sense. I'm going to try to write something up based on #5034 and incorporate all the different aspects this potentially touches. I will create a post on IRLO in the coming days 👍

@detrumi
Copy link
Member Author

detrumi commented Dec 17, 2018

@detrumi Would you mind if I pick up this PR in the next days? I would really like to see this implemented in 2019. (I would probably start with a fresh PR)

Yes, feel free to work on this. Creating a post on IRLO seems like a good way to push this forward, as there are too many open questions. I'd be happy to help, but I don't have much experience pushing discussion forward and such.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants