Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Emit error PTH118 for os.sep.join() #5905

Closed
dosisod opened this issue Jul 20, 2023 · 6 comments · Fixed by #5935
Closed

Emit error PTH118 for os.sep.join() #5905

dosisod opened this issue Jul 20, 2023 · 6 comments · Fixed by #5935
Labels
rule Implementing or modifying a lint rule

Comments

@dosisod
Copy link
Contributor

dosisod commented Jul 20, 2023

The following shows 2 similar snippets of code, but only one is picked up by Ruff currently:

import os

os.path.join("hello", "world")   # PTH118
os.sep.join(("hello", "world"))  # no error

os.sep.join() acts the same as os.path.join(), just written differently. Searching on grep.app shows that this is a somewhat common idiom.

Running:

$ ruff --version
ruff 0.0.278

$ ruff file.py
file.py:3:1: PTH118 `os.path.join()` should be replaced by `Path` with `/` operator
Found 1 error.

Expected:

An error for both os.sep.join and os.path.join.

@sbrugman
Copy link
Contributor

sbrugman commented Jul 20, 2023

I can take this one (also working on some other pathlib ports from refurb)

Nice catch, and also interesting to learn about grep.app. I've been using the GitHub search functionality so far

@charliermarsh charliermarsh added the rule Implementing or modifying a lint rule label Jul 20, 2023
@dosisod
Copy link
Contributor Author

dosisod commented Jul 20, 2023

I've found that GitHub search doesn't find exactly for what I'm looking for while grep.app does, in addition to providing case-insensitive and regex searching. It's also great for gauging how impactful a new rule might be, and finding potential edge-cases.

And thank you for taking the time to port parts of Refurb into Ruff! I've added a lot of checks since #1348 was opened, and I've been meaning to leave a comment with an updated list but haven't had the time. I'll find some time this weekend to update the list!

@charliermarsh
Copy link
Member

Any idea why folks are using os.sep.join in lieu of os.path.join? I just want to make sure there's not a subtle distinction that we're overlooking.

@sbrugman
Copy link
Contributor

os.sep.join is a string join on the os.sep character. os.path.join also handles some path logic. os.sep.join may be faster (so)

For the Pathlib rules this shouldn't matter. The overhead of path objects in is neglectable unless it's in a loop (and this is mentioned in our docs in #5815)

@sbrugman
Copy link
Contributor

sbrugman commented Jul 21, 2023

Just realised that we should also detect the opposite: .split(os.sep) is also frequently used

This should be a new rule, the requires a combination of Path.name and Path.parent, or Path.parts

@dosisod
Copy link
Contributor Author

dosisod commented Jul 21, 2023

One thing to note is that os.path.join() will drop falsey arguments, but os.sep.join() won't:

>>> import os
>>> os.path.join("hello", "world")
'hello/world'
>>> os.sep.join(("hello", "", "world"))
'hello//world'

This isn't an issue when using it for the Path() constructor, but might be an issue if generalized to all uses of os.path.join():

>>> from pathlib import Path
>>> Path("hello", "", "world") == Path("hello", "world")
True

charliermarsh added a commit that referenced this issue Jul 21, 2023
Closes #5905

Co-authored-by: Charlie Marsh <charlie.r.marsh@gmail.com>
konstin added a commit that referenced this issue Jul 23, 2023
Implements
#5905 (comment)

---------

Co-authored-by: konsti <konstin@mailbox.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
rule Implementing or modifying a lint rule
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants