Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Removal of scandir package from requirements-ci.txt #7633

Merged
merged 1 commit into from
May 21, 2024

Conversation

pmisik
Copy link
Contributor

@pmisik pmisik commented May 19, 2024

scandir has been included in the Python 3.5 standard library as os.scandir(), and the related performance improvements to os.walk() have also been included. see https://github.com/benhoyt/scandir?tab=readme-ov-file#now-included-in-a-python-near-you

As Buildbot now requires Python 3.8 or newer we can use standard library rather than package.

Fixes #7632

Contributor Checklist:

  • I have updated the unit tests
  • I have created a file in the newsfragments directory (and read the README.txt in that directory)
  • I have updated the appropriate documentation

@pmisik pmisik marked this pull request as ready for review May 19, 2024 16:53
@p12tic
Copy link
Member

p12tic commented May 19, 2024

requirements-ci.txt is used to ensure that the set of installed packages is reproducible in CI. We should ensure that scandir does not come from some transitive dependency. We can remove this package only if there are no such dependencies.

@pmisik
Copy link
Contributor Author

pmisik commented May 21, 2024

If there was a transitive dependency, then scandir should appear in the pip list output.
I do not see failing pip check with scandir error or listed in pip list step
There are failing pip check but they are unrelated like and they test forced old twisted

treq 23.11.0 has requirement Twisted[tls]>=22.10.0, but you have twisted 18.7.0.
treq 23.11.0 has requirement Twisted[tls]>=22.10.0, but you have twisted 22.4.0.

https://buildbot.buildbot.net/#/builders/2/builds/5753

May I ask what should I look for and check?

@pmisik pmisik changed the title Removal of scandir package from requirements Removal of scandir package from requirements-ci.txt May 21, 2024
@p12tic
Copy link
Member

p12tic commented May 21, 2024

If there was a transitive dependency, then scandir should appear in the pip list output.

You're right. I removed the transitive dependencies from requirements-ci.txt, installed it and it didn't bring scandir.

`scandir` has been included in the Python 3.5 standard library as os.scandir(), and the related performance improvements to os.walk() have also been included.
see https://github.com/benhoyt/scandir?tab=readme-ov-file#now-included-in-a-python-near-you

As Buildbot now requires Python 3.8 or newer we can use standard library rather than package.

Fixes buildbot#7632
@p12tic p12tic merged commit bcf0cda into buildbot:master May 21, 2024
32 of 35 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Removal of scandir package from requirements
2 participants