Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Core] Unable to run worker with virtual environment without installing dashboard #45410

Open
SebastianMorawiec opened this issue May 17, 2024 · 2 comments
Assignees
Labels
bug Something that is supposed to be working; but isn't core Issues that should be addressed in Ray Core P2 Important issue, but not time-critical

Comments

@SebastianMorawiec
Copy link

What happened + What you expected to happen

Ive tried to minimize the dependencies inherited from Ray.
I am trying to run Ray Remote with new virtualenv (adding new dependencies).

If I am only installing pip install ray==2.9.0 I get an error that there is no such package as virtualenv from worker.
I need to install pip install ray[default]==2.9.0 to make it work, which brings 23 more dependencies bunch of them related to ray-dashboard which I am not interested it.

I can add virtualenv to my own dependencies, but I'd have to maintain dependency that actually Ray uses.

TLDR:
Please add your virtualenv to default dependencies.

Versions / Dependencies

Ray 2.9.0 (same goes for 2.22 tho)

Reproduction script

n/a

Issue Severity

High: It blocks me from completing my task.

@SebastianMorawiec SebastianMorawiec added bug Something that is supposed to be working; but isn't triage Needs triage (eg: priority, bug/not-bug, and owning component) labels May 17, 2024
@anyscalesam anyscalesam added the core Issues that should be addressed in Ray Core label May 20, 2024
@rynewang
Copy link
Contributor

Do you mean runtime environment from Ray? This feature requires ray[default], because we need those dependencies to set up things. If you don't want runtime env, you can create an image and install deps in it, thus avoiding runtime env.

@rynewang rynewang added P2 Important issue, but not time-critical and removed triage Needs triage (eg: priority, bug/not-bug, and owning component) labels May 20, 2024
@rynewang rynewang self-assigned this May 20, 2024
@SebastianMorawiec
Copy link
Author

I want to be able to run Ray Remotes with runtime environment, without installing Ray Dashboard.
Ray[default] installs (AFAIR) 34 more dependencies than just Ray with no extra.
To run Ray Remote with runtime environments, I need to install Ray and separately install virtualenv dependnecy.
Would be much better IMHO if virutalenv just became standard dependnency without any extras

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something that is supposed to be working; but isn't core Issues that should be addressed in Ray Core P2 Important issue, but not time-critical
Projects
None yet
Development

No branches or pull requests

3 participants