Skip to content

Multi-gpu error with gradio from gpu_infer cast type: 'str' object cannot be interpreted as an integer#95

Open
pftq wants to merge 4 commits intoali-vilab:mainfrom
pftq:main
Open

Multi-gpu error with gradio from gpu_infer cast type: 'str' object cannot be interpreted as an integer#95
pftq wants to merge 4 commits intoali-vilab:mainfrom
pftq:main

Conversation

@pftq
Copy link
Copy Markdown

@pftq pftq commented Jun 14, 2025

When running gradio with multi-gpu, it results in an error from gpu_infer being cast as a string because os.environ.get('LOCAL_WORLD_SIZE') returns a string. This PR fixes it by casting to int

After this, gradio works great with multi-gpu support:

gpu_count=2
python vace/gradios/vace_wan_demo.py \
--mp --ulysses_size ${gpu_count} --ring_size 1 \
--model_name "vace-14B" \
--ckpt_dir "models/Wan2.1-VACE-14B/"

@CLAassistant
Copy link
Copy Markdown

CLAassistant commented Jun 14, 2025

CLA assistant check
All committers have signed the CLA.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants