Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fixed the Windows build. #5596

Merged
merged 3 commits into from
May 31, 2024
Merged

Fixed the Windows build. #5596

merged 3 commits into from
May 31, 2024

Conversation

costin-eseanu
Copy link
Contributor

Fixed the Windows build.

Fixes applied:

  • Remove some more ops that don't build on Windows.
  • Remove the use of symlinks that didn't work correctly and replace with shutil.copytree().
  • Small fixes to make the C++ code compile.

Tested with Python 3.9 and CUDA 12.1.

@tjruwase tjruwase requested review from loadams and removed request for arashb and awan-10 May 31, 2024 20:24
@tjruwase
Copy link
Contributor

@costin-eseanu, see below to resolve formatting
https://github.com/microsoft/DeepSpeed/blob/master/CONTRIBUTING.md

@loadams loadams added this pull request to the merge queue May 31, 2024
Merged via the queue into master with commit e7dd28a May 31, 2024
13 checks passed
@costin-eseanu costin-eseanu deleted the costineseanu/windows_build branch June 4, 2024 22:54
sfc-gh-reyazda pushed a commit to Snowflake-Labs/DeepSpeed that referenced this pull request Jun 10, 2024
Fixed the Windows build.

Fixes applied:
- Remove some more ops that don't build on Windows.
- Remove the use of symlinks that didn't work correctly and replace with
`shutil.copytree()`.
- Small fixes to make the C++ code compile.

Tested with Python 3.9 and CUDA 12.1.

---------

Co-authored-by: Costin Eseanu <costineseanu@gmail.com>
Co-authored-by: Logan Adams <114770087+loadams@users.noreply.github.com>
@ChangxingJiang
Copy link

this commit may cause a build error. There use the wrong path and shutil.copytree cannot cover the exists file.

if sys.platform == "win32":
    shutil.copytree('.\\csrc', '.\\deepspeed\\ops')
    shutil.copytree('.\\op_builder', '.\\deepspeed\\ops')
    shutil.copytree('.\\accelerator', '.\\deepspeed\\accelerator')
    egg_info.manifest_maker.template = 'MANIFEST_win.in'

@loadams
Copy link
Contributor

loadams commented Jun 19, 2024

Hi @ChangxingJiang - this should be fixed in #5609, can you confirm there?

@ChangxingJiang
Copy link

Hi @ChangxingJiang - this should be fixed in #5609, can you confirm there?

Yes, is useful.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants