Skip to content

Add multi-gpu support for DP#166

Closed
alexandresablayrolles wants to merge 1 commit into
meta-pytorch:masterfrom
alexandresablayrolles:export-D24729467
Closed

Add multi-gpu support for DP#166
alexandresablayrolles wants to merge 1 commit into
meta-pytorch:masterfrom
alexandresablayrolles:export-D24729467

Conversation

@alexandresablayrolles

Copy link
Copy Markdown
Contributor

Summary:
Gaussian noise is seeded to make sure each worker adds the same Gaussian noise.

Speed: 950 img/s/GPU for {1,2} GPUs for Resnet-18 on 56*56 images.

Reviewed By: Darktex

Differential Revision: D24729467

@facebook-github-bot facebook-github-bot added CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported labels Apr 16, 2021
@facebook-github-bot

Copy link
Copy Markdown
Contributor

This pull request was exported from Phabricator. Differential Revision: D24729467

alexandresablayrolles pushed a commit to alexandresablayrolles/opacus that referenced this pull request Apr 16, 2021
Summary:
Pull Request resolved: meta-pytorch#166

Gaussian noise is seeded to make sure each worker adds the same Gaussian noise.

Speed: 950 img/s/GPU for {1,2} GPUs for Resnet-18 on 56*56 images.

Reviewed By: Darktex

Differential Revision: D24729467

fbshipit-source-id: dba68513e1d6d891ce2e38021bd0370d7ed1cf06
@facebook-github-bot

Copy link
Copy Markdown
Contributor

This pull request was exported from Phabricator. Differential Revision: D24729467

alexandresablayrolles pushed a commit to alexandresablayrolles/opacus that referenced this pull request Apr 16, 2021
Summary:
Pull Request resolved: meta-pytorch#166

Gaussian noise is seeded to make sure each worker adds the same Gaussian noise.

Speed: 950 img/s/GPU for {1,2} GPUs for Resnet-18 on 56*56 images.

Reviewed By: Darktex

Differential Revision: D24729467

fbshipit-source-id: f9f285ebef99e9710574fe96c86dc72eb7a106af
@facebook-github-bot

Copy link
Copy Markdown
Contributor

This pull request was exported from Phabricator. Differential Revision: D24729467

alexandresablayrolles pushed a commit to alexandresablayrolles/opacus that referenced this pull request Apr 16, 2021
Summary:
Pull Request resolved: meta-pytorch#166

Gaussian noise is seeded to make sure each worker adds the same Gaussian noise.

Speed: 950 img/s/GPU for {1,2} GPUs for Resnet-18 on 56*56 images.

Reviewed By: Darktex

Differential Revision: D24729467

fbshipit-source-id: 05dd4bfeb59b6f5b814323255d4b332dc5427f13
@facebook-github-bot

Copy link
Copy Markdown
Contributor

This pull request was exported from Phabricator. Differential Revision: D24729467

alexandresablayrolles pushed a commit to alexandresablayrolles/opacus that referenced this pull request Apr 19, 2021
Summary:
Pull Request resolved: meta-pytorch#166

Gaussian noise is seeded to make sure each worker adds the same Gaussian noise.

Speed: 950 img/s/GPU for {1,2} GPUs for Resnet-18 on 56*56 images.

Reviewed By: Darktex

Differential Revision: D24729467

fbshipit-source-id: d79d628b996770c07362f689ea6c66c6cbeab209
@facebook-github-bot

Copy link
Copy Markdown
Contributor

This pull request was exported from Phabricator. Differential Revision: D24729467

alexandresablayrolles pushed a commit to alexandresablayrolles/opacus that referenced this pull request Apr 20, 2021
Summary:
Pull Request resolved: meta-pytorch#166

Gaussian noise is seeded to make sure each worker adds the same Gaussian noise.

Speed: 950 img/s/GPU for {1,2} GPUs for Resnet-18 on 56*56 images.

Reviewed By: Darktex

Differential Revision: D24729467

fbshipit-source-id: d10f0dfd09fdd83a82e3611dcffdcbf008e37a2e
@facebook-github-bot

Copy link
Copy Markdown
Contributor

This pull request was exported from Phabricator. Differential Revision: D24729467

1 similar comment
@facebook-github-bot

Copy link
Copy Markdown
Contributor

This pull request was exported from Phabricator. Differential Revision: D24729467

alexandresablayrolles pushed a commit to alexandresablayrolles/opacus that referenced this pull request Apr 21, 2021
Summary:
Pull Request resolved: meta-pytorch#166

Gaussian noise is seeded to make sure each worker adds the same Gaussian noise.

Speed: 950 img/s/GPU for {1,2} GPUs for Resnet-18 on 56*56 images.

Reviewed By: Darktex

Differential Revision: D24729467

fbshipit-source-id: 765a38f26b904387e6bc0241c845e698ca0d8b93
Summary:
Pull Request resolved: meta-pytorch#166

Gaussian noise is seeded to make sure each worker adds the same Gaussian noise.

Speed: 950 img/s/GPU for {1,2} GPUs for Resnet-18 on 56*56 images.

Reviewed By: Darktex

Differential Revision: D24729467

fbshipit-source-id: 6effafe5ad094bddbd0f5b50edf6c31758b79d99
@facebook-github-bot

Copy link
Copy Markdown
Contributor

This pull request was exported from Phabricator. Differential Revision: D24729467

@facebook-github-bot

Copy link
Copy Markdown
Contributor

This pull request has been merged in da8f3fd.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported Merged

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants