Discussions

• 1 You must be logged in to vote

  🤖

  replace_sampler_ddp + batch_sampler

  sshleifer asked Sep 11, 2020 in DDP / multi-GPU / multi-node · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🤖

  Attribute is reset per batch in dp mode

  siahuat0727 asked Sep 1, 2020 in DDP / multi-GPU / multi-node · Answered

  

  

  

  

  3
• 1 You must be logged in to vote

  🤖

  extremely slow training with multiple GPUs

  pamparana34 asked Jun 3, 2020 in DDP / multi-GPU / multi-node · Answered

  

  

  

  

  4
• 0 You must be logged in to vote

  ⚡

  Correctly using IoU and ConfusionMatrix

  remisphere asked Jul 29, 2020 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  

  

  6
• 1 You must be logged in to vote

  🤖

  Is Sync BatchNorm supported?

  nynyg asked Jul 5, 2020 in DDP / multi-GPU / multi-node · Unanswered

  

  

  

  

  8
• 1 You must be logged in to vote

  🤖

  How to get ddp working for custom collate functions

  edraizen asked Sep 9, 2020 in DDP / multi-GPU / multi-node · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🤖

  Distributed Modes Speed Benchmark

  briankosw asked Sep 10, 2020 in DDP / multi-GPU / multi-node · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ⚡

  Multi-GPU "[LightningModule] object has no attribute [attribute]"

  andrewjong asked Aug 22, 2020 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  5
• 1 You must be logged in to vote

  🤖

  Multi-GPU Training GPU Usage

  zhenhuahu asked Jul 25, 2020 in DDP / multi-GPU / multi-node · Answered

  

  

  4
• 1 You must be logged in to vote

  🤖

  Does Pytorch-Lightning have a multiprocessing (or Joblib) module?

  leockl asked Jul 27, 2020 in DDP / multi-GPU / multi-node · Answered

  

  

  1
• 1 You must be logged in to vote

  🤖

  Custom Logger gather results for ddp?

  Data-drone asked May 26, 2020 in DDP / multi-GPU / multi-node · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🤖

  What's the Correct Batch Size in Distributed Data Parallel Training?

  zhenhuahu asked Jul 24, 2020 in DDP / multi-GPU / multi-node · Answered

  

  

  2
• 1 You must be logged in to vote

  🤖

  version 0.7.6 is 2x faster than version 0.8.1

  ternaus asked Jun 19, 2020 in DDP / multi-GPU / multi-node · Unanswered

  

  

  

  

  6
• 1 You must be logged in to vote

  🤖

  Multi-GPU when using Torchtext iterator for data loading

  aitor-garcia-p asked Sep 16, 2019 in DDP / multi-GPU / multi-node · Unanswered

  

  

  

  

  22
• 1 You must be logged in to vote

  🤖

  Bind a LightningModule to more than 1 GPU.

  lucadiliello asked Apr 14, 2020 in DDP / multi-GPU / multi-node · Unanswered

  

  

  

  

  5
• 1 You must be logged in to vote

  🤖

  Is it possible for SLURM auto submit to work on DP?

  philip30 asked Apr 11, 2020 in DDP / multi-GPU / multi-node · Answered

  

  

  3
• 1 You must be logged in to vote

  🤖

  How to use pytorch-lightning distributed training without SLURM?

  areshytko asked Apr 1, 2020 in DDP / multi-GPU / multi-node · Answered

  

  

  2
• 1 You must be logged in to vote

  🤖

  multi-gpu inference during training

  AljoSt asked Mar 3, 2020 in DDP / multi-GPU / multi-node · Unanswered

  

  

  

  

  4
• 1 You must be logged in to vote

  🤖

  online hard-example mining/examining under Multi-GPU ='dp'

  KentChun33333 asked Mar 17, 2020 in DDP / multi-GPU / multi-node · Answered

  

  

  

  

  3
• 2 You must be logged in to vote

  🤖

  Why MultiGPU dp seems slower?

  ricardorei asked Mar 2, 2020 in DDP / multi-GPU / multi-node · Answered

  

  

  1
• 1 You must be logged in to vote

  🤖

  Trainer super slow on single node, 2 GPU SLURM

  LucFrachon asked Jan 30, 2020 in DDP / multi-GPU / multi-node · Unanswered

  

  

  5
• 1 You must be logged in to vote

  ⚡

  Unfreezing layers during training?

  s-rog asked Nov 2, 2019 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Answered

  

  

  1
• 1 You must be logged in to vote

  ⚡

  Where is EarlyStopping searching for metrics?

  felixkreuk asked Jan 8, 2020 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Answered

  

  

  

  

  8
• 1 You must be logged in to vote

  ⚡

  What is hparams exactly?

  keunwoochoi asked Dec 26, 2019 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Answered

  

  

  

  

  6
• 2 You must be logged in to vote

  🤖

  Accessing validation metrics at checkpoint from outside module in ddp mode

  LucFrachon asked Jan 13, 2020 in DDP / multi-GPU / multi-node · Unanswered

  

  

  

  

  7