Training framework with neural networks, compatible with multiple GPU training
Development ideas from:
- https://github.com/ilkarman/DeepLearningFrameworks
- https://towardsdatascience.com/speed-up-your-algorithms-part-1-pytorch-56d8a4ae7051
- https://pytorch.org/tutorials/beginner/former_torchies/parallelism_tutorial.html
- https://pytorch.org/tutorials/beginner/blitz/data_parallel_tutorial.html
- https://thispointer.com/how-to-append-text-or-lines-to-a-file-in-python/
Want to add further:
- https://towardsdatascience.com/a-bunch-of-tips-and-tricks-for-training-deep-neural-networks-3ca24c31ddc8
- https://medium.com/huggingface/training-larger-batches-practical-tips-on-1-gpu-multi-gpu-distributed-setups-ec88c3e51255
- https://camel.readthedocs.io/en/latest/yamlref.html
- http://blog.vwelch.com/2011/04/combining-configparser-and-argparse.html
- https://blog.paperspace.com/pytorch-memory-multi-gpu-debugging/