
ZeRO & Fastest BERT: Increasing the scale and speed of deep learning training in DeepSpeed webinar
August 6, 2020
The latest trend in AI is that larger natural language models provide better accuracy; however, larger models are difficult to train because of cost, time, and ease of code integration. With the goal of advancing large model training by improving scale, speed, cost, and usability…