GPipe and PipeDream: Scaling AI training in every direction
Data science is hard work, not a magical incantation. Whether an AI model performs as advertised depends on how well it’s been trained, and there’s no “one size fits all” approach for training AI models.
(Insider Story)