BMTrain

BMTrain is an efficient toolkit for training large models with tens of billions of parameters.