Language-speech Pretraining

We are working on pre-trained language model, including new pre-training method, pre-trained model compression, pre-training for other tasks such as speech and music.