开发者

Train mobileBERT from scratch for other languages

I am thinking开发者_运维知识库 of training a mobileBERT model from scratch for the German language. Can I use the English mobileBERT model from HuggingFace to apply it to a dataset in another language? It makes sense that I would have to adapt the teacher model of mobileBERT to a BERT model of the corresponding language. Unfortunately, I could not find a parameter to adapt the teacher model.

Are there any other ideas on how best to train a mobileBERT model for another language?

Many greetings and many thanks! ALPacker

0

上一篇:

下一篇:

精彩评论

暂无评论...
验证码 换一张
取 消

最新问答

问答排行榜