Привет, мы в Deeppavlov тюнили мультиязычный и русский Sentence BERT на NLI тасках:
http://docs.deeppavlov.ai/en/master/features/models/bert.htmlSentence Multilingual BERT is a representation-based sentence encoder for 101 languages of Multilingual BERT. It is initialized with Multilingual BERT and then fine-tuned on english MultiNLI and on dev set of multilingual XNLI.
Sentence RuBERT is a representation-based sentence encoder for Russian. It is initialized with RuBERT and fine-tuned on SNLI google-translated to russian and on russian part of XNLI dev set.
Sentence representations are mean pooled token embeddings in the same manner as in original Sentence-BERT.