RuBioRoBERTa

BERT-based model for Russian language biomedical text mining

The first model in Russia for the analysis and recognition of medical texts, trained on a large corpus of biomedical texts. The model is available for further training for any tasks to solve the problems of practical healthcare on relatively small datasets.

The model can be found here:

https://huggingface.co/alexyalunin/RuBioRoBERTa

Contact

If you have any questions, please post a Github issue.

Citation

If you find this repo useful, please cite as:

@article{yalunin2022rubioroberta,
  title={RuBioRoBERTa: a pre-trained biomedical language model for Russian language biomedical text mining},
  author={Yalunin, Alexander and Nesterov, Alexander and Umerenkov, Dmitriy},
  journal={arXiv preprint arXiv:2204.03951},
  year={2022}
}