Basic implementation of BERT and Transformer in Pytorch in one short python file (also includes "predict next word" GPT task)
-
Updated
Jan 9, 2024 - Python
Basic implementation of BERT and Transformer in Pytorch in one short python file (also includes "predict next word" GPT task)
DrBERT: A Robust Pre-trained Model in French for Biomedical and Clinical domains
A project during my summer internship at the LIRMM
The project is still in its infancy. It is not functional as is. However some simple sentences are already handled.
Add a description, image, and links to the taln topic page so that developers can more easily learn about it.
To associate your repository with the taln topic, visit your repo's landing page and select "manage topics."