Data

We pre-trained our custom $\text{BERT}$ models by using the data from the CodeSearchNet challenge project. The datasets are freely available.

The following table reports the size of the pre-training datasets and the links to download the datasets. We report in bold the language datasets, or their combinations, we used to produce the pre-trained models.