Pre-training

We describe the data and configuration for our customized $\text{BERT}$ model. You are free to download the pre-trained models and use them for your projects based on source code encoding.