Pre-training

We describe the data and configuration for our customized BERT\text{BERT} model. You are free to download the pre-trained models and use them for your projects based on source code encoding.