Pre-Training

The initial phase of training a model on a massive dataset to learn general language and code patterns. Pre-training is computationally expensive but produces a versatile base model ready for fine-tuning.