CH 11.1Ch-1 Encoder-Only Paradigm1BERT_Architecture2Masked_LM_Pretraining3RoBERTa_and_DeBERTa4Sentence_Transformers_and_BiEncodersCH 21.2Ch-2 Encoder-Decoder Paradigm1T5_Text_to_Text_Framework2BART_and_Denoising_AutoencodersCH 31.3Ch-3 Causal Decoder Paradigm1Autoregressive_Language_Modeling2GPT_1_Pretraining_and_Finetuning3GPT_2_Architecture_Deep_Dive4Zero_Shot_Task_Transfer
CH 11.1Ch-1 Encoder-Only Paradigm1BERT_Architecture2Masked_LM_Pretraining3RoBERTa_and_DeBERTa4Sentence_Transformers_and_BiEncoders
CH 31.3Ch-3 Causal Decoder Paradigm1Autoregressive_Language_Modeling2GPT_1_Pretraining_and_Finetuning3GPT_2_Architecture_Deep_Dive4Zero_Shot_Task_Transfer