pre-training

An benchmark for evaluating the capabilities of large vision-language models (LVLMs)

This repository collects awesome representative papers and resources for "From Pre-training to Post-training: A Survey on Time Series Foundation Models" (TechRxiv-26).

Implementation of COCO-LM, Correcting and Contrasting Text Sequences for Language Model Pretraining, in Pytorch

从零开始学大模型Transformer、GPT2、BERT pre-training and fine-tuning from scratch

This is an official pytorch implementation for paper "A Unified Shape-Aware Foundation Model for Time Series Classification" (AAAI-26).

A distributed training framework for large language models powered by Lightning.

Code for reproducing the experiments on large-scale pre-training and transfer learning for the paper "Effect of large-scale pre-training on full and few-shot transfer learning for natural and medical images" (https://arxiv.org/abs/2106.00116)

(WACV'24) Kaizen: Practical self-supervised continual learning with continual fine-tuning

预训练模型知识量度量竞赛 Baseline F1 0.35 BERTForMaskedLM

Source codes and datasets for paper "Zero-1-to-3: Domain-level Zero-shot Cognitive Diagnosis via One Batch of Early-bird Students towards Three Diagnostic Objectives" (AAAI2024)