My Implementations' Archive

Archive Index

Reproduced Papers

• BERTScore: Evaluating Text Generation with BERT
  • Document
  • Run Evaluation
• Distil-Whisper: Robust Knowledge Distillation via Large-Scale Pseudo Labelling
  • Document
  • Run Pseudo Labelling
  • Initialize Distilled Whisper
  • Run Distillation
• SlimPajama-DC- Understanding Data Combinations for LLM Training
  • Run ETL

Model Training/Inference Runners

• Distil-Whisper: Robust Knowledge Distillation via Large-Scale Pseudo Labelling
  • Document
  • Run Pseudo Labelling
  • Initialize Distilled Whisper
  • Run Distillation
• flan-T5
  • Document
  • Fine-Tune
  • Inference
• LLM
  • Document
  • Fine-Tune

Crawlers

Audio Corpus Crawlers

ETL

• Line-Based Splitter to Generate Train/Dev/Test Dataset
  • bash ./bin/etl/train_dev_test_splitter_for_lines_data.sh ${DATA_LINES_PATH} ${DEV_DATA_SIZE} ${TEST_DATA_SIZE}
• SlimPajama-DC Text Corpus Low-Length Filtering and Deduplication
  • python ./bin/etl/dataset/text_corpus/text_corpus_slimpajama_dc_processor.py ./bin/etl/dataset/text_corpus/text_corpus_slimpajama_dc_processor.json