The official PyTorch implementation of the paper "SAITS: Self-Attention-based Imputation for Time Series". A fast and state-of-the-art (SOTA) deep-learning neural network model for efficient time-series imputation (impute multivariate incomplete time series containing NaN missing data/values with machine learning). https://arxiv.org/abs/2202.08516

Self-attentive deep learning method for online traffic classification and its interpretability (CN21 & NetAI20)

《李宏毅深度学习教程》（李宏毅老师推荐👍），PDF下载地址：https://github.com/datawhalechina/leedl-tutorial/releases

[CVPR 2024 Best paper award candidate] EGTR: Extracting Graph from Transformer for Scene Graph Generation

An unofficial pytorch implementation of 'Efficient Infinite Context Transformers with Infini-attention'

[MIR-2023-Survey] A continuously updated paper list for multi-modal pre-trained big models

Porting vision models to Keras 3 for easily accessibility. Contains MobileViT v1, MobileViT v2

Implementing a GPT (Generative Pre-trained Transformer) model from scratch on Shakespeare's work.

An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

With the goal of recovering high-quality image content from its degraded version, image restoration enjoys numerous applications, such as in photography, security, medical imaging, and remote sensing. In this project I have implemented an model named MirNet for low-light image enhancement.

Repo for ML Models built from scratch such as Self-Attention, Linear +Logistic Regression, PCA, LDA. CNN, LSTM, Neural Networks using Numpy only

Materials for our paper: K. Apostolidis, J. Abesser, L. Cuccovillo, V. Mezaris, "Visual and audio scene classification for detecting discrepancies in video: a baseline method and experimental protocol", Proc. ACM Int. Workshop on Multimedia AI against Disinformation (MAD’24) at the ACM Int. Conf. on Multimedia Retrieval (ICMR’24)

PyTorch implementation of U-TAE and PaPs for satellite image time series panoptic segmentation.

Multi-stain graph self attention multiple instance learning for histopathology Whole Slide Images - BMVC 2023

[ICLR 2024] Official PyTorch implementation of FasterViT: Fast Vision Transformers with Hierarchical Attention

The GitHub repository for the paper "Informer" accepted by AAAI 2021.

Simple character level Transformer

A engine for the Orca AI architechure, written in Python.

This collection of notebooks is based on the Dive into Deep Learning Book. All of the notes are written in Pytorch and the d2l/torch library