A curated list of awesome Self-Supervised Learning resources. Inspired by awesome-deep-vision, awesome-adversarial-machine-learning, awesome-deep-learning-papers, and awesome-architecture-search
Self-Supervised Learning has become an exciting direction in AI community.
Please help contribute this list by pull request
Markdown format:
- Paper Name.
[[pdf]](link)
[[code]](link)
- Author 1, Author 2, and Author 3. *Conference Year*
A Theoretical Analysis of Contrastive Unsupervised Representation Learning. [pdf]
Towards the Generalization of Contrastive Self-Supervised Learning. [pdf]
Understanding the Behaviour of Contrastive Loss. [pdf]
Predicting What You Already Know Helps: Provable Self-Supervised Learning. [pdf]
Contrastive learning , multi-view redundancy , and linear models. [pdf]
Understanding Self-supervised Learning with Dual Deep Networks. [pdf]
For self-supervised learning, Rationality implies generalization, provably. [pdf]
Can Pretext-Based Self-Supervised Learning Be Boosted by Downstream Data? A Theoretical Analysis. [pdf]
Contrastive Representation Learning: A Framework and Review [pdf]
A Survey on Contrastive Self-supervised Learning [pdf]
Self-supervised Visual Feature Learning with Deep Neural Networks: A Survey. [pdf]
Self-supervised Learning: Generative or Contrastive [pdf]
Know Your Self-supervised Learning: A Survey on Image-based Generative and Discriminative Training [pdf]
FAIR Self-Supervision Benchmark [pdf] [repo]: various benchmark (and legacy) tasks for evaluating quality of visual representations learned by various self-supervision approaches.
How Well Do Self-Supervised Models Transfer? [pdf] [repo]: A benchmark for evaluating self-supervision consisting of many-shot/few-shot recognition, object detection, surface normal estimation and semantic segmentation.
Unsupervised Visual Representation Learning by Context Prediction. [pdf] [code]
Unsupervised Learning of Visual Representations using Videos. [pdf] [code]
Learning to See by Moving. [pdf] [code]
Learning image representations tied to ego-motion. [pdf] [code]
Joint Unsupervised Learning of Deep Representations and Image Clusters. [pdf] [code-torch] [code-caffe]
Unsupervised Deep Embedding for Clustering Analysis. [pdf] [code]
Slow and steady feature analysis: higher order temporal coherence in video. [pdf]
Context Encoders: Feature Learning by Inpainting. [pdf] [code]
Colorful Image Colorization. [pdf] [code]
Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles. [pdf] [code]
Ambient Sound Provides Supervision for Visual Learning. [pdf] [code]
Learning Representations for Automatic Colorization. [pdf] [code]
Unsupervised Visual Representation Learning by Graph-based Consistent Constraints. [pdf] [code]
Adversarial Feature Learning. [pdf] [code]
Self-supervised learning of visual features through embedding images into text topic spaces. [pdf] [code]
Split-Brain Autoencoders: Unsupervised Learning by Cross-Channel Prediction. [pdf] [code]
Learning Features by Watching Objects Move. [pdf] [code]
Colorization as a Proxy Task for Visual Understanding. [pdf] [code]
DeepPermNet: Visual Permutation Learning. [pdf] [code]
Unsupervised Learning by Predicting Noise. [pdf] [code]
Multi-task Self-Supervised Visual Learning. [pdf]
Representation Learning by Learning to Count. [pdf]
Transitive Invariance for Self-supervised Visual Representation Learning. [pdf]
Look, Listen and Learn. [pdf]
Unsupervised Representation Learning by Sorting Sequences. [pdf] [code]
Unsupervised Feature Learning via Non-parameteric Instance Discrimination [pdf] [code]
Learning Image Representations by Completing Damaged Jigsaw Puzzles. [pdf] [code]
Unsupervised Representation Learning by Predicting Image Rotations. [pdf] [code]
Learning Latent Representations in Neural Networks for Clustering through Pseudo Supervision and Graph-based Activity Regularization. [pdf] [code]
Improvements to context based self-supervised learning. [pdf]
Self-Supervised Feature Learning by Learning to Spot Artifacts. [pdf] [code]
Boosting Self-Supervised Learning via Knowledge Transfer. [pdf]
Cross-domain Self-supervised Multi-task Feature Learning Using Synthetic Imagery. [pdf] [code]
ShapeCodes: Self-Supervised Feature Learning by Lifting Views to Viewgrids. [pdf]
Deep Clustering for Unsupervised Learning of Visual Features [pdf] [code]
Cross Pixel Optical-Flow Similarity for Self-Supervised Learning. [pdf]
Representation Learning with Contrastive Predictive Coding. [pdf]
Self-Supervised Learning via Conditional Motion Propagation. [pdf] [code]
Self-Supervised Representation Learning by Rotation Feature Decoupling. [pdf] [code]
Revisiting Self-Supervised Visual Representation Learning. [pdf] [code]
Self-Supervised GANs via Auxiliary Rotation Loss. [pdf] [code]
AET vs. AED: Unsupervised Representation Learning by Auto-Encoding Transformations rather than Data. [pdf] [code]
Unsupervised Deep Learning by Neighbourhood Discovery. [pdf]. [code].
Contrastive Multiview Coding. [pdf] [code]
Large Scale Adversarial Representation Learning. [pdf]
Learning Representations by Maximizing Mutual Information Across Views. [pdf] [code]
Philip Bachman, R Devon Hjelm, William Buchwalter
Selfie: Self-supervised Pretraining for Image Embedding. [pdf]
Trieu H. Trinh, Minh-Thang Luong, Quoc V. Le
Data-Efficient Image Recognition with Contrastive Predictive Coding [pdf]
Olivier J. He ́naff, Ali Razavi, Carl Doersch, S. M. Ali Eslami, Aaron van den Oord
Using Self-Supervised Learning Can Improve Model Robustness and Uncertainty [pdf] [code]
Dan Hendrycks, Mantas Mazeika, Saurav Kadavath, Dawn Song. NeurIPS 2019
Boosting Few-Shot Visual Learning with Self-Supervision [pdf]
Pyros Gidaris, Andrei Bursuc, Nikos Komodakis, Patrick Pérez, and Matthieu Cord. ICCV 2019
Self-Supervised Generalisation with Meta Auxiliary Learning [pdf] [code]
Shikun Liu, Andrew J. Davison, Edward Johns. NeurIPS 2019
Wasserstein Dependency Measure for Representation Learning [pdf] [code]
Sherjil Ozair, Corey Lynch, Yoshua Bengio, Aaron van den Oord, Sergey Levine, Pierre Sermanet. NeurIPS 2019
Scaling and Benchmarking Self-Supervised Visual Representation Learning [pdf] [code]
Unsupervised Pre-Training of Image Features on Non-Curated Data [pdf] [code]
S4L: Self-Supervised Semi-Supervised Learning [pdf] [code]
Self-supervised model adaptation for multimodal semantic segmentation. [pdf] [code]
A critical analysis of self-supervision, or what we can learn from a single image [pdf] [code]
On Mutual Information Maximization for Representation Learning [pdf] [code]
Understanding the Limitations of Variational Mutual Information Estimators [pdf] [code]
Self-labelling via simultaneous clustering and representation learning [pdf] [blogpost] [code]
Self-supervised Label Augmentation via Input Transformations [pdf] [code]
Automatic Shortcut Removal for Self-Supervised Representation Learning [pdf]
A Simple Framework for Contrastive Learning of Visual Representations [pdf] [code]
How Useful is Self-Supervised Pretraining for Visual Tasks? [pdf] [code]
Momentum Contrast for Unsupervised Visual Representation Learning [pdf] [code]
ClusterFit: Improving Generalization of Visual Representations [pdf]
Self-Supervised Learning of Pretext-Invariant Representations [pdf]
Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning [pdf] [unofficial-code]
Jean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec, Pierre H. Richemond, Elena Buchatskaya, Carl Doersch, Bernardo Avila Pires, Zhaohan Daniel Guo, Mohammad Gheshlaghi Azar, Bilal Piot, Koray Kavukcuoglu, Rémi Munos, Michal Valko. NeurIPS 2020, Oral
Contrastive learning of global and local features for medical image segmentation with limited annotations [pdf] [code]
Krishna Chaitanya, Ertunc Erdil, Neerav Karani, Ender Konukoglu. NeurIPS 2020, Oral
Unsupervised Representation Learning by InvariancePropagation [pdf] [code]
Feng Wang, Huaping Liu, Di Guo, Fuchun Sun. NeurIPS 2020, Spotlight
Big Self-Supervised Models are Strong Semi-Supervised Learners [pdf] [code]
Ting Chen, Simon Kornblith, Kevin Swersky, Mohammad Norouzi, Geoffrey Hinton. NeurIPS 2020
Self-Supervised Prototypical Transfer Learning for Few-Shot Classification [pdf] [code]
Carlos Medina, Arnout Devos, Matthias Grossglauser
SCAN: Learning to Classify Images without Labels [pdf] [code]
Wouter Van Gansbeke, Simon Vandenhende, Stamatios Georgoulis, Marc Proesmans, Luc Van Gool. ECCV 2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments [pdf] [code]
Mathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal, Piotr Bojanowski, Armand Joulin. NeurIPS 2020
Self-Supervised Relational Reasoning for Representation Learning [pdf] [code]
Massimiliano Patacchiola, Amos Storkey. NeurIPS 2020, Spotlight
Exploring Simple Siamese Representation Learning [pdf] [unofficial-code]
Xinlei Chen, Kaiming He
Online Bag-of-Visual-Words Generation for Unsupervised Representation Learning [pdf] [code]
Spyros Gidaris, Andrei Bursuc, Gilles Puy, Nikos Komodakis, Matthieu Cord, Patrick Pérez
Rethinking the Value of Labels for Improving Class-Imbalanced Learning [pdf] [code]
Yuzhe Yang, Zhi Xu. NeurIPS 2020
Demystifying contrastive self-supervised learning: Invariances, augmentations and dataset biases [pdf]
Mitigating embedding and class assignment mismatch in unsupervised image classification [pdf] [code]
Self-Supervised Learning Across Domains [pdf]
Barlow twins: Self-supervised learning via redundancy reduction [pdf] [code]
Contrastive Semi-Supervised Learning for 2D Medical Image Segmentation [pdf]
Propagate Yourself: Exploring Pixel-Level Consistency for Unsupervised Visual Representation Learning [pdf] [code]
How Well Do Self-Supervised Models Transfer? [pdf] [code]
Vectorization and Rasterization: Self-Supervised Learning for Sketch and Handwriting.
[code]
Ayan Kumar Bhunia, Pinaki nath Chowdhury, Yongxin Yang, Timothy Hospedales, Tao Xiang, Yi-Zhe Song. CVPR 2021
SelfAugment: Automatic Augmentation Policies for Self-Supervised Learning [pdf] [code]
Colorado Reed, Sean Metzger, Aravind Srinivas, Trevor Darrell, Kurt Keutzer. CVPR 2021
Jigsaw Clustering for Unsupervised Visual Representation Learning [pdf] [code]
Pengguang Chen, Shu Liu, Jiaya Jia. CVPR 2021
Improving Unsupervised Image Clustering With Robust Learning [pdf] [code]
Sungwon Park, Sungwon Han, Sundong Kim, Danu Kim, Sungkyu Park, Seunghoon Hong, Meeyoung Cha. CVPR 2021
Improving Contrastive Learning by Visualizing Feature Transformation [pdf] [code]
Rui Zhu, Bingchen Zhao, Jingen Liu, Zhenglong Sun, Chang Wen Chen. ICCV 2021 Oral
Tailoring Self-Supervision for Supervised Learning [pdf] [code]
FedX: Unsupervised Federated Learning with Cross Knowledge Distillation [pdf] [code]
Masked Siamese Networks for Label-Efficient Learning [pdf] [code]
TriBYOL: Triplet BYOL for Self-Supervised Representation Learning [pdf]
Self-Knowledge Distillation based Self-Supervised Learning for Covid-19 Detection from Chest X-Ray Images [pdf]
VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning [pdf]
Inter-Instance Similarity Modeling for Contrastive Learning [pdf] [code]
Asymmetric Patch Sampling for Contrastive Learning [pdf] [code]
Unsupervised Learning of Video Representations using LSTMs. [pdf] [code]
Shuffle and Learn: Unsupervised Learning using Temporal Order Verification. [pdf] [code]
LSTM Self-Supervision for Detailed Behavior Analysis [pdf]
Self-Supervised Video Representation Learning With Odd-One-Out Networks. [pdf]
Unsupervised Learning of Long-Term Motion Dynamics for Videos. [pdf]
Geometry Guided Convolutional Neural Networks for Self-Supervised Video Representation Learning. [pdf]
Improving Spatiotemporal Self-Supervision by Deep Reinforcement Learning. [pdf]
Self-supervised learning of a facial attribute embedding from video. [pdf]
Self-Supervised Video Representation Learning with Space-Time Cubic Puzzles. [pdf]
Self-Supervised Spatio-Temporal Representation Learning for Videos by Predicting Motion and Appearance Statistics. [pdf]
DynamoNet: Dynamic Action and Motion Network. [pdf]
Learning Correspondence from the Cycle-consistency of Time. [pdf] [code]
Joint-task Self-supervised Learning for Temporal Correspondence. [pdf] [code]
Self-Supervised Video Representation Learning Using Inter-Intra Contrstive Framework [pdf] [code]
Video Playback Rate Perception for Self-Supervised Spatio-Temporal Representation Learning [pdf] [Code]
Self-Supervised Video Representation Learning by Pace Prediction [pdf] [code]
Video Representation Learning by Recognizing Temporal Transformations [pdf] [code]
Self-supervised Co-training for Video Representation Learning [pdf] [code]
Cycle-Contrast for Self-Supervised Video Representation Learning [pdf]
Video Representation Learning with Visual Tempo Consistency [pdf] [code]
Self-supervised Video Representation Learning by Uncovering Spatio-temporal Statistics [pdf]
Spatiotemporal Contrastive Video Representation Learning [pdf]
Self-Supervised Video Representation Using Pretext-Contrastive Learning [pdf]
Unsupervised Video Representation Learning by Bidirectional Feature Prediction [pdf]
RSPNet: Relative Speed Perception for Unsupervised Video Representation Learning [pdf] [code]
Hierarchically Decoupled Spatial-Temporal Contrast for Self-supervised Video Representation Learning [pdf]
Can Temporal Information Help with Contrastive Self-Supervised Learning? [pdf]
Enhancing Unsupervised Video Representation Learning by Decoupling the Scene and the Motion [pdf] [code]
Space-Time Correspondence as a Contrastive Random Walk [pdf] [code] [project]
Self-Supervised Deep Learning on Point Clouds by Reconstructing Space [pdf]
Self-Supervised Learning of Point Clouds via Orientation Estimation [pdf] [code]
Self-Supervised Learning on 3D Point Clouds by Learning Discrete Generative Models [pdf]
PointContrast: Unsupervised Pre-training for 3D Point Cloud [pdf] [code]
Guided Point Contrastive Learning for Semi-supervised Point Cloud Semantic Segmentation [pdf]
Ponder: Point Cloud Pre-training via Neural Rendering [pdf]
PonderV2: Pave the Way for 3D Foundation Model with A Universal Pre-training Paradigm [pdf] [code]
UniPAD: A Universal Pre-training Paradigm for Autonomous Driving [pdf] [code]
Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescue. [pdf] [code]
Self-supervised Learning of Motion Capture. [pdf] [code] [web]
Unsupervised learning of object frames by dense equivariant image labelling. [pdf]
Unsupervised Learning of Depth and Ego-Motion from Video. [pdf] [code] [web]
Active Stereo Net: End-to-End Self-Supervised Learning for Active Stereo Systems. [project]
Self-Supervised Relative Depth Learning for Urban Scene Understanding. [pdf] [project]
Geometry-Aware Learning of Maps for Camera Localization. [pdf] [code]
Self-supervised Learning of Geometrically Stable Features Through Probabilistic Introspection. [pdf] [web]
Self-Supervised Learning of 3D Human Pose Using Multi-View Geometry. [pdf]
SelFlow: Self-Supervised Learning of Optical Flow. [pdf]
Unsupervised Learning of Landmarks by Descriptor Vector Exchange. [pdf] [code] [web]
Audio-Visual Scene Analysis with Self-Supervised Multisensory Features. [pdf] [code]
Objects that Sound. [pdf]
Learning to Separate Object Sounds by Watching Unlabeled Video. [pdf] [project]
The Sound of Pixels. [pdf] [project]
Learnable PINs: Cross-Modal Embeddings for Person Identity. [pdf] [web]
Cooperative Learning of Audio and Video Models from Self-Supervised Synchronization. [pdf]
Self-Supervised Generation of Spatial Audio for 360° Video. [pdf]
TriCycle: Audio Representation Learning from Sensor Network Data Using Self-Supervision [pdf]
Self-supervised audio-visual co-segmentation [pdf]
Does Visual Self-Supervision Improve Learning of Speech Representations? [pdf]
There is More than Meets the Eye: Self-Supervised Multi-Object Detection and Tracking with Sound by Distilling Multimodal Knowledge [pdf] [code]
BYOL for Audio: Self-Supervised Learning for General-Purpose Audio Representation. [pdf] [code]
Learning State-Aware Visual Representations from Audible Interactions [pdf] [code]
Self-supervised Learning for Human Activity Recognition Using 700,000 Person-days of Wearable Data [pdf] [code]
Self-learning Scene-specific Pedestrian Detectors using a Progressive Latent Model. [pdf]
Free Supervision from Video Games. [pdf] [project+code]
Fighting Fake News: Image Splice Detection via Learned Self-Consistency [pdf] [code]
Self-supervised Tracking by Colorization (Tracking Emerges by Colorizing Videos). [pdf]
High-Fidelity Image Generation With Fewer Labels. [pdf]
Self-supervised Fitting of Articulated Meshes to Point Clouds.
Just Go with the Flow: Self-Supervised Scene Flow Estimation [pdf] [code]
SCOPS: Self-Supervised Co-Part Segmentation.
Self-Supervised Adaptation of High-Fidelity Face Models for Monocular Performance Tracking.
Multi-Task Self-Supervised Object Detection via Recycling of Bounding Box Annotations. [pdf] [code]
Self-Supervised Convolutional Subspace Clustering Network.
Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation.
Unsupervised 3D Pose Estimation With Geometric Self-Supervision.
Learning to Generate Grounded Image Captions without Localization Supervision. [pdf]
VideoBERT: A Joint Model for Video and Language Representation Learning [pdf]
Countering Noisy Labels By Learning From Auxiliary Clean Labels [pdf]
Self-Supervised Point Cloud Completion via Inpainting [pdf]
ColloSSL: Collaborative Self-Supervised Learning for Human Activity Recognition [pdf] [code]
Self-taught Learning: Transfer Learning from Unlabeled Data. [pdf]
Representation Learning: A Review and New Perspectives. [pdf]
Curiosity-driven Exploration by Self-supervised Prediction. [pdf] [code]
Large-Scale Study of Curiosity-Driven Learning. [pdf]
Playing hard exploration games by watching YouTube. [pdf]
Unsupervised State Representation Learning in Atari. [pdf] [code]
Visual Reinforcement Learning with Self-Supervised 3D Representations. [pdf] [code]
Improving Robot Navigation Through Self-Supervised Online Learning [pdf]
Reverse Optical Flow for Self-Supervised Adaptive Autonomous Robot Navigation [pdf]
Online self-supervised learning for dynamic object segmentation [pdf]
Self-Supervised Online Learning of Basic Object Push Affordances [pdf]
Self-supervised learning of grasp dependent tool affordances on the iCub Humanoid robot [pdf]
Persistent self-supervised learning principle: from stereo to monocular vision for obstacle avoidance [pdf]
The Curious Robot: Learning Visual Representations via Physical Interactions. [pdf]
Learning to Poke by Poking: Experiential Learning of Intuitive Physics. [pdf]
Supersizing Self-supervision: Learning to Grasp from 50K Tries and 700 Robot Hours. [pdf]
Supervision via Competition: Robot Adversaries for Learning Tasks. [pdf]
Multi-view Self-supervised Deep Learning for 6D Pose Estimation in the Amazon Picking Challenge. [pdf] [Project]
Combining Self-Supervised Learning and Imitation for Vision-Based Rope Manipulation. [pdf] [Project]
Learning to Fly by Crashing [pdf]
Self-supervised learning as an enabling technology for future space exploration robots: ISS experiments on monocular distance learning [pdf]
Unsupervised Perceptual Rewards for Imitation Learning. [pdf] [project]
Self-Supervised Visual Planning with Temporal Skip Connections. [pdf]
CASSL: Curriculum Accelerated Self-Supervised Learning. [pdf]
Time-Contrastive Networks: Self-Supervised Learning from Video. [pdf] [Project]
Self-Supervised Deep Reinforcement Learning with Generalized Computation Graphs for Robot Navigation. [pdf]
Learning Actionable Representations from Visual Observations. [pdf] [Project]
Learning Synergies between Pushing and Grasping with Self-supervised Deep Reinforcement Learning. [pdf] [Project]
Visual Reinforcement Learning with Imagined Goals. [pdf] [Project]
Grasp2Vec: Learning Object Representations from Self-Supervised Grasping. [pdf] [Project]
Robustness via Retrying: Closed-Loop Robotic Manipulation with Self-Supervised Learning. [pdf] [Project]
Learning Long-Range Perception Using Self-Supervision from Short-Range Sensors and Odometry. [pdf]
Learning Latent Plans from Play. [pdf] [Project]
Self-Supervised Visual Terrain Classification from Unsupervised Acoustic Feature Learning. [pdf]
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. [pdf] [link]
Self-Supervised Dialogue Learning [pdf]
Self-Supervised Learning for Contextualized Extractive Summarization [pdf]
A Mutual Information Maximization Perspective of Language Representation Learning [pdf]
VL-BERT: Pre-training of Generic Visual-Linguistic Representations [pdf] [code]
A Simple and Effective Self-Supervised Contrastive Learning Framework for Aspect Detection [pdf] [code]
Self-Guided Contrastive Learning for BERT Sentence Representations [pdf] [code]
wav2vec: Unsupervised Pre-Training for Speech Recognition [pdf] [code]
Learning Robust and Multilingual Speech Representations [pdf]
Unsupervised Pretraining Transfers Well Across Languages [pdf] [code]
vq-wav2vec: Self-Supervised Learning of Discrete Speech Representations [pdf]
Effectiveness of Self-supervised Pre-training for Speech Recognition [pdf]
Towards Unsupervised Speech Recognition and Synthesis with Quantized Speech Representation Learning [pdf]
Self-Training for End-to-End Speech Recognition [pdf]
Generative Pre-Training for Speech with Autoregressive Predictive Coding [pdf] [code]
Disentangled Speech Embeddings using Cross-modal Self-supervision [pdf]
Multi-task Self-supervised Learning for Robust Speech Recognition [pdf]
Visually Guided Self Supervised Learning of Speech Representations [pdf]
Mockingjay: Unsupervised Speech Representation Learning with Deep Bidirectional Transformer Encoders [pdf] [code]
Vector-Quantized Autoregressive Predictive Coding [pdf] [code]
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations [pdf] [code]
Robust wav2vec 2.0: Analyzing Domain Shift in Self-Supervised Pre-Training [pdf] [code]
HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units [pdf] [code]
Unsupervised Speech Recognition [pdf] [code]
TERA: Self-Supervised Learning of Transformer Encoder Representation for Speech [pdf] [code]
Non-Autoregressive Predictive Coding for Learning Speech Representations from Local Dependencies [pdf] [code]
Unsupervised Scalable Representation Learning for Multivariate Time Series [pdf] [code]
Time-Series Representation Learning via Temporal and Contextual Contrasting [pdf] [code]
Unsupervised Representation Learning for Time Series with Temporal Neighborhood Coding [pdf] [code]
A Transformer-Based Framework for Multivariate Time Series Representation Learning [pdf] [code]
Deep Graph Infomax [pdf] [code]
When Does Self-Supervision Help Graph Convolutional Networks [pdf]
Multi-Stage Self-Supervised Learning for Graph Convolutional Networks on Graphs with Few Labels [pdf]
Gaining insight into SARS-CoV-2 infection and COVID-19 severity using self-supervised edge features and Graph Neural Networks [pdf]
Deep Graph Contrastive Representation Learning [pdf] [code]
Contrastive Multi-View Representation Learning on Graphs [pdf]
GCC: Graph Contrastive Coding for Graph Neural Network Pre-Training [pdf]
GPT-GNN: Generative Pre-Training of Graph Neural Networks [pdf] [code]
Self-supervised Learning on Graphs: Deep Insights and New Direction [pdf]
Self-Supervised Learning of Contextual Embeddings for Link Prediction in Heterogeneous Networks [pdf] [code]
Self-Supervised Hyperboloid Representations from Logical Queries over Knowledge Graphs [pdf] [code]
GraphMAE: Self-supervised Masked Graph Autoencoders [pdf] [code]
To the extent possible under law, Zhongzheng Ren has waived all copyright and related or neighboring rights to this work.