conview's comments

On: DinoV2: Meta’s Open Source State-of-the-art computer vision models

[conview]

Quick overview of DINOv2: https://mchromiak.github.io/articles/2023/Apr/18/DINOv2-Lear...

On: DINOv2: State-of-the-art computer vision models with self-supervised learning

[conview]

https://mchromiak.github.io/articles/2023/Apr/18/DINOv2-Lear...

On: Masked Autoencoders Are Scalable Vision Learners – New SSL Algorithm

[conview]

The return of patch-based self-supervision! No ResNets but from one of the authors of the initial paper. Now with ViT, very simple self-supervised (SSL) pre-training shines again. It outperforms the contrastive learning counterparts and is simpler than BEiT, as its pixel-based (no tokenisation) needed. No need for special augmentation considerations like BYOL. i1k=87.8%

On: Decision Transformer; Transformer for RL partially ditching dynamic programming

[conview]

The "Decision Transformer: Reinforcement Learning via Sequence Modeling" : by Chen L. et al explaining how to use transformer to replace dynamic programming for context length reference.

On: MLP-Mixer: How can pure MLP be useful?

[conview]

An explanatory article on how can MLP is still useful comparing to modern machine learning architectures without convolutions, nor attention.