MIM高频与对比学习

  • What do self-supervised vision transformers learn?
    MIM更关注纹理这种高频信息,对比学习更关注形状
    Analyzing Local Representations of Self-supervised Vision Transformers
    直接移除MIM中高方差特征后性能提升