Optical Illusions in CLIP — Embedding Space
adjust region or rotation
Region focus
Rotation
0°
Region and rotation both shift CLIP's classification — just like directing human attention does.
CLIP Embedding Space (PCA)
adjust the controls to see classification shift