fix padding side issue for fast_vlm tests - #45592

fix padding side issue for fast_vlm tests#45592

ydshieh merged 3 commits into

huggingface:mainhuggingface/transformers:mainfrom

kaixuanliu:fast-vlm-fixkaixuanliu/transformers:fast-vlm-fixCopy head branch name to clipboard