[tests] tighten dependency testing.#13332

sayakpaul wants to merge 4 commits intomainhuggingface/diffusers:mainfrom

revisit-deps-testshuggingface/diffusers:revisit-deps-testsCopy head branch name to clipboard