cannot import name 'MT5Tokenizer' from 'transformers'

[n1ck-guo]

Describe the bug

When using diffusers with transformers, it shows this bug:

E RuntimeError: Failed to import diffusers.pipelines.auto_pipeline because of the following error (look up to see its traceback):
E Failed to import diffusers.pipelines.hunyuandit.pipeline_hunyuandit because of the following error (look up to see its traceback):
E cannot import name 'MT5Tokenizer' from 'transformers' (/home/hengguo/miniforge3/envs/ar_env/lib/python3.12/site-packages/transformers/init.py)

Cause in pipeline_hunyuandit.py : from transformers import BertModel, BertTokenizer, CLIPImageProcessor, MT5Tokenizer, T5EncoderModel

Reproduction

pipe = AutoPipelineForText2Image.from_pretrained("black-forest-labs/FLUX.1-dev")

Logs

./../../../miniforge3/envs/ar_env/lib/python3.12/site-packages/diffusers/utils/import_utils.py:1016: in _get_module
    return importlib.import_module("." + module_name, self.__name__)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
../../../../miniforge3/envs/ar_env/lib/python3.12/importlib/__init__.py:90: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<frozen importlib._bootstrap>:1381: in _gcd_import
    ???
<frozen importlib._bootstrap>:1354: in _find_and_load
    ???
<frozen importlib._bootstrap>:1325: in _find_and_load_unlocked
    ???
<frozen importlib._bootstrap>:929: in _load_unlocked
    ???
<frozen importlib._bootstrap_external>:994: in exec_module
    ???
<frozen importlib._bootstrap>:488: in _call_with_frames_removed
    ???
../../../../miniforge3/envs/ar_env/lib/python3.12/site-packages/diffusers/pipelines/hunyuandit/pipeline_hunyuandit.py:20: in <module>
    from transformers import BertModel, BertTokenizer, CLIPImageProcessor, MT5Tokenizer, T5EncoderModel
E   ImportError: cannot import name 'MT5Tokenizer' from 'transformers' (/home/hengguo/miniforge3/envs/ar_env/lib/python3.12/site-packages/transformers/__init__.py)

The above exception was the direct cause of the following exception:
../../../../miniforge3/envs/ar_env/lib/python3.12/site-packages/diffusers/utils/import_utils.py:1016: in _get_module
    return importlib.import_module("." + module_name, self.__name__)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
../../../../miniforge3/envs/ar_env/lib/python3.12/importlib/__init__.py:90: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
<frozen importlib._bootstrap>:1381: in _gcd_import
    ???
<frozen importlib._bootstrap>:1354: in _find_and_load
    ???
<frozen importlib._bootstrap>:1325: in _find_and_load_unlocked
    ???
<frozen importlib._bootstrap>:929: in _load_unlocked
    ???
<frozen importlib._bootstrap_external>:994: in exec_module
    ???
<frozen importlib._bootstrap>:488: in _call_with_frames_removed
    ???
../../../../miniforge3/envs/ar_env/lib/python3.12/site-packages/diffusers/pipelines/auto_pipeline.py:55: in <module>
    from .hunyuandit import HunyuanDiTPipeline
<frozen importlib._bootstrap>:1406: in _handle_fromlist
    ???
../../../../miniforge3/envs/ar_env/lib/python3.12/site-packages/diffusers/utils/import_utils.py:1006: in __getattr__
    module = self._get_module(self._class_to_module[name])
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
../../../../miniforge3/envs/ar_env/lib/python3.12/site-packages/diffusers/utils/import_utils.py:1018: in _get_module
    raise RuntimeError(
E   RuntimeError: Failed to import diffusers.pipelines.hunyuandit.pipeline_hunyuandit because of the following error (look up to see its traceback):
E   cannot import name 'MT5Tokenizer' from 'transformers' (/home/hengguo/miniforge3/envs/ar_env/lib/python3.12/site-packages/transformers/__init__.py)

The above exception was the direct cause of the following exception:
test_cpu/models/test_diffusion.py:4: in <module>
    from diffusers import AutoPipelineForText2Image
<frozen importlib._bootstrap>:1406: in _handle_fromlist
    ???
../../../../miniforge3/envs/ar_env/lib/python3.12/site-packages/diffusers/utils/import_utils.py:1007: in __getattr__
    value = getattr(module, name)
            ^^^^^^^^^^^^^^^^^^^^^
../../../../miniforge3/envs/ar_env/lib/python3.12/site-packages/diffusers/utils/import_utils.py:1006: in __getattr__
    module = self._get_module(self._class_to_module[name])
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
../../../../miniforge3/envs/ar_env/lib/python3.12/site-packages/diffusers/utils/import_utils.py:1018: in _get_module
    raise RuntimeError(
E   RuntimeError: Failed to import diffusers.pipelines.auto_pipeline because of the following error (look up to see its traceback):
E   Failed to import diffusers.pipelines.hunyuandit.pipeline_hunyuandit because of the following error (look up to see its traceback):
E   cannot import name 'MT5Tokenizer' from 'transformers' (/home/hengguo/miniforge3/envs/ar_env/lib/python3.12/site-packages/transformers/__init__.py)

System Info

Who can help?

No response

[yiyixuxu]

hey @n1ck-guo
I think it's already fixed in #12877
can you update diffusers to latest?

[janepie]

I have the same issue, looks to me like it's merged but not released?

[BitCalSaul]

is this one fixed? same issue
Traceback (most recent call last): File "/data/jwq/miniconda3/envs/xdit/bin/xdit", line 3, in <module> from xfuser.cli import main File "/home/jwq/xDiT/xfuser/__init__.py", line 1, in <module> from xfuser.model_executor.pipelines import ( File "/home/jwq/xDiT/xfuser/model_executor/pipelines/__init__.py", line 9, in <module> from .pipeline_hunyuandit import xFuserHunyuanDiTPipeline File "/home/jwq/xDiT/xfuser/model_executor/pipelines/pipeline_hunyuandit.py", line 6, in <module> from diffusers import HunyuanDiTPipeline File "<frozen importlib._bootstrap>", line 1229, in _handle_fromlist File "/data/jwq/miniconda3/envs/xdit/lib/python3.11/site-packages/diffusers/utils/import_utils.py", line 1007, in __getattr__ value = getattr(module, name) ^^^^^^^^^^^^^^^^^^^^^ File "/data/jwq/miniconda3/envs/xdit/lib/python3.11/site-packages/diffusers/utils/import_utils.py", line 1007, in __getattr__ value = getattr(module, name) ^^^^^^^^^^^^^^^^^^^^^ File "/data/jwq/miniconda3/envs/xdit/lib/python3.11/site-packages/diffusers/utils/import_utils.py", line 1006, in __getattr__ module = self._get_module(self._class_to_module[name]) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/data/jwq/miniconda3/envs/xdit/lib/python3.11/site-packages/diffusers/utils/import_utils.py", line 1018, in _get_module raise RuntimeError( RuntimeError: Failed to import diffusers.pipelines.hunyuandit.pipeline_hunyuandit because of the following error (look up to see its traceback): cannot import name 'MT5Tokenizer' from 'transformers' (/data/jwq/miniconda3/envs/xdit/lib/python3.11/site-packages/transformers/__init__.py)

[yiyixuxu]

hey @BitCalSaul should be fixed now #13146 (comment)

[BitCalSaul]

tks i will check it out @yiyixuxu

[xin3he]

Yes, it's resolved.

[asomoza]

thanks @xin3he, since we got a confirmation, I'll close this issue.