Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

qwen2-vl微调,freeze_vision_tower设为false时报错 #5324

Closed
dlnlpchenliyu opened this issue Sep 2, 2024 · 5 comments
Closed

qwen2-vl微调,freeze_vision_tower设为false时报错 #5324

dlnlpchenliyu opened this issue Sep 2, 2024 · 5 comments
Labels
solved This problem has been already solved

Comments

@dlnlpchenliyu
Copy link

dlnlpchenliyu commented Sep 2, 2024

使用examples/train_lora/qwen2vl_lora_sft.yaml脚本微调,一切正常。
将freeze_vision_tower设置为false后,运行脚本报错:ValueError: Target module Conv3d(3, 1280, kernel_size=(2, 14, 14), stride=(2, 14, 14), bias=False) is not supported. Currently, only the following modules are supported: torch.nn.Linear, torch.nn.Embedding, torch.nn.Conv2d, transformers.pytorch_utils.Conv1D.
更多信息:
torch 2.4.0+cu118
cuda 11.8
transformers 4.45.0.dev0(按照qwen2-vl的readme, pip install git+https://github.com/huggingface/transformers)

@github-actions github-actions bot added the pending This problem is yet to be addressed label Sep 2, 2024
@dlnlpchenliyu dlnlpchenliyu changed the title qwen2-vl微调开启freeze_vision_tower报错 qwen2-vl微调,freeze_vision_tower设为false时报错 Sep 2, 2024
@zxc351200
Copy link

请问一下为什么我使用了4.45.0.dev0,还是会出现AttributeError: 'NoneType' object has no attribute 'image_processor'这个错误

@dlnlpchenliyu
Copy link
Author

请问一下为什么我使用了4.45.0.dev0,还是会出现AttributeError: 'NoneType' object has no attribute 'image_processor'这个错误

你的torch版本是多少?我之前也遇到了这个问题,torch升级到2.4.0就没这个问题了

@zxc351200
Copy link

torch已经升级到2.4.0了,cuda是12.2,python版本试了好几个了都会报错。

@dlnlpchenliyu
Copy link
Author

torch已经升级到2.4.0了,cuda是12.2,python版本试了好几个了都会报错。

我这边的配置:
torch 2.4.0+cu118
cuda 11.8
transformers 4.45.0.dev0
python 3.10
此外,根据qwen2-vl的readme,还需要安装qwen-vl-utils。
此外,还可以看看datasets的版本是不是和推荐的版本一致。
如果这些都没问题,依然出现这个错误,就需要另请高明了~~

@hiyouga
Copy link
Owner

hiyouga commented Sep 2, 2024

fixed

@hiyouga hiyouga closed this as completed in a61c8c4 Sep 2, 2024
@hiyouga hiyouga added solved This problem has been already solved and removed pending This problem is yet to be addressed labels Sep 2, 2024
yuwangnexusera pushed a commit to yuwangnexusera/LLaMA-Factory that referenced this issue Sep 5, 2024
yuwangnexusera pushed a commit to yuwangnexusera/LLaMA-Factory that referenced this issue Sep 5, 2024
yuwangnexusera pushed a commit to yuwangnexusera/LLaMA-Factory that referenced this issue Sep 5, 2024
yuwangnexusera pushed a commit to yuwangnexusera/LLaMA-Factory that referenced this issue Sep 5, 2024
yuwangnexusera pushed a commit to yuwangnexusera/LLaMA-Factory that referenced this issue Sep 5, 2024
yuwangnexusera pushed a commit to yuwangnexusera/LLaMA-Factory that referenced this issue Sep 5, 2024
yuwangnexusera pushed a commit to yuwangnexusera/LLaMA-Factory that referenced this issue Sep 5, 2024
yuwangnexusera pushed a commit to yuwangnexusera/LLaMA-Factory that referenced this issue Sep 5, 2024
yuwangnexusera pushed a commit to yuwangnexusera/LLaMA-Factory that referenced this issue Sep 5, 2024
yuwangnexusera pushed a commit to yuwangnexusera/LLaMA-Factory that referenced this issue Sep 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
solved This problem has been already solved
Projects
None yet
Development

No branches or pull requests

3 participants