Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

mistral-of-depth微调报错:forward() takes from 7 to 8 positional arguments but 9 were given #6557

Open
1 task done
jingtian11 opened this issue Jan 7, 2025 · 0 comments
Labels
pending This problem is yet to be addressed

Comments

@jingtian11
Copy link

Reminder

  • I have read the README and searched the existing issues.

System Info

使用mod方法微调的时候报错forward() takes from 7 to 8 positional arguments but 9 were given
WechatIMG396
WechatIMG397

Reproduction

File "/data/quanchanghao/anaconda3/envs/cl/lib/python3.9/site-packages/peft/peft model.py'
return self.base modelFile "/data/guanchanghao/anaconda3/envs/cl/lib/python3.9/site-packages/torch/n/modules/module.py", line 1736, in _wrapped call implreturn self. call impl(*args,水*Kwar0SFile "/data/guanchanghao/anaconda3/envs/cl/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1747, in _call implreturn forward call(*args,**kwargs)File "/data/guanchanghao/anaconda3/envs/cl/lib/python3.9/site-packages/peft/tuners/tuners_utils.py", line 188, in forwardreturn self.model.forward(*args,水*Kwa r0SFile "'/data/guanchanghao/anaconda3/envs/cl/lib/python3.9/site-packages/transformers/models/llama/modeling llama.py", line 1198, in f
wardoutputs = self model(File "/data/guanchanghao/anaconda3/envs/cl/lib/python3.9/site-packages/torch/n/modules/module.py", line 1736, in _wrapped call implreturn self. call impl(*args,**kwargsFile "/data/guanchanghao/anaconda3/envs/cl/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1747, in _call implreturn forward call(*args,**kwargs)File "/data/guanchanghao/anaconda3/envs/cl/lib/python3.9/site-packages/transformers/models/llama/modeling_llama.py", line 933, in foard
layer outputs =self, gradient checkpointing func
File "/data/guanchanghao/A continue learning Acl2025/src/llamafactory/model/model utils/checkpointing.py", line 65, in custom gradielcheckpointing funcreturn gradient checkpointing func(func, *args,**kwaras)File "/data/guanchanghao/anaconda3/envs/cl/lib/python3.9/site-packages/torch/_compile.py", line 32,
return disable fn(*args,**kwargs)File "/data/guanchanghao/anaconda3/envs/cl/lib/python3.9/site-packages/torch/_dynamo/eval frame.py", line 632, in _fnreturn fn(*args,**kwargs)File "/data/guanchanghao/anaconda3/envs/cl/lib/python3.9/site-packages/torch/utils/checkpoint.py", line 489, in checkpointreturn CheckpointFunction.apply(function,File "/data/guanchanghao/anaconda3/envs/cl/lib/python3.9/site-packages/torch/autograd/function.py", line 575, in applyreturn super().apply(*args,**kwargs)# type:ignorelmiscFile "/data/guanchanghao/anaconda3/envs/cl/lib/python3.9/site-packages/torch/utils/checkpoint.py", line 264, in forwardoutputs = run function(*args)File "/data/guanchanghao/anaconda3/envs/cl/lib/python3.9/site packages/torch/mn/modules/module.py", line 1736, in _wrapped call implreturn self. call impl(*args,**kwargs )File "/data/quanchanghao/anaconda3/envs/cl/lib/python3.9/site packages/torch/m/modules/module.py", lir Add to composer sl Add to chat tareturn forward call(*args,**kwargs)TypeError: forward()takes from 7 to 8 positional arquments but 9 were given

Others

No response

@github-actions github-actions bot added the pending This problem is yet to be addressed label Jan 7, 2025
@jingtian11 jingtian11 changed the title mod微调报错:forward() takes from 7 to 8 positional arguments but 9 were given mistral-of-depth微调报错:forward() takes from 7 to 8 positional arguments but 9 were given Jan 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
pending This problem is yet to be addressed
Projects
None yet
Development

No branches or pull requests

1 participant