Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

执行webui的训练报IndexError: list index out of range #3728

Closed
1 task done
lixiaopenglidapeng opened this issue May 13, 2024 · 4 comments
Closed
1 task done

执行webui的训练报IndexError: list index out of range #3728

lixiaopenglidapeng opened this issue May 13, 2024 · 4 comments
Labels
solved This problem has been already solved

Comments

@lixiaopenglidapeng
Copy link

Reminder

  • I have read the README and searched the existing issues.

Reproduction

报错信息如下
Traceback (most recent call last):
File "/root/miniconda3/envs/train/lib/python3.10/site-packages/gradio/queueing.py", line 566, in process_events
response = await route_utils.call_process_api(
File "/root/miniconda3/envs/train/lib/python3.10/site-packages/gradio/route_utils.py", line 270, in call_process_api
output = await app.get_blocks().process_api(
File "/root/miniconda3/envs/train/lib/python3.10/site-packages/gradio/blocks.py", line 1887, in process_api
result = await self.call_function(
File "/root/miniconda3/envs/train/lib/python3.10/site-packages/gradio/blocks.py", line 1484, in call_function
prediction = await utils.async_iteration(iterator)
File "/root/miniconda3/envs/train/lib/python3.10/site-packages/gradio/utils.py", line 632, in async_iteration
return await iterator.anext()
File "/root/miniconda3/envs/train/lib/python3.10/site-packages/gradio/utils.py", line 625, in anext
return await anyio.to_thread.run_sync(
File "/root/miniconda3/envs/train/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
return await get_async_backend().run_sync_in_worker_thread(
File "/root/miniconda3/envs/train/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2144, in run_sync_in_worker_thread
return await future
File "/root/miniconda3/envs/train/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 851, in run
result = context.run(func, *args)
File "/root/miniconda3/envs/train/lib/python3.10/site-packages/gradio/utils.py", line 608, in run_sync_iterator_async
return next(iterator)
File "/root/miniconda3/envs/train/lib/python3.10/site-packages/gradio/utils.py", line 791, in gen_wrapper
response = next(iterator)
File "/opt/LLaMA-Factory/src/llmtuner/webui/runner.py", line 275, in run_train
yield from self._launch(data, do_train=True)
File "/opt/LLaMA-Factory/src/llmtuner/webui/runner.py", line 266, in _launch
yield from self.monitor()
File "/opt/LLaMA-Factory/src/llmtuner/webui/runner.py", line 302, in monitor
running_log, running_progress, running_loss = get_trainer_info(output_path, self.do_train)
File "/opt/LLaMA-Factory/src/llmtuner/webui/utils.py", line 95, in get_trainer_info
running_loss = gr.Plot(gen_loss_plot(trainer_log))
File "/opt/LLaMA-Factory/src/llmtuner/extras/ploting.py", line 46, in gen_loss_plot
ax.plot(steps, smooth(losses), color="#1f77b4", label="smoothed")
File "/opt/LLaMA-Factory/src/llmtuner/extras/ploting.py", line 24, in smooth
last = scalars[0]
IndexError: list index out of range

Expected behavior

No response

System Info

No response

Others

No response

@hiyouga hiyouga added the pending This problem is yet to be addressed label May 13, 2024
@liuhao16
Copy link

我也遇到了。01-ai/Yi-1.5-6B-Chat 模型

@sweetning0809
Copy link

请问有解决方法吗

@sevendark
Copy link

同样的问题

@hiyouga
Copy link
Owner

hiyouga commented May 14, 2024

已修复,重新训练时需要指定新的输出目录

@hiyouga hiyouga added solved This problem has been already solved and removed pending This problem is yet to be addressed labels May 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
solved This problem has been already solved
Projects
None yet
Development

No branches or pull requests

5 participants