train from scratch?

[fangzhangmnm]

Is there a function to pretrain a base model from scratch? With tinystories dataset it is something can be done on a potato computer in a night.

[hiyouga]

use train_from_scratch: true

[fangzhangmnm]

I'm sorry. here are two additional requirements

1. can you add to the webui the train_from_scratch commands? What I'm thinking of is to pick a model structure, specify the number of heads and layers for example, and then train a model from scratch.
2. can you add a tinystories and tinystories-chinese example into datasets?

thank you very much

[wangqh1996]

I'm sorry. here are two additional requirements

1. can you add to the webui the train_from_scratch commands? What I'm thinking of is to pick a model structure, specify the number of heads and layers for example, and then train a model from scratch.
2. can you add a tinystories and tinystories-chinese example into datasets?

thank you very much

同样需求这个功能，特别是第一个train_from_scratch，thanks。

[HuangZhen02]

can you add to the webui the train_from_scratch commands? What I'm thinking of is to pick a model structure, specify the number of heads and layers for example, and then train a model from scratch.

The same requirement.

[Mr-lonely0]

I'm sorry. here are two additional requirements

1. can you add to the webui the train_from_scratch commands? What I'm thinking of is to pick a model structure, specify the number of heads and layers for example, and then train a model from scratch.
2. can you add a tinystories and tinystories-chinese example into datasets?

thank you very much

同样需要第一个功能，可以自己定义一个全新的模型，完全的train from scratch, thanks!