You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When i run the code xLSTM_test_notebook.ipynb , in the forth block the define of block, the attribute _num_blocks can not passed into the class properly but be considered as None which is the default setting of _num_blocks.
When i run the code xLSTM_test_notebook.ipynb , in the forth block the define of block, the attribute _num_blocks can not passed into the class properly but be considered as None which is the default setting of _num_blocks.
warning below:
File :\xlstm-main\test..\xlstm\components\init.py:30, in wang_init_(param, dim, num_blocks)
28 def wang_init_(param: torch.Tensor, dim: int, num_blocks: int):
29 """Adopted from https://github.com/EleutherAI/gpt-neox/blob/main/megatron/model/init_functions.py."""
---> 30 std = 2 / num_blocks / math.sqrt(dim)
31 torch.nn.init.normal_(param, mean=0.0, std=std)
32 return param
TypeError: unsupported operand type(s) for /: 'int' and 'NoneType'
The text was updated successfully, but these errors were encountered: