最新代码评估结果generated_predictions.jsonl的顺序乱了，前天还是正常的

[johnmai-dev]

Reminder

• I have read the README and searched the existing issues.

Reproduction

generated_predictions.jsonl的顺序乱了，之前我是按找generated_predictions.jsonl顺序去eval_data数据集中找对应的数据。

Expected behavior

No response

System Info

No response

Others

No response

[johnmai-dev]

这个commit导致的：b55fb61

LLaMA-Factory/src/llamafactory/data/loader.py

Lines 122 to 124 in c4f5086

	if data_args.max_samples is not None: # truncate dataset
	indexes = np.random.permutation(len(dataset))[: data_args.max_samples]
	dataset = dataset.select(indexes)

目前我先自己改回了

    if data_args.max_samples is not None:  # truncate dataset
        num_samples = min(data_args.max_samples, len(dataset))
        dataset = dataset.select(range(num_samples))

@hiyouga