Code

add split argument to Generator#7015

Code

Merged

albertvillanova merged 11 commits intohuggingface:mainhuggingface/datasets:mainfrom piercus:generator-splitpiercus/datasets:generator-splitCopy head branch name to clipboardJul 26, 2024

+39-12

Commits

Commits on Jul 1, 2024

• add split argument to Generator, from_generator, AbstractDatasetInputStream, GeneratorDatasetInputStream

  piercus

  committed
  3524459

  Copy full SHA for 3524459

Commits on Jul 10, 2024

• split generator review feedbacks

  piercus

  committed
  eef7c96

  Copy full SHA for eef7c96

• import Split

  piercus

  committed
  bdd9662

  Copy full SHA for bdd9662

• tag added version in iterable_dataset, rollback change in _concatenate_iterable_datasets

  piercus

  committed
  5512e3f

  Copy full SHA for 5512e3f

• rm useless Generator __init__

  piercus

  committed
  6f1c18b

  Copy full SHA for 6f1c18b

• docstring formatting

  Show description for d74a862
  

  piercus

  and

  albertvillanova

  authored
  d74a862

  Copy full SHA for d74a862

• format docstring

  Show description for 7e50f23
  

  piercus

  and

  albertvillanova

  authored
  7e50f23

  Copy full SHA for 7e50f23

Commits on Jul 11, 2024

• fix test_dataset_from_generator_split[None]

  piercus

  committed
  96b9e37

  Copy full SHA for 96b9e37

• Merge branch 'main' into generator-split

  piercus

  authored
  b912261

  Copy full SHA for b912261

Commits on Jul 26, 2024

• Merge remote-tracking branch 'upstream/main' into generator-split

  albertvillanova

  committed
  9480dae

  Copy full SHA for 9480dae

• Merge branch 'main' into generator-split

  albertvillanova

  committed
  5962e2d

  Copy full SHA for 5962e2d