Code

fast array extraction#7227

Code

Open

alex-hh wants to merge 17 commits intohuggingface:mainhuggingface/datasets:mainfrom alex-hh:fast-array-extractionalex-hh/datasets:fast-array-extractionCopy head branch name to clipboard

+208-36

Commits

Commits on Oct 14, 2024

• fast array extraction

  alex-hh

  committed
  a181015

  Copy full SHA for a181015

Commits on Oct 15, 2024

• add array 1d feature

  alex-hh

  committed
  426178e

  Copy full SHA for 426178e

• fast struct extraction by invoking extension type to_pylist

  alex-hh

  committed
  303c4e2

  Copy full SHA for 303c4e2

• also use to_pylist for list array

  alex-hh

  committed
  0be0895

  Copy full SHA for 0be0895

• improve struct extraction

  alex-hh

  committed
  deee87e

  Copy full SHA for deee87e

• handle structs and lists of arrays

  alex-hh

  committed
  ac5a46d

  Copy full SHA for ac5a46d

• restore arrow array to numpy to numpy extractor

  alex-hh

  committed
  a89ef52

  Copy full SHA for a89ef52

• fix failing array tests

  alex-hh

  committed
  7f1e217

  Copy full SHA for 7f1e217

• test cast array xd to features fix

  alex-hh

  committed
  abbb59a

  Copy full SHA for abbb59a

• test array write

  alex-hh

  committed
  c39c4bc

  Copy full SHA for c39c4bc

• formatting

  alex-hh

  committed
  67f65b5

  Copy full SHA for 67f65b5

Commits on Oct 17, 2024

• fix a couple more test cases

  alex-hh

  committed
  97f0f19

  Copy full SHA for 97f0f19

Commits on Oct 18, 2024

• fix writing struct arrays

  alex-hh

  committed
  0f37d05

  Copy full SHA for 0f37d05

Commits on Nov 2, 2024

• handle null rows in struct array

  alex-hh

  committed
  7f8c00c

  Copy full SHA for 7f8c00c

• handle field name inference

  alex-hh

  committed
  0d80abc

  Copy full SHA for 0d80abc

• formatting

  alex-hh

  committed
  0c01621

  Copy full SHA for 0c01621

Commits on Nov 8, 2024

• revert arrow dataset change

  alex-hh

  committed
  8fc6cc6

  Copy full SHA for 8fc6cc6