Code

feat: Integrate flash attention#853

Code

Merged

numb3r3 merged 24 commits intojina-ai:mainjina-ai/clip-as-service:mainfrom OrangeSodahub:integrate-flash-attentionOrangeSodahub/clip-as-service:integrate-flash-attentionCopy head branch name to clipboardNov 15, 2022

+156-1

Commits

Commits on Nov 9, 2022

• feat: add flash attention

  OrangeSodahub

  committed
  24deab4

• fix: flash-attn dependency

  OrangeSodahub

  committed
  3cf73b1

• fix: flash_attn dependency

  OrangeSodahub

  committed
  1e688b1

• fix: use cuda in flash_attn

  OrangeSodahub

  committed
  3537eb2

• fix: import flash_attn

  OrangeSodahub

  committed
  d1fca64

• fix: errors with batch_size > 1

  OrangeSodahub

  committed
  380b93c

• fix: remove use_flash

  OrangeSodahub

  committed
  ba0c667

Commits on Nov 10, 2022

• fix: optimize shape operation

  OrangeSodahub

  committed
  cfecdeb

• fix: add causal mask

  OrangeSodahub

  committed
  234447c

• fix: flash attention import

  OrangeSodahub

  committed
  ec100c4

• fix: setup.py

  OrangeSodahub

  committed
  c9383cf

• fix: flash attention import

  OrangeSodahub

  committed
  5cedb3d

Commits on Nov 11, 2022

• fix: test ci

  OrangeSodahub

  committed
  0ed3c3a

• fix: test ci

  OrangeSodahub

  committed
  99aa3f3

• fix: test ci

  OrangeSodahub

  committed
  069d851

• fix: test ci

  OrangeSodahub

  committed
  ed7b088

• fix: test ci

  OrangeSodahub

  committed
  7f04c42

• fix: test ci

  OrangeSodahub

  committed
  7e1fb91

• fix: test ci

  OrangeSodahub

  committed
  51a4761

• fix: test ci

  OrangeSodahub

  committed
  013270a

• fix: test ci

  OrangeSodahub

  committed
  280d713

Commits on Nov 14, 2022

• fix: passby flash attention

  OrangeSodahub

  committed
  ab52be2

• fix: test ci

  OrangeSodahub

  committed
  979a42c

• Revert "fix: test ci"

  Show description for 733d572
  OrangeSodahub

  committed
  733d572