Code

WIP: refactor for Java bindings#40

Code

Open

eisber wants to merge 27 commits intoopenai:mainopenai/tiktoken:mainfrom eisber:maineisber/tiktoken:mainCopy head branch name to clipboard

+1,181-451

Commits

Commits on Feb 8, 2023

• refactor

  eisber

  committed
  6c49a41

  Copy full SHA for 6c49a41

Commits on Feb 9, 2023

• ported loading to Rust

  eisber

  committed
  09dada4

  Copy full SHA for 09dada4

• fixed?

  eisber

  committed
  4c6afcb

  Copy full SHA for 4c6afcb

• Propagate errors from split whitespace in bpe_merges

  jackgerrits

  committed
  502a6ec

  Copy full SHA for 502a6ec

• moving registry into rust

  eisber

  committed
  c685d99

  Copy full SHA for c685d99

• return ref

  jackgerrits

  committed
  6dcfa91

  Copy full SHA for 6dcfa91

Commits on Feb 10, 2023

• split into multiple libs

  eisber

  committed
  25306a5

  Copy full SHA for 25306a5

• fixed core

  eisber

  committed
  ba69bd9

  Copy full SHA for ba69bd9

• Fix python setup.py for package in workspace

  jackgerrits

  committed
  c98f824

  Copy full SHA for c98f824

• java bindings...

  eisber

  committed
  f248694

  Copy full SHA for f248694

• more TODO

  eisber

  committed
  2f371f6

  Copy full SHA for 2f371f6

Commits on Feb 11, 2023

• Initial VERY rough impl of JNI layer

  jackgerrits

  committed
  1d3f707

  Copy full SHA for 1d3f707

Commits on Feb 22, 2023

• improve error handling

  eisber

  committed
  97d8dea

  Copy full SHA for 97d8dea

Commits on Feb 24, 2023

• Improve error handling in JNI functions

  jackgerrits

  committed
  53628a4

  Copy full SHA for 53628a4

Commits on Feb 27, 2023

• Merge pull request #1 from eisber/error_handling

  Show description for 42548d8
  eisber

  authored
  42548d8

  Copy full SHA for 42548d8

• moved config into json

  eisber

  committed
  e3ab3f6

  Copy full SHA for e3ab3f6

• add github action

  eisber

  committed
  22584d4

  Copy full SHA for 22584d4

• add jar build

  eisber

  committed
  42efde4

  Copy full SHA for 42efde4

• fix rust build

  eisber

  committed
  484f15a

  Copy full SHA for 484f15a

• build jar

  eisber

  committed
  6c45bf6

  Copy full SHA for 6c45bf6

• fix path

  Show description for b883d0c
  eisber

  committed
  b883d0c

  Copy full SHA for b883d0c

• fix java

  eisber

  committed
  98070f1

  Copy full SHA for 98070f1

• Merge remote-tracking branch 'upstream/main' into main

  eisber

  committed
  3b39f6b

  Copy full SHA for 3b39f6b

Commits on Feb 28, 2023

• cleanup

  eisber

  committed
  4e70da0

  Copy full SHA for 4e70da0

• update groupid

  eisber

  committed
  381d32b

  Copy full SHA for 381d32b

• remove comments

  eisber

  committed
  f1560bd

  Copy full SHA for f1560bd

Commits on Mar 3, 2023

• added gpt-3.5-turbo.

  eisber

  committed
  135e86c

  Copy full SHA for 135e86c