Add add_bos=False, add_eos=False to SentencePieceTokenizer.__init__()#1811
Merged
mattdangerw merged 4 commits intokeras-team:masterfrom briango28:masterSep 9, 2024
+34
add_bos=False, add_eos=False to SentencePieceTokenizer.__init__()#1811