Build docker images for tokenizers main branch #16708
Closed
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
PR 1/2: in order to run the full test suite (slow tests included), with the
main
branch of thetokenizers
library, rebase this PR onmain
. Once the workflows have finished, head to PR 2/2 here: #16712This PR is one of two items to run the full test suite for the tokenizers current
main
branch.In order to re-run, rebuild the docker images, publish them to the docker hub, and rebase this PR on the
main
branch of this repository.Steps done in order to create this PR:
tokenizers
from source in the containerbuild-docker-images.yml
action to:internal
as a prefix, andtokenizers-main
as a suffix.These images will be built on each commit, so rebasing this branch on
main
will retrigger the workflow