feat: add JSON format option to ollama #647
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
tmc
reviewed
Mar 6, 2024
corani
force-pushed
the
corani/ollamajson
branch
from
43b7fd9
to
973f2c6
Compare
Done. I've also added an example of how to use this to simulate functions with Ollama. |
|
@eliben this may allow for some fun projects for your blog series 😄 |
corani
force-pushed
the
corani/ollamajson
branch
from
973f2c6
to
48db2b0
Compare
A new functionality was introduced to allow the setting of a specified data format (currently Ollama only supports JSON). This is done via the `WithFormat` option. The change provides more flexibility and control over the format of data processed by the client. Moreover, the test `TestWithFormat` has been added to assert the proper functioning of this new feature. Using the JSON format allows you to simulate `Functions` using prompt injection, as it forces Ollama to respond in valid JSON.
Add an example showing how the Ollama `JSON` format in combination with prompt injection can be used to simulate Functions.
corani
force-pushed
the
corani/ollamajson
branch
from
48db2b0
to
997607a
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
feat: add JSON format option to ollama
A new functionality was introduced to allow the setting of a specified
data format (currently Ollama only supports JSON). This is done via the
WithFormatoption. The change provides more flexibility and controlover the format of data processed by the client.
Moreover, the test
TestWithFormathas been added to assert the properfunctioning of this new feature.
Using the JSON format allows you to simulate
Functionsusing promptinjection, as it forces Ollama to respond in valid JSON.
example: add new Ollama functions example
Add an example showing how the Ollama
JSONformat in combination withprompt injection can be used to simulate Functions.
Output: