Skip to content

Commit

Permalink
in_http: add descriptions about Content-Type
Browse files Browse the repository at this point in the history
Need to add `application/x-ndjson` and `application/csp-report`.

Related:

* fluent/fluentd#3616
* fluent/fluentd#4282

Signed-off-by: Daijiro Fukuda <[email protected]>
  • Loading branch information
daipom committed May 15, 2024
1 parent e8cda55 commit 72f96a2
Showing 1 changed file with 61 additions and 14 deletions.
75 changes: 61 additions & 14 deletions input/http.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,11 +22,43 @@ For the full list of the configurable options, see the [Parameters](http.md#para

## Basic Usage

Here is a simple example to post a record using `curl`, which uses the default Content-Type `application/x-www-form-urlencoded`
By default, the data format depends on the `Content-Type`.
In summary, you can send the follwoing format.

```text
# Post a record with the tag "app.log"
$ curl -X POST -d 'json={"foo":"bar"}' http://localhost:9880/app.log
* `json`
* `ndjson`
* `msgpack`

Here is a simple example to post a record using `curl`, which uses the default Content-Type `application/x-www-form-urlencoded`.

Example: post JSON data with the tag "app.log":

```bash
curl -X POST -d 'json={"foo":"bar"}' http://localhost:9880/app.log
```

Example: post NDJSON data with the tag "app.log":

```bash
ndjson=`echo -e 'ndjson={"k1":"v1"}\n{"k2":"v2"}\n'`
curl -X POST -d "$ndjson" http://localhost:9880/app.log
```

Example: post MessagePack data with the tag "app.log":

```bash
msgpack=`echo -e "msgpack=\x81\xa3foo\xa3bar"`
curl -X POST -d "$msgpack" http://localhost:9880/app.log
```

Some `Content-Type` other than `application/x-www-form-urlencoded` support specific formats.
In that case, the format type specification as `json=` in the data is not necessary.

Example: Post JSON data with `Content-Type: application/json`:

```bash
curl -X POST -d '{"foo":"bar"}' -H 'Content-Type: application/json' \
http://localhost:9880/app.log
```

**For more details regarding the message body syntax and `Content-Type` see [How to use HTTP Content-Type Header](http.md#how-to-use-http-content-type-header)**
Expand Down Expand Up @@ -230,24 +262,39 @@ $ curl -X POST -d "msgpack=$msgpack" http://localhost:9880/app.log

`in_http` plugin recognizes HTTP `Content-Type` header in the incoming requests.

By default `curl` uses `-H "Content-Type: application/x-www-form-urlencoded"`, which allows the use of the syntax `json=` and `msgpack=` as seen on the previous examples.
If you use the default `<parse>` setting, the data format depends on the `Content-Type`.
(If you set the `<parse>` directive to use a specific Parser, the `Content-Type` is not used).

However, you can send a JSON payload without the `json=` prefix by setting the content type `application/json`:
By default `curl` uses `-H "Content-Type: application/x-www-form-urlencoded"`, which allows the use of the prefix `json=`, `ndjson=`, and `msgpack=` as seen on the previous examples.

```text
$ curl -X POST -d '{"foo":"bar"}' -H 'Content-Type: application/json' \
On the other hand, some `Content-Type` other than `application/x-www-form-urlencoded` support specific formats.
In that case, the prefix such as `json=` in the data is not necessary.

Here is the list of supported `Content-Type`:

| `Content-Type` | data format | version |
| :--- | :--- | :--- |
| `application/json` | JSON | - |
| `application/csp-report` | JSON | 1.17.0 |
| `application/msgpack` | MessagePack | - |
| `application/x-ndjson` | NDJSON | 1.14.5 |

Examples:

```bash
curl -X POST -d '{"foo":"bar"}' -H 'Content-Type: application/json' \
http://localhost:9880/app.log
```

To use MessagePack, set the content type to `application/msgpack`:

```text
$ msgpack=`echo -e "\x81\xa3foo\xa3bar"`
$ curl -X POST -d "$msgpack" -H 'Content-Type: application/msgpack' \
```bash
msgpack=`echo -e "\x81\xa3foo\xa3bar"`
curl -X POST -d "$msgpack" -H 'Content-Type: application/msgpack' \
http://localhost:9880/app.log
```

Also, you can use `multipart/form-data`.
For more details about `multipart/form-data`, please see [Why `in_http` removes '+' from my log](http.md#why-in_http-removes--from-my-log).

### Handle Other Formats using Parser Plugins

You can handle various input formats by using the `<parse>` directive. For example, add the following settings to the configuration file:
Expand Down

0 comments on commit 72f96a2

Please sign in to comment.