Outputs

An output defines how a stream outputs its data. They are specified under the outputs property in a stream configuration, e.g.:

streams:
  authors:
    outputs:
      default:
        format: json

See stream outputs for more details.

Every output object has a format property, and may have additional properties depending on the value of format.

csv

Outputs data as CSV, e.g.:

format: csv
columns:
  - id
  - authorId
  - text
  - timestamp

If the top-level stream schema is not an object, the CSV will have a single column with a header matching the name of the stream.

All arrays and nested objects will be output as escaped JSON strings.

columns

Specifies which object properties to include in the CSV, and in which order.

By default, this is the lexical order of the properties in the streams's schema and is ignored for non-object streams.

json

Outputs data as JSON, e.g.:

format: json