Credentials
Stored encrypted and decrypted only while a job is running. Use an IAM user scoped to the bucket below.
Temporary credentials
Leave empty for a long-lived IAM user key.
Location
Where browsing starts. Leave it empty to start at the top of the bucket. Saved work addresses objects by their full path, so this is a starting point rather than a restriction.
Convert JSON Lines to Avro
Convert your JSON Lines / NDJSON data to Apache Avro quickly
Connectors
Read straight from the systems your data already lives in, instead of uploading a file.
JSON Lines / NDJSON
JSON Lines (also known as NDJSON — Newline Delimited JSON) is a text format where each line is a self-contained,
valid JSON value, typically a JSON object. It is widely used for streaming data, log files, and large data exports
because files can be read and written one record at a time without loading the entire document into memory.
Common file extensions are .jsonl and .ndjson.
Apache Avro
Apache Avro is a row-based data serialization format designed to support efficient data encoding and compression. Avro stores data in a compact binary format, which makes it efficient for both storage and transmission. Every Avro file includes a schema that describes the structure of the data stored within it. Avro supports a range of complex data types, including nested records, arrays, and maps. Avro also supports schema evolution, allowing the schema of a dataset to change over time (adding new fields, for example) while maintaining backward compatibility with the older version of the schema.