Credentials
Stored encrypted and decrypted only while a job is running. Use an IAM user scoped to the bucket below.
Temporary credentials
Leave empty for a long-lived IAM user key.
Location
Where browsing starts. Leave it empty to start at the top of the bucket. Saved work addresses objects by their full path, so this is a starting point rather than a restriction.
Convert Avro to Parquet
Convert your Apache Avro data to Apache Parquet quickly
Connectors
Read straight from the systems your data already lives in, instead of uploading a file.
Apache Avro
Apache Avro is a row-based data serialization format designed to support efficient data encoding and compression. Avro stores data in a compact binary format, which makes it efficient for both storage and transmission. Every Avro file includes a schema that describes the structure of the data stored within it. Avro supports a range of complex data types, including nested records, arrays, and maps. Avro also supports schema evolution, allowing the schema of a dataset to change over time (adding new fields, for example) while maintaining backward compatibility with the older version of the schema.
Apache Parquet
Apache Parquet is a columnar storage file format that provides efficient data compression and encoding schemes. It is optimized for use with complex nested data structures and is effective for queries that process large volumes of data and for table-like datasets.