Merge Data with Avro Data
Merge data with your Apache Avro data quickly
Merge Data
Merging stacks your Apache Avro file together with one or more datasets, appending their records underneath so everything lands in one table. The result includes every column found across all datasets, and you choose which column from each dataset fills each one. Perfect for combining exports from different periods, regions, or systems into a single dataset.
Apache Avro
Apache Avro is a row-based data serialization format designed to support efficient data encoding and compression. Avro stores data in a compact binary format, which makes it efficient for both storage and transmission. Every Avro file includes a schema that describes the structure of the data stored within it. Avro supports a range of complex data types, including nested records, arrays, and maps. Avro also supports schema evolution, allowing the schema of a dataset to change over time (adding new fields, for example) while maintaining backward compatibility with the older version of the schema.