Credentials
Stored encrypted and decrypted only while a job is running. Use an IAM user scoped to the bucket below.
Temporary credentials
Leave empty for a long-lived IAM user key.
Location
Where browsing starts. Leave it empty to start at the top of the bucket. Saved work addresses objects by their full path, so this is a starting point rather than a restriction.
Remove Duplicate Records from JSON Data
Remove duplicate records from your JSON data quickly
Connectors
Read straight from the systems your data already lives in, instead of uploading a file.
Remove Duplicates
Duplicate rows can cause confusion, errors, and even system failures. This tool scans your JSON file for duplicate entries based on the fields you choose and removes the rows automatically. Whether you're cleaning up customer data, survey responses, or any other dataset, it helps ensure your file is accurate and reliable. You can choose to check for exact duplicates or compare specific columns, giving you full flexibility in how duplicates are identified.
JSON
JSON (JavaScript Object Notation) is a lightweight, text-based format used for data interchange. JSON is easy to read and write for humans and simple to parse and generate for machines. Its structure is composed of two elements: objects, containing key-value pairs, and arrays, holding lists of values. Keys in JSON objects are strings, and values can be strings, numbers, arrays, true or false, null, and other objects. This format is widely used in web applications for sending data between clients and servers, as well as in configuration files and data feeds.