AWS Snowball User Guide
Manual Data Validation for Snowball
After Import into Amazon S3
Manual Data Validation for Snowball After Import
into Amazon S3
After an import job has completed, you have several options to manually validate the data in Amazon
S3, as described following.
Check job completion report and associated logs
Whenever data is imported into or exported out of Amazon S3, you get a downloadable PDF job report.
For import jobs, this report becomes available at the end of the import process. For more information,
see Getting Your Job Completion Report and Logs in the Console (p. 42).
S3 inventory
If you transferred a huge amount of data into Amazon S3 in multiple jobs, going through each job
completion report might not be an efficient use of time. Instead, you can get an inventory of all the
objects in one or more Amazon S3 buckets. Amazon S3 inventory provides a .csv file showing your
objects and their corresponding metadata on a daily or weekly basis. This file covers objects for an
Amazon S3 bucket or a shared prefix (that is, objects that have names that begin with a common string).
Once you have the inventory of the Amazon S3 buckets that you've imported data into, you can easily
compare it against the files that you transferred on your source data location. In this way, you can quickly
identify what files where not transferred.
Use the Amazon S3 sync command
If your workstation can connect to the internet, you can do a final validation of all your transferred files
by running the AWS CLI command aws s3 sync. This command syncs directories and S3 prefixes. This
command recursively copies new and updated files from the source directory to the destination. For
more information, see http://docs.aws.amazon.com/cli/latest/reference/s3/sync.html.
Important
If you specify your local storage as the destination for this command, make sure that you have a
backup of the files you sync against. These files are overwritten by the contents in the specified
Amazon S3 source.
89
To Next Page
Loading...