AWS Snowball User Guide
Manual Data Validation for Snowball During Transfer
• Manual Data Validation for Snowball After Import into Amazon S3 (p. 89) – Outlines how to check
for failed files after your import job into Amazon S3 has ended.
Manual Data Validation for Snowball During
Transfer
You can use manual validation to check that your data was successfully transferred to a Snowball Edge.
You can also use manual validation if you receive an error after attempting to transfer data. Use the
following section to find how to manually validate data on a Snowball Edge.
Check the failed-files log – Snowball client
When you run the Snowball client copy command, a log showing any files that couldn't be transferred
to the Snowball is generated. If you encounter an error during data transfer, the path for the failed-files
log will be printed to the terminal. This log is saved as a comma-separated values (.csv) file. Depending
on your operating system, you find this log in one of the following locations:
• Windows – C:/Users/<username>/AppData/Local/Temp/snowball-<random-character-
string>/failed-files
• Linux – /tmp/snowball-<random-character-string>/failed-files
• Mac – /var/folders/gf/<random-character-string>/<random-character-
string>/snowball-7464536051505188504/failed-files
Use the --verbose option for the Snowball client copy command
When you run the Snowball client copy command, you can use the --verbose option to list all the files
that are transferred to the Snowball. You can use this list to validate the content that was transferred to
the Snowball.
Check the logs – Amazon S3 Adapter for Snowball
When you run the Amazon S3 Adapter for Snowball to copy data with the AWS CLI, logs are generated.
These logs are saved in the following locations, depending on your file system:
• Windows – C:/Users/<username>/.aws/snowball/logs/
snowball_adapter_<year_month_date_hour>
• Linux – /home/.aws/snowball/logs/snowball_adapter_<year_month_date_hour>
• Mac – /Users/<username>/.aws/snowball/logs/
snowball_adapter_<year_month_date_hour>
Use the --stopOnError copy option
If you're transferring with the Snowball client, you can use this option to stop the transfer process in
the event a file fails. This option stops the copy on any failure so you can address that failure before
continuing the copy operation. For more information, see Options for the snowball cp Command (p. 60).
Run the Snowball client's validate command
The Snowball client's snowball validate command can validate that the files on the Snowball were
all completely copied over to the Snowball. If you specify a path, then this command validates the
content pointed to by that path and its subdirectories. This command lists files that are currently in the
process of being transferred as incomplete for their transfer status. For more information on the validate
command, see Validate Command for the Snowball Client (p. 59).
88
To Next Page
Loading...