AWS Snowball - Page 62

To Next Page

To Previous Page

AWS Snowball User Guide

Using the Snowball Client

Before Transferring Data from HDFS

Before using the Snowball client to copy HDFS (version 2.x) data, take the following steps:

1. To transfer data from an HDFS cluster, get the latest version of the Snowball client. You can download

and install the Snowball client from the AWS Snowball Tools Download page. There you can ﬁnd the

installation package for your operating system. Follow the instructions to install the Snowball client.

2. Ensure that your HDFS cluster is running, and accessible from the workstation that you've installed the

Snowball client on.

Transferring Data from HDFS

Now you're ready to transfer data from your HDFS (version 2.x) cluster. For more information on all the

Snowball client copy command options, including those speciﬁc to HDFS, see Options for the snowball

cp Command (p. 60).

If you encounter performance issues while transferring data from your HDFS 2.x cluster to a Snowball,

see Performance Considerations for HDFS Data Transfers (p. 36).

After Transferring Data from HDFS

Once you've ﬁnished transferring data from your HDFS (version 2.x) cluster, you can validate the data on

the Snowball with the following steps:

1. Use the snowball validate command to verify the number of uploaded ﬁles and conﬁrm that they

were uploaded correctly.

2. List all the ﬁles at the destination path or paths to conﬁrm that the HDFS ﬁle or ﬁles were copied. For

example, you can use the following command:

snowball ls s3://bucket-name/destination-path

Commands for the Snowball Client

Following, you can ﬁnd information on Snowball client commands that help you manage your data

transfer into Amazon Simple Storage Service (Amazon S3). You can have multiple instances of the

Snowball client in diﬀerent terminal windows connected to a single Snowball.

Topics

• Copy Command for the Snowball Client (p. 57)

• List Command for the Snowball Client (p. 57)

• Make Directory Command for the Snowball Client (p. 58)

• Retry Command for the Snowball Client (p. 58)

• Remove Command for the Snowball Client (p. 58)

• Start Command for the Snowball Client (p. 59)

• Status Command for the Snowball Client (p. 59)

• Stop Command for the Snowball Client (p. 59)

• Test Command for the Snowball Client (p. 59)

• Validate Command for the Snowball Client (p. 59)

• Version Command for the Snowball Client (p. 60)

• Using the Verbose Option (p. 60)