Questions tagged [s3cmd]
13 questions
13
votes
3 answers
How can I install s3cmd on Mac OS X Yosemite?
I am using Mac OS X Yosemite and want to install s3cmd from S3Tools. Here is a summary of what I have done so far:
Downloaded and extracted the .tar.gz.
Moved the resulting directory to /usr/local/src
cd /usr/local/src/s3cmd-1.5.0
sudo python…
mpavey
- 263
6
votes
1 answer
GPG program not found on OS X
Trying to run s3cmd on my mac book air, receiving the following message.
Success. Your access key and secret key worked fine :-)
Now verifying that encryption works... ERROR: Test failed: GPG program
not found
Sorter
- 431
3
votes
2 answers
S4cmd working only for Amazon S3. Is it possible to configure it for DreamObjects cloud storage the way S3cmd worked?
I just switched from S3cmd to S4cmd. It's working great for EC2 to Amazon S3 data transfer. But when I'm trying DreamObjects or CenturyLink Object storage in it's place, it shows the below error:
ClientError: An error occurred (InvalidAccessKeyId)…
Avinash
- 61
2
votes
1 answer
s3cmd fails to run from an init-script
I created an init-script that should push some log files using s3cmd to an Amazon S3 bucket when the system is going down. s3cmd is installed and s3cmd --configure was run as user root and the configuration is OK
When manually executing the init…
marekful
- 173
2
votes
2 answers
1
vote
1 answer
How to download a large S3 object from the command line much faster than s3cmd
With the s3cmd command you can download files from S3 like this:
s3cmd get s3://my.private.bucket/some/location/hugefile.dat
But that can take quite a while if the stored files are really big.
Are there alternative command line solutions to the…
Erik
- 445
1
vote
2 answers
s3cmd sync hangs at "Retrieving list of remote files for ..."
As part of a backup solution, I am using s3cmd to transfer a load of files.
I have four different jobs with directories of different sizes and files of different sizes.
Three of the jobs runs just fine. The last job, though, hangs at the…
Eldamir
- 315
1
vote
2 answers
How to save echo result into a variable?
I have this output from a s3cmd ls --list-md5 command.
2013-05-22 12:20 1965154 41eae9b40d23de2f02bf07635870f6d0 s3://company-backup/company/amazon/ip-11-11-111-11/backup_server245/app.20121117040001.gz
2013-05-22 12:20 11456836 …
Valter Silva
- 1,381
1
vote
1 answer
Installing s3cmd on MacOS High Sierra with pip
I have installed s3cmd with pip on MacOS High Sierra, which has successfully installed.
sudo pip install --user s3cmd
The directory '/Users/crmpicco/Library/Caches/pip/http' or its parent directory is not owned by the current user and the cache has…
crmpicco
- 315
1
vote
0 answers
does s3cmd put command overwrite files?
I am trying to write a script that will automatically backup a drive I have to amazon s3. I have downloaded s3cmd and I am wondering what the put command does...
It seems to me like it uploads the files every time, overwriting them. Is that what it…
Joff
- 227
0
votes
1 answer
s3cmd: KeyError: 'dest_name' when attempting to copy several files
I need to process some files in an S3 bucket using hive. Problem is, hive doesn't apparently like using the buckets as folders, so I decided to create a folder in another bucket, and copy the files there via s3cmd.
This is my command:
s3cmd -v cp…
zack_falcon
- 1,033
0
votes
0 answers
How to sync digital ocean spaces from one account to another
I have two digital ocean accounts.
Account A
space A
Account B
space B
I am using version s3cmd 2.02.
I have to transfer all the files from space A to space B. I have read the documentation on its usage but this documentaion doesn't cover my…
bhanu
- 101
0
votes
1 answer
unable to install s3cmd on centos
I tried the following commands to install s3cmd on centos on centos-release-6-8
cd etc/yum.repos.d
wget http://s3tools.org/repo/RHEL_6/s3tools.repo
yum install s3cmd
last command output "Illegal instruction (core dumped)"
i tried sudo yum install…
