Questions tagged [s3cmd]

The tag has no usage guidance.

0
votes
0answers
8 views

`s3cmd get` transfers from AWS are slower than the AWS cli tools

I'm using s3cmd get to transfer a large file from AWS. It transfers at almost exactly 30Mbit consistently. However with the AWS command line tools I can get higher transfer rates, upward of 60Mbit on ...
0
votes
0answers
61 views

S3cmd connection refused error

How can I solve this s3cmd error: "Invoked as: /usr/bin/s3cmd ls S3://bucket-name/ Problem: error: [Errno 111] Connection refused S3cmd: 2.0.1 python: 2.6.6"?
1
vote
1answer
275 views

Installing s3cmd on MacOS High Sierra with pip

I have installed s3cmd with pip on MacOS High Sierra, which has successfully installed. sudo pip install --user s3cmd The directory '/Users/crmpicco/Library/Caches/pip/http' or its parent directory ...
1
vote
2answers
1k views

copy specific files from s3 bucket

I have some files in s3 bucket. aws s3 ls s3://bucketname/ file-111-100x100.jpg file-112-1400x1400.jpg file-123-250x250.jpg file-231-1400x1400.jpg file-222-700x700.jpg file-333-100x100.jpg file-131-...
1
vote
2answers
651 views

S4cmd working only for Amazon S3. Is it possible to configure it for DreamObjects cloud storage the way S3cmd worked?

I just switched from S3cmd to S4cmd. It's working great for EC2 to Amazon S3 data transfer. But when I'm trying DreamObjects or CenturyLink Object storage in it's place, it shows the below error: ...
0
votes
1answer
140 views

unable to install s3cmd on centos

I tried the following commands to install s3cmd on centos on centos-release-6-8 cd etc/yum.repos.d wget http://s3tools.org/repo/RHEL_6/s3tools.repo yum install s3cmd last command output "Illegal ...
1
vote
1answer
432 views

does s3cmd put command overwrite files?

I am trying to write a script that will automatically backup a drive I have to amazon s3. I have downloaded s3cmd and I am wondering what the put command does... It seems to me like it uploads the ...
0
votes
0answers
174 views

How to pass the command to the other server using ssh

#!/bin/bash ENV=stg NODE=node4 KEYFILE=************ USERNAME=ubuntu PORT=22 HOST=********** CASSANDRA_HOME=/ebs/var/lib/cassandra KEYSPACE=*** TABLE1=RegisterUser TABLE2=EmailSyncMetadata TABLE3=...
10
votes
2answers
17k views

How can I install s3cmd on Mac OS X Yosemite?

I am using Mac OS X Yosemite and want to install s3cmd from S3Tools. Here is a summary of what I have done so far: Downloaded and extracted the .tar.gz. Moved the resulting directory to /usr/local/...
1
vote
1answer
2k views

How to download a large S3 object from the command line much faster than s3cmd

With the s3cmd command you can download files from S3 like this: s3cmd get s3://my.private.bucket/some/location/hugefile.dat But that can take quite a while if the stored files are really big. Are ...
1
vote
2answers
638 views

s3cmd sync hangs at “Retrieving list of remote files for …”

As part of a backup solution, I am using s3cmd to transfer a load of files. I have four different jobs with directories of different sizes and files of different sizes. Three of the jobs runs just ...
0
votes
1answer
163 views

s3cmd: KeyError: 'dest_name' when attempting to copy several files

I need to process some files in an S3 bucket using hive. Problem is, hive doesn't apparently like using the buckets as folders, so I decided to create a folder in another bucket, and copy the files ...
4
votes
1answer
10k views

GPG program not found on OS X

Trying to run s3cmd on my mac book air, receiving the following message. Success. Your access key and secret key worked fine :-) Now verifying that encryption works... ERROR: Test failed: GPG ...
2
votes
1answer
222 views

s3cmd fails to run from an init-script

I created an init-script that should push some log files using s3cmd to an Amazon S3 bucket when the system is going down. s3cmd is installed and s3cmd --configure was run as user root and the ...
1
vote
2answers
1k views

How to save echo result into a variable?

I have this output from a s3cmd ls --list-md5 command. 2013-05-22 12:20 1965154 41eae9b40d23de2f02bf07635870f6d0 s3://company-backup/company/amazon/ip-11-11-111-11/backup_server245/app....