Questions tagged [s3cmd]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
256 views

How to sync digital ocean spaces from one account to another

I have two digital ocean accounts. Account A space A Account B space B I am using version s3cmd 2.02. I have to transfer all the files from space A to space B. I have read the documentation on ...
bhanu's user avatar
  • 101
1 vote
1 answer
859 views

Installing s3cmd on MacOS High Sierra with pip

I have installed s3cmd with pip on MacOS High Sierra, which has successfully installed. sudo pip install --user s3cmd The directory '/Users/crmpicco/Library/Caches/pip/http' or its parent directory ...
crmpicco's user avatar
  • 315
2 votes
2 answers
6k views

copy specific files from s3 bucket

I have some files in s3 bucket. aws s3 ls s3://bucketname/ file-111-100x100.jpg file-112-1400x1400.jpg file-123-250x250.jpg file-231-1400x1400.jpg file-222-700x700.jpg file-333-100x100.jpg file-131-...
Jaimin's user avatar
  • 63
2 votes
3 answers
2k views

S4cmd working only for Amazon S3. Is it possible to configure it for DreamObjects cloud storage the way S3cmd worked?

I just switched from S3cmd to S4cmd. It's working great for EC2 to Amazon S3 data transfer. But when I'm trying DreamObjects or CenturyLink Object storage in it's place, it shows the below error: ...
Avinash's user avatar
  • 51
0 votes
1 answer
227 views

unable to install s3cmd on centos

I tried the following commands to install s3cmd on centos on centos-release-6-8 cd etc/yum.repos.d wget http://s3tools.org/repo/RHEL_6/s3tools.repo yum install s3cmd last command output "Illegal ...
bilal rabbi's user avatar
1 vote
0 answers
1k views

does s3cmd put command overwrite files?

I am trying to write a script that will automatically backup a drive I have to amazon s3. I have downloaded s3cmd and I am wondering what the put command does... It seems to me like it uploads the ...
Joff's user avatar
  • 227
13 votes
3 answers
23k views

How can I install s3cmd on Mac OS X Yosemite?

I am using Mac OS X Yosemite and want to install s3cmd from S3Tools. Here is a summary of what I have done so far: Downloaded and extracted the .tar.gz. Moved the resulting directory to /usr/local/...
mpavey's user avatar
  • 263
1 vote
1 answer
3k views

How to download a large S3 object from the command line much faster than s3cmd

With the s3cmd command you can download files from S3 like this: s3cmd get s3://my.private.bucket/some/location/hugefile.dat But that can take quite a while if the stored files are really big. Are ...
Erik's user avatar
  • 385
1 vote
2 answers
1k views

s3cmd sync hangs at "Retrieving list of remote files for ..."

As part of a backup solution, I am using s3cmd to transfer a load of files. I have four different jobs with directories of different sizes and files of different sizes. Three of the jobs runs just ...
Eldamir's user avatar
  • 315
0 votes
1 answer
185 views

s3cmd: KeyError: 'dest_name' when attempting to copy several files

I need to process some files in an S3 bucket using hive. Problem is, hive doesn't apparently like using the buckets as folders, so I decided to create a folder in another bucket, and copy the files ...
zack_falcon's user avatar
  • 1,033
6 votes
1 answer
20k views

GPG program not found on OS X

Trying to run s3cmd on my mac book air, receiving the following message. Success. Your access key and secret key worked fine :-) Now verifying that encryption works... ERROR: Test failed: GPG ...
Sorter's user avatar
  • 421
2 votes
1 answer
235 views

s3cmd fails to run from an init-script

I created an init-script that should push some log files using s3cmd to an Amazon S3 bucket when the system is going down. s3cmd is installed and s3cmd --configure was run as user root and the ...
marekful's user avatar
  • 163
1 vote
2 answers
2k views

How to save echo result into a variable?

I have this output from a s3cmd ls --list-md5 command. 2013-05-22 12:20 1965154 41eae9b40d23de2f02bf07635870f6d0 s3://company-backup/company/amazon/ip-11-11-111-11/backup_server245/app....
Valter Silva's user avatar
  • 1,371