Hot answers tagged

39

Amazon provides their own CLI tools now too. From http://aws.amazon.com/cli/ Using familiar syntax, you can view the contents of your S3 buckets in a directory-based listing. $ aws s3 ls s3://mybucket LastWriteTime Length Name ------------- ------ ---- PRE myfolder/ 2013-09-03 10:00:00 1234 myfile....


22

No, you cannot use rsync to transfer files to Amazon. It uses its own protocol for the service. But you can access their storage via third-party services, like www.s3rsync.com, then you'll be able to use rsync, and your data will be finally transfered to S3 storage. Or you can use special utilities designed for S3 storage. There are: s3sync, s3command, s3cp,...


20

http://s3tools.org/s3cmd does what you want to. Uploading & downloading files, syncing directories and creating buckets.


16

According to the Amazon S3 Documentation: Once deleted, there is no method to restore or undelete an object.


14


10

If you can't (perhaps you're on a shared host) or don't want to install extra tools, it is possible to just use bash, curl, and openssl. http://tmont.com/blargh/2014/1/uploading-to-s3-in-bash file=/path/to/file/to/upload.tar.gz bucket=your-bucket resource="/${bucket}/${file}" contentType="application/x-compressed-tar" dateValue=`date -R` stringToSign="PUT\...


9

I've used arq for years and love it. It is not timemachine (bummer) but does do automatic backups to either Amazon's S3 or Glacier. Update As of 5/4/2015, Arq supports incremental backups the following services: Amazon s3 and Glacier Google Drive Microsoft OneDrive DropBox Google Cloud Storage SFTP to your own server DreamObjects Other S3 compatible ...


8

Why a seperate file manager when there is s3fs, which makes it possible to mount S3 buckets via fuse? See http://code.google.com/p/s3fs/wiki/FuseOverAmazon for installation instructions. That way you won't notice any difference between local files and your S3 bucket in nautilus.


7

A POSIX-compliant shell script that requires openssl, curl and sed only; supporting AWS Signature Version 4, which is required for region eu-central-1 (Frankfurt) and recommended for the others: https://gist.github.com/vszakats/2917d28a951844ab80b1 #!/bin/sh # To the extent possible under law, Viktor Szakats (vszakats.net) # has waived all copyright ...


6

With unencrypted data you can never be 100% sure that some rogue sysadmin over at amazon does not peek at your data. And you can be sure that they will hand over your data if the authorities asks for it. If you want to be 100% secure, encrypt locally before uploading.


6

Cyberduck works with S3 among others.


5

Can you give us a rough idea of your bandwidth / storage requirements? Generally the cheapest cost is to purchase your own server and then colocate it at an inexpensive datacenter. But that is more work to manage it plus more cost up-front to buy the servers. Edit: Ok, that's about $3000-$4000/mo in Amazon S3 costs. 25TB/mo could probably be handled ...


5

If you have versioning enable, yes you can! On a versioned bucket, a delete action on a file does not really delete it but it adds a version with a "Delete Marker". You can delete the delete marker with the AWS CLI: aws s3api delete-object --bucket yourbucket-name --key "yourfile" --version-id id_of_the_delete_marker You can get all the files in the ...


5

Amazon's EC2 service is far more complex and powerful than a simple VPS. Under EC2 you can manage one or more "instances", with the ability to automate the starting/stopping/creation/destruction of instances. Each instance is a virtual machine running the operating system of your choice, like with a VPS. EC2 is not oriented towards disk space (although the ...


5

Yes, you are right, you need to install fusefs-s3fs, once you have done that, make sure you put fusefs_enable="YES" somewhere in your /etc/rc.conf (so that fuse will start after a reboot). Now create a file in /etc/ called passwd-s3fs and set its perms to 640. In that file add your S3 access-key and secret key as follows: accessKeyId:secretAccessKey on ...


5

Click the triangle next to "Other Computers". (Or if you're using Arq 3, hover your mouse over "Other Backup Sets" and click the "Show" link). There you'll find your old backup data. Select it and click the "Adopt This Backup Set". This will cause Arq to adopt the settings and backup data it was using on your old computer, so you don't have to re-upload. (I'...


5

The answer to the question comes in two parts. First, though, using "Let's Encrypt" is not actually relevant to the question: it's a Certificate Authority (CA). It issues SSL (TLS) certificates, just like all the others, except that it apparently will only issue domain validation (DV) certificates and those certs will apparently be issued without charge. ...


5

You can store files of your website on S3, but to publish it you need to use CloudFront. And there you'll be able to select custom certificate which you have to upload at AWS IAM certificate store. How to upload custom server certificate: http://docs.aws.amazon.com/IAM/latest/UserGuide/id_credentials_server-certs_manage.html


4

Yes, you may use Bucket Policies to configure bucket in a way that all existing and new files will be publicly available. Here is the bucket policy you need to apply: { "Version": "2008-10-17", "Statement": [ { "Sid": "AllowPublicRead", "Effect": "Allow", "Principal": { "AWS": "*" }, "Action": [ "s3:...


3

Just updating this question as I was looking for the answer: You can add VERSIONING to S3 buckets now. This will cause S3 to keep versions of an object even after deletion. Full documentation: http://docs.amazonwebservices.com/AmazonS3/latest/dev/Versioning.html


3

TL;DR CrossFTP is in the Ubuntu app store, you must "buy" it for the purchase price of $0.00. So an Ubuntu One account is required, to install that way. For a mountable file-system try S3QL, which is available through a PPA. Okay, it seems part of the confusion with s3fs is that there are THREE of them with mostly the same name with varying levels of ...


3

DragonDisk is a decent Amazon S3 GUI client for Ubuntu.


3

Use s3cmd which has a sync command to transfer files either direction.


3

My two cents go to Jungledisk. The interface is great, it will plug right into S3 and works great in a Windows ecosystem


3


3

Jungle Disk Workgroup Edition fits your requirements. There's even an iPhone/iPad app.


3

Your Dropbox is encrypted during transmission and while stored on their servers. Dropbox themselves do, however, have access to there files but it is against their policy to look at your files (note that it's against policy though technically possible). If you're concerned with the security of your files on any of these services, the solution is to encrypt ...


3

From Amazon aws forum: s3cmd -c .s3cfg-bespoke --rexclude "/$" sync s3://my_bucket/ ~/local_folder/


3

This is caused by backups to iCloud, Apple's cloud storage service. While I can't find any official information from Apple, some sites are reporting that Apple is using both Azure and S3 to store iCloud data. I've not found any way to limit the bandwidth through the device itself; limiting the throughput on the router seems to be the only way to throttle ...



Only top voted, non community-wiki answers of a minimum length are eligible