Tag Info

Hot answers tagged

19

No, you cannot use rsync to transfer files to Amazon. It uses its own protocol for the service. But you can access their storage via third-party services, like www.s3rsync.com, then you'll be able to use rsync, and your data will be finally transfered to S3 storage. Or you can use special utilities designed for S3 storage. There are: s3sync, s3command, ...


15

http://s3tools.org/s3cmd does what you want to. Uploading & downloading files, syncing directories and creating buckets.


14

Amazon provides their own CLI tools now too. From http://aws.amazon.com/cli/ Using familiar syntax, you can view the contents of your S3 buckets in a directory-based listing. $ aws s3 ls s3://mybucket LastWriteTime Length Name ------------- ------ ---- PRE myfolder/ 2013-09-03 10:00:00 1234 ...


14


13

According to the Amazon S3 Documentation: Once deleted, there is no method to restore or undelete an object.


7

Why a seperate file manager when there is s3fs, which makes it possible to mount S3 buckets via fuse? See http://code.google.com/p/s3fs/wiki/FuseOverAmazon for installation instructions. That way you won't notice any difference between local files and your S3 bucket in nautilus.


6

With unencrypted data you can never be 100% sure that some rogue sysadmin over at amazon does not peek at your data. And you can be sure that they will hand over your data if the authorities asks for it. If you want to be 100% secure, encrypt locally before uploading.


5

Amazon's EC2 service is far more complex and powerful than a simple VPS. Under EC2 you can manage one or more "instances", with the ability to automate the starting/stopping/creation/destruction of instances. Each instance is a virtual machine running the operating system of your choice, like with a VPS. EC2 is not oriented towards disk space (although the ...


5

Yes, you are right, you need to install fusefs-s3fs, once you have done that, make sure you put fusefs_enable="YES" somewhere in your /etc/rc.conf (so that fuse will start after a reboot). Now create a file in /etc/ called passwd-s3fs and set its perms to 640. In that file add your S3 access-key and secret key as follows: accessKeyId:secretAccessKey on ...


5

Can you give us a rough idea of your bandwidth / storage requirements? Generally the cheapest cost is to purchase your own server and then colocate it at an inexpensive datacenter. But that is more work to manage it plus more cost up-front to buy the servers. Edit: Ok, that's about $3000-$4000/mo in Amazon S3 costs. 25TB/mo could probably be handled ...


5

Cyberduck works with S3 among others.


4

I've used arq for years and love it. It is not timemachine (bummer) but does do automatic backups to either Amazon's S3 or Glacier. Update As of 5/4/2015, Arq supports incremental backups the following services: Amazon s3 and Glacier Google Drive Microsoft OneDrive DropBox Google Cloud Storage SFTP to your own server DreamObjects Other S3 compatible ...


4

Yes, you may use Bucket Policies to configure bucket in a way that all existing and new files will be publicly available. Here is the bucket policy you need to apply: { "Version": "2008-10-17", "Statement": [ { "Sid": "AllowPublicRead", "Effect": "Allow", "Principal": { "AWS": "*" }, "Action": [ ...


3

From Amazon aws forum: s3cmd -c .s3cfg-bespoke --rexclude "/$" sync s3://my_bucket/ ~/local_folder/


3

Your Dropbox is encrypted during transmission and while stored on their servers. Dropbox themselves do, however, have access to there files but it is against their policy to look at your files (note that it's against policy though technically possible). If you're concerned with the security of your files on any of these services, the solution is to encrypt ...


3

Jungle Disk Workgroup Edition fits your requirements. There's even an iPhone/iPad app.


3

DragonDisk is a decent Amazon S3 GUI client for Ubuntu.


3

My two cents go to Jungledisk. The interface is great, it will plug right into S3 and works great in a Windows ecosystem


3

S3 buckets can be accessed by anyone as long as you know: the bucket name the access key the secret key There are many tools that allow you to connect to an S3 bucket and up/download files, including: S3 browser Cyberduck s3fs (CLI) s3cmd (CLI) … I'm sure a web search for S3 clients will deliver more results.


3

Click the triangle next to "Other Computers". (Or if you're using Arq 3, hover your mouse over "Other Backup Sets" and click the "Show" link). There you'll find your old backup data. Select it and click the "Adopt This Backup Set". This will cause Arq to adopt the settings and backup data it was using on your old computer, so you don't have to re-upload. ...


2

So, first: regions like us-east-1 contain availability zones like us-east-1e. S3 operates in terms of regions, whereas many EC2 concepts (including VPC subnets and reserved instances) are specifically concerned with availability zones. The ec2-import-instance documentation shows how to specify both a region and an availability zone. Try --region us-east-1 ...


2

The public data sets are not hosted on Amazon S3 as such, rather they are provided as Amazon Elastic Block Store (EBS) snapshots. While these are stored on S3 in fact, it is not possible to access such a snapshot directly, rather you need to create a new EBS volume from it and attach it to an Amazon EC2 instance for further processing at your discretion. ...


2

This is caused by backups to iCloud, Apple's cloud storage service. While I can't find any official information from Apple, some sites are reporting that Apple is using both Azure and S3 to store iCloud data. I've not found any way to limit the bandwidth through the device itself; limiting the throughput on the router seems to be the only way to throttle ...


2

Under the assumption that you have created an IAM user with a dedicated policy it might miss the s3:ListAllMyBuckets action. If so, you can browse a single bucket in Cyberduck by connecting to mybucket.s3.amazonaws.com instead of the default S3 hostname. Refer to http://trac.cyberduck.ch/wiki/help/en/howto/s3#Externalbuckets.


2

I haven't tried that particular storage option, but cyberduck supports s3, has a sync option, and has generally been quite robust for me.


2

I just tried using s3tools (s3cmd-1.5.0-rc1). Got this hint from their FAQ http://s3tools.org/kb/item13.htm. See below. Does s3cmd support multipart uploads? Yes, the latest version of s3cmd supports Amazon S3 multipart uploads. Multipart uploads are automatically used when a file to upload is larger than 15MB. In that case the file is ...


2

A one liner: diff <(awk '{print $4}' s3 | sort) <(awk '{print $1}' local | sort) Basically, what it does is compare the output of awk, which we'll use to print the fourth and first column of the files, respectively. We need to sort the output in case the hashes are in different orders. The <(…) syntax is process substitution and allows us to run ...


2

Haven't tried it myself, but Dolly Drive is designed to create a Time Machine volume that exists "in the cloud"



Only top voted, non community-wiki answers of a minimum length are eligible