Amazon S3 (Simple Storage Service) is a web service which provides storage and various interfaces for accessing data stored there.

learn more… | top users | synonyms (1)

21
votes
7answers
17k views

Replacing Dropbox with: Amazon S3 + SSL + GPG/TrueCrypt + Mounting on OSX ?? [closed]

So, right now we're using Dropbox to share various data files around between approximately 10 Mac OS X systems. However, we already have an S3 account and everyone on the lowest Dropbox plan of ...
19
votes
3answers
11k views

Uploading files to S3 account from linux command prompt

I've got several large files sitting in my linux hosted account that I need to upload to my S3 account. I dont want to download them first and then upload it into S3. Is there any way I can "upload" ...
15
votes
4answers
8k views

Time machine backup on S3

Is there any possibility to use Amazon S3 for Mac OS X time machine backups? Or in other words: Use S3 rather an external hard disk for time machine backups?
12
votes
5answers
10k views

A decent S3 bucket manager for Ubuntu

I'm looking for a decent S3 bucket manager for Ubuntu (Gnome). I prefer it to integrate with Nautilus so it will look like just any other drive (a la WebDAV) but so far I haven't been able to find ...
10
votes
6answers
9k views

Alternative to Amazon's S3 service? [closed]

Just wondering if there is good alternative to Amazon's S3 service? I like S3 but the bandwidth cost is high. I looked at CouldFiles from Rackspace but the cost is even higher. I don't mind ...
9
votes
3answers
9k views

Can I use rsync for backing up at Amazon S3

I have bought some space from evbackup which provides me FTP, rsync and SSH. But I have also read that Amazon S3 can also be used to backups. So I am really confused that do Amazon give FTP access ...
6
votes
3answers
6k views

Amazon S3 Recover Deleted File

Is it possible to recover a file I deleted from my S3 bucket?
6
votes
2answers
5k views

Auto-set permissions when uploading to Amazon S3 with Transmit 4 [closed]

Does anyone know how to auto-set the read permissions for "World" upon upload of a file to Amazon S3 with Transmit? It is currently a two step process in my workflow: upload the file change ...
6
votes
3answers
1k views

What free method would you recommend for mounting an Amazon S3 bucket on OS X 10.6?

It seems s3fs is broken on Snow Leopard ( http://mark.aufflick.com/blog/2007/10/28/leopard-amazon-s3-network-storage ) Does anyone know of a free (and preferably open source) way to mount a bucket so ...
4
votes
4answers
1k views

Can I rely on S3 to keep my data secure?

I want to back up sensitive personal data to S3 via an rsync-style interface. I'm currently using s3cmd - a great tool - but it doesn't yet support encrypted syncs. This means that while my data is ...
4
votes
1answer
2k views

How to mount Amazon S3 bucket to a directory on FreeBSD?

I can't find a solution on how to mount an Amazon S3 bucket to an existing directory on FreeBSD. I suspect, I need to install port fusefs-s3fs. But how should I configure it? I can't find any info.
4
votes
1answer
4k views

Amazon S3 GUI client for OS X [closed]

I'm looking for a good GUI client for Amazon S3. On Windows I used Cloudberry Explorer and I would like to know if there's anything like that for Mac OS X.
4
votes
1answer
521 views

A company wide dropbox like system on top of Amazon S3

Is there a system that will provide dropbox like features on top of Amazon s3? It would be used company wide, mostly for documents, recordings, etc... Some users work on Microsoft Windows, others on ...
4
votes
5answers
766 views

Cloud based backup solutions based on open standards?

I am looking for a solution to backup and consolidate important media from a couple Windows laptops and Mac laptop. I would like a solutions that based on open standards, so my data isn't trapped by ...
4
votes
1answer
2k views

Why can't I connect to my Amazon S3 storage with two of my three clients?

I use Transmit, Cyberduck, and Espresso, all of which support connecting to Amazon S3. But for some reason, I can only connect to my S3 storage successfully in Transmit; Cyberduck and Espresso both ...
4
votes
1answer
226 views

Automatically Transcode Video and Upload to Cloud

I'm looking for a solution to take video files from my HD Camera and automate transcoding to a smaller format and then uploading to the cloud (AWS or otherwise). The ideal workflow would be, I have a ...
4
votes
1answer
417 views

How to automate regular google takeout backups to cloud storage

I would like create a regular google takeout backups (let's say every 3 months) and store them encrypted in some other cloud storage like DropBox or S3. It does not have to be cloud-to-cloud ...
3
votes
5answers
1k views

Setting up scripts in Amazon EC2 Cloud

I am currently running a few perl and python scripts on a windows pc and would like to port over to the Amazon EC2 servers running 64-bit LINUX. The scripts are basic web scrapers that go to a ...
3
votes
2answers
375 views

Amazon S3 - To Backup or Not to Backup

So heres a question: Should I back up my data if I store using S3 (not RRS) or does S3 already handle a good enough multiple site data replication redundancy? If backing up is desired, I'd like to ...
3
votes
1answer
2k views

Encryption strategy for Amazon S3?

I'm running Windows and strongly considering using Amazon S3 to back up some of my more important data, but i'm having trouble coming up with a good encryption strategy. I'm a fan of Truecypt and use ...
3
votes
1answer
884 views

Are whole VM images backed up on Amazon EC2/S3?

I've been trying to get my head around Amazon Web Services as a VPS provider. My understanding is a EC2 instance running Windows is basically a Windows VM, very similar to renting a VPS from a more ...
3
votes
1answer
1k views

Use personal Amazon S3 account to backup Gmail using Ubuntu

As question, I have found online that backupify offer shifting from their S3 to user's personal S3, I have a backupify account but I can't find this options, besides, I don't prefer having my email ...
2
votes
2answers
815 views

What actually is Amazon EC2's 'pay per hour' for on demand instances?

I'm thinking to host my ROR website on Amazon EC2. I wont be needing a S3 as of now. But when I check the their pricing it's like Micro - $0.020 per Hour I don't get this per hour billing.My ...
2
votes
1answer
955 views

Is having Linux VPS same as Amazon EC2 or S3 [closed]

I am new to Amazon services so have no idea, whenever i ask some questions on forums , few recommend Amazon instead of VPS. So i want to know is having Amazon EC2 or S3 is exact replacement of VPS. i ...
2
votes
3answers
792 views

What desktop app can sync Amazon S3 with an FTP folder?

What I'm trying to do is migrate large files off my web site to S3.
2
votes
1answer
590 views

s3cmd tool falls over on local directory

I'm trying to use s3cmd to copy a full bucket down to my local machine like so: s3cmd -c .s3cfg-bespoke sync s3://my_bucket/ ~/local_folder/ There are three folders and a smattering of files in the ...
2
votes
1answer
381 views

Zip Multiple Text Files from Multiple Directories into One ZIP File in One Command in Bash

I have an account on AWS and I use S3 for storing data. I have commands that will enable me to zip data files like so: data.zip s3_dir/level-1/level-2/*/*/data.txt But there are, say, 50 or more ...
2
votes
2answers
785 views

Transfer file to Amazon S3 from web server

How do I transfer a tarball from my web server (e.g. http://example.com/backup.tar.gz) to an Amazon S3 bucket? Do I have to download it locally and upload it?
2
votes
1answer
266 views

Backup software for Ubuntu - which one?

I have spent some time testing out different backup solutions for my small home office during the last weeks, but still haven't found anything that have been working out too well yet. We can ...
2
votes
1answer
57 views

Where are these S3 requests coming from?

I've recently been working to create a CentOS 6.4 Amazon machine image (AMI) from scratch to be used as a base image for running Postfix email services on EC2. In my quest to learn the process, I ...
2
votes
1answer
2k views

S3 based dropbox like program for mac os and windows [closed]

I use dropbox to sync file between several computers. It does the job quite well but it have several disadvantages: Storing files on S3 is much cheaper (I need about 10Gb for all my shared files) ...
2
votes
2answers
1k views

Real-Time Automated Amazon S3 Backup for Windows

I'm looking for a service I can configure in Windows 7 that will run in the background to monitor selected file system(s) for changes, and immediately push those changes in a lazy fashion to my Amazon ...
2
votes
2answers
455 views

Is there the equivalent of cloud computing for modems?

I asked this question on SF, and someone recommended that I ask it on SO, and on SO, it was voted to be closed, and someone suggest that I post it here - (and so, the merry go round continues) - so ...
2
votes
1answer
441 views

Amazon S3 bucket - download only certain files

I have an Amazon S3 bucket with 10,000 images sitting in it with a standard naming convention: 001_small.jpg 001_large.jpg 002_small.jpg 002_large.jpg Since there is such a large amount of files I ...
2
votes
0answers
702 views

Automating backup of Amazon S3 data - Alternatives to Bucket Commander?

I need to back up an entire Amazon S3 110 GB bucket on an automatic basis, to a location only accessible to me. We do not store data physically, all our data is in the cloud, so what I am looking for ...
2
votes
1answer
787 views

Can Git GPG program be used for s3cmd?

My ultimate goal is to be able to put files onto my Amazon EC2 server. After a month of failed attempts at getting SSH access to the server, I have decided to try s3cmd and eventually migrate files ...
2
votes
1answer
544 views

Subversion repository on Amazon S3

Is it possible to put a subversion repository on Amazon S3. I found SvnToS3 on google code but that project seems dead.
2
votes
1answer
286 views

Can I prevent Jungle Disk's “Compressing Backup Database” process from spiking my CPU?

Every time my scheduled backup runs, it spikes my CPU usage up to 100%, literally freezing everything else I'm doing. It is only during the 'Compressing Backup Database' part of the backup process ...
2
votes
1answer
824 views

Getting a Quicktime Movie to Stream Instead of Download

In the past, I've placed Quicktime movies on Amazon S3, and when a user loads the file's in Firefox (on OS X), the movie starts playing immediately, doing that pseudo streaming quicktime thing where ...
1
vote
3answers
133 views

How concerned do you think I need to be about the security and integrity of my Dropbox and Amazon S3 accounts? [closed]

What are the risks? Where are the vulnerabilities? Is my Dropbox encrypted?
1
vote
1answer
1k views

Why is my iPad connecting to S3 and using lots of bandwidth? [closed]

I noticed my connection has been extremely slow lately at some random times. I figured someone in my house was torrenting, so I booted up tcpdump on the router. What I found out is that it appears ...
1
vote
1answer
1k views

How can I download a copy of an S3 public data set?

i was naively assuming I could do something like s3cmd sync s3://snap-d203feb5 /var/tmp/copy but I seem to have the wrong idea of how to go about this. I cannot even get a simple thing to work; ...
1
vote
2answers
1k views

can i create a symlink from an ec2 disk to S3 bucket?

Is it possible to create a symlink from a file on the local disk of a windows machine in ec2 so that it is actually stored in an S3 bucket? MSMQ wants to write our queue to a local disk and this ...
1
vote
2answers
705 views

Using S3 instead of FTP- any reason NOT to?

Whenever a client wants an FTP storage solution, my instinct it to direct them to S3 instead, as a secure and cost-effective alternative. Is there any good reason NOT to use S3 instead of FTP/SFTP in ...
1
vote
1answer
105 views

AWS S3 cp does not download 40 GB file

I just uploaded a 40GB backup file from my linux EC2 machine to an S3 bucket. However when I want to download it the aws command ends with no message and nothing was copied. Here is my command: ...
1
vote
1answer
22 views

How to get the last time a particular file was downloaded from S3

I was wondering if there is a way to get the last downloaded time on of an S3 object. I had a use case where I need this data to decide whether to remove a file if its not downloaded for a set period. ...
1
vote
1answer
275 views

Can't get instances of a video (mp4) to play in multiple tabs in Chrome

I have a mp4 that I would like to play in Chrome. The mp4 is stored on s3 and has a url like http://bucket.s3.amazonaws.com/vid.mp4 Now when I put that url into Chrome 27.0.1453.94 the video plays. ...
1
vote
1answer
489 views

How to upload big files to S3 on a flaky connection?

I have a bunch of files (between 500MB and 7GB) that I need uploaded to an S3 bucket. My connection is very flaky. I tried uploading a 500MB file via s3cmd but it timed out after it was 91% done ...
1
vote
1answer
458 views

Is it possible to transfer files from Amazon S3 directly to another web server? [closed]

I need to transfer some files from several Amazon S3 buckets to a different web server. The amount of data is several gigs, so downloading and re-uploading is not favorable. I have done some ...
1
vote
1answer
1k views

Using a script that uses Duplicity + S3 excluding large files

I'm trying to write an backup script that will exclude files over a certain size. If i run the script duplicity gives an error. However if I copy and paste the same command generated by the script ...