Amazon S3 (Simple Storage Service) is a web service which provides storage and various interfaces for accessing data stored there.

learn more… | top users | synonyms (1)

1
vote
1answer
16 views

AWS S3 cp does not download 40 GB file

I just uploaded a 40GB backup file from my linux EC2 machine to an S3 bucket. However when I want to download it the aws command ends with no message and nothing was copied. Here is my command: ...
0
votes
0answers
14 views

How to know when a file was deleted from Amazon S3?

Some files in our S3 bucket have been deleted (unintentionally). Is there a way to find out when or who deleted these files? Is there a log file or website that might contain this information.
0
votes
0answers
85 views

https proxy s3 aws via nginx with pagespeed

I'm trying to setup pagespeed to proxy s3 files via nginx. I want to "save" the files on amazon s3; The story I want is: User A 1. nginx serves page to user; and rewrites all ...
1
vote
1answer
18 views

How to get the last time a particular file was downloaded from S3

I was wondering if there is a way to get the last downloaded time on of an S3 object. I had a use case where I need this data to decide whether to remove a file if its not downloaded for a set period. ...
0
votes
1answer
36 views

Sync local files to S3 similar to Robocopy

I am looking for a way to synchronize an entire local folder structure to Amazon S3, similar to how one might synchronize two folders using Robocopy. Whatever solution I come up with needs to be ...
0
votes
0answers
54 views

Tar a very large file directly to a drive

I was running my code to download some data on the Amazon cloud. The instance that I was running had an 8GB storage that I had bought with it plus 140GB extra instance storage (sort of plugged in as a ...
1
vote
0answers
262 views

How to use FFMPEG to transcode mp4 video for http stream in Amazon S3?

I want to use FFMPEG to transcode my mp4 video for http streaming on Amazon S3 without downloading. However, with reference to this post, I still cannot get it streaming: ffmpeg -i input.avi -c:v ...
0
votes
1answer
47 views

Arq app — Merge a backup folder from a fresh install

context I'm using Arq app, my disk have 2 partitions, os and data, the partition I'm backing up is data. added the content under data partition to backup and waited for the data upload to complete ...
0
votes
1answer
63 views

how to access an s3 bucket given user name and keys?

a friend gave me information on his s3 bucket, so I can look at his logs: user name access key secret key A lot of the material I have is to access your own bucket, but how do people share a ...
3
votes
0answers
202 views

How to automate regular google takeout backups to cloud storage

I would like create a regular google takeout backups (let's say every 3 months) and store them encrypted in some other cloud storage like DropBox or S3. It does not have to be cloud-to-cloud ...
1
vote
1answer
100 views

Allow a group to upload files on an Amazon S3 bucket

After a group trip abroad, I would like to gather the photos & videos that everybody took. I have an Amazon S3 account, how can I use it to allow people to send files to it ? Most people in the ...
0
votes
0answers
36 views

amazon beanstalk and local files

I have a web application in PHP that accepts image uploads from a user interface (sent using some javascript). The PHP application processes the image and saves to disk several different versions and ...
1
vote
2answers
95 views

How do I backup all the photos I have in Picasa 3 to Amazon S3?

I have thousands of photos that I would like to push to Amazon S3. Picasa has them all indexed, but they are spread all over my computer and a USB drive. How do I backup all the photos I have in ...
2
votes
1answer
43 views

Where are these S3 requests coming from?

I've recently been working to create a CentOS 6.4 Amazon machine image (AMI) from scratch to be used as a base image for running Postfix email services on EC2. In my quest to learn the process, I ...
0
votes
1answer
41 views

Find out who delete the file

Hi we are using the S3 on AWS. and there are several people who have access to that box, however, everyone has to log in as the same user/ubuntu. I was doing some work, zipping a big file using ...
0
votes
1answer
524 views

GPG program not found on OS X

Trying to run s3cmd on my mac book air, receiving the following message. Success. Your access key and secret key worked fine :-) Now verifying that encryption works... ERROR: Test failed: GPG ...
0
votes
1answer
34 views

How to know what are in a file and what aren't in another?

I doing a nrpe check for my nagios about the files that I backup, sending to Amazon S3. I have two files then, s3, which list all my files that are in Amazon already. And local which list all my files ...
2
votes
2answers
461 views

What actually is Amazon EC2's 'pay per hour' for on demand instances?

I'm thinking to host my ROR website on Amazon EC2. I wont be needing a S3 as of now. But when I check the their pricing it's like Micro - $0.020 per Hour I don't get this per hour billing.My ...
1
vote
0answers
89 views

Should i use AWS IAM or my root credentials for my webapp access to S3 bucket?

I have a webapp that requires uploading/deleting/reading files inside a S3 bucket. What I did was I created a brand new Amazon WebServices (aka AWS) account. Let's call this AWS account ...
0
votes
0answers
162 views

S3 usage reports per bucket

Are there any good AWS Usage Report parsers that will separate S3 usage per bucket, in a more human-readable form? Right now, you can export the usage exports into an XML or CSV file, but these are ...
0
votes
1answer
217 views

How upload files larger than 5GB to Amazon S3 in Windows?

I need to send some SQL Server files from my Windows Server 2008 to Amazon S3. After doing some researches I found some programs that do that, but it (the freewares) can't : send files larger than ...
1
vote
0answers
286 views

Adding a disk to an Amazon EC2 instance

I am using Amazon EC2 instance where I have low disk space [root@ip-10-59-143-73 ~]# df -h Filesystem Size Used Avail Use% Mounted on /dev/xvde1 5.7G 3.3G 2.3G 60% / none ...
1
vote
1answer
234 views

Can't get instances of a video (mp4) to play in multiple tabs in Chrome

I have a mp4 that I would like to play in Chrome. The mp4 is stored on s3 and has a url like http://bucket.s3.amazonaws.com/vid.mp4 Now when I put that url into Chrome 27.0.1453.94 the video plays. ...
0
votes
1answer
965 views

How sync files with s3cmd to Amazon S3, check if sent and remove locally?

I'm trying to use Amazon S3 service to store logs from my applications. Given /user/bin/s3cmd --help tells me what I need to know how send the files: s3cmd --help usage: s3cmd [options] COMMAND ...
0
votes
0answers
166 views

Parallel upload of directory structure with small files to Amazon S3

How can I efficiently upload a big directory structure with many files to Amazon S3 from OSX? I would like to make parallel uploads.
1
vote
1answer
403 views

How to upload big files to S3 on a flaky connection?

I have a bunch of files (between 500MB and 7GB) that I need uploaded to an S3 bucket. My connection is very flaky. I tried uploading a 500MB file via s3cmd but it timed out after it was 91% done ...
1
vote
3answers
397 views

Initiate restore of directory hierarchy in Glacier to S3?

Using software that runs under Linux, is there a way to initiate a restore from Glacier to S3 of an entire directory hierarchy? The files are transferred to Glacier using a S3 bucket lifecycle rule. ...
4
votes
1answer
1k views

Why can't I connect to my Amazon S3 storage with two of my three clients?

I use Transmit, Cyberduck, and Espresso, all of which support connecting to Amazon S3. But for some reason, I can only connect to my S3 storage successfully in Transmit; Cyberduck and Espresso both ...
1
vote
1answer
1k views

Would it be okay to use the Amazon S3 for personal use? [closed]

I understand that AWS is meant for corporate use, but I just thought about using the S3 for personal backups, and by using their calculator it seems like it would be quite cheap in comparison to other ...
2
votes
0answers
562 views

Automating backup of Amazon S3 data - Alternatives to Bucket Commander?

I need to back up an entire Amazon S3 110 GB bucket on an automatic basis, to a location only accessible to me. We do not store data physically, all our data is in the cloud, so what I am looking for ...
1
vote
1answer
853 views

Why is my iPad connecting to S3 and using lots of bandwidth? [closed]

I noticed my connection has been extremely slow lately at some random times. I figured someone in my house was torrenting, so I booted up tcpdump on the router. What I found out is that it appears ...
1
vote
1answer
781 views

How can I download a copy of an S3 public data set?

i was naively assuming I could do something like s3cmd sync s3://snap-d203feb5 /var/tmp/copy but I seem to have the wrong idea of how to go about this. I cannot even get a simple thing to work; ...
1
vote
0answers
63 views

Is there a way to automate XML playlist creation for files in an S3 bucket?

I'm working on an XML-based, non-Flash music player for a client. They want to be able to upload files to a bucket and stream MP3s back to their website. I'm wondering if there's a way to ...
1
vote
1answer
409 views

Is it possible to transfer files from Amazon S3 directly to another web server? [closed]

I need to transfer some files from several Amazon S3 buckets to a different web server. The amount of data is several gigs, so downloading and re-uploading is not favorable. I have done some ...
2
votes
2answers
477 views

Need PC Software that does real-time syncing for files from a local desktop folder to an amazon S3 account?

I need pc software with a GUI that will allow me to sync a folder on my computer with a folder on my amazon s3 account. The syncing needs to be in real time. It should listen for changes and then sync ...
0
votes
1answer
113 views

Methods of moving all of my local files into cloud storage [closed]

I have a large amount of data that I would like to move into cloud storage. Some of the files (~30 GB) are archived, but uncompressed, files (text, documents, images, videos, and other media). Other ...
0
votes
1answer
742 views

s3cmd: how to copy files from local to S3 bucket with existing structure

I'm trying to copy files with s3cmd to a bucket with an existing folder structure. Both structures already exist both on local dev machine and in the bucket. The folders structure is as follows ...
2
votes
1answer
681 views

Can Git GPG program be used for s3cmd?

My ultimate goal is to be able to put files onto my Amazon EC2 server. After a month of failed attempts at getting SSH access to the server, I have decided to try s3cmd and eventually migrate files ...
1
vote
0answers
134 views

s3fs gives me an empty directory

I built s3fs, and now I'm getting an empty directory where I mounted the s3 bucket. I put a text file in the directory, and I can see it in there, and it transfers into the bucket. How can I see the ...
1
vote
2answers
1k views

can i create a symlink from an ec2 disk to S3 bucket?

Is it possible to create a symlink from a file on the local disk of a windows machine in ec2 so that it is actually stored in an S3 bucket? MSMQ wants to write our queue to a local disk and this ...
0
votes
1answer
593 views

Environment Variables and Shell Rc File [duplicate]

Possible Duplicate: What are PATH and other environment variables, and how can I set or use them? I am trying to automatically establish a connection with Amazon s3 using keys. This ...
0
votes
1answer
1k views

Mount a S3 bucket on Linux without 3rd party tool?

Is there any way to mount a S3 bucket on the Linux filesystem without any 3rd party tools? Assuming I have a standard Ubuntu installation.
2
votes
1answer
3k views

Amazon S3 GUI client for OS X [closed]

I'm looking for a good GUI client for Amazon S3. On Windows I used Cloudberry Explorer and I would like to know if there's anything like that for Mac OS X.
2
votes
1answer
2k views

S3 based dropbox like program for mac os and windows [closed]

I use dropbox to sync file between several computers. It does the job quite well but it have several disadvantages: Storing files on S3 is much cheaper (I need about 10Gb for all my shared files) ...
1
vote
1answer
217 views

Can I convert a Jungle Disk 2.0 bucket to a “compatible” bucket?

I have some data in a Jungle Disk 2.0 bucket on Amazon S3. It seems like the data in this bucket cannot be accessed via Amazon's own web interface to S3 - at least not very conveniently (the data is ...
0
votes
3answers
715 views

Upload very many files to S3

I have about 1 million images (organized in directories) that I need to get into S3. I started using s3sync.rb, but since it is built for syncing it creates tons of extra files for keeping track of ...
0
votes
1answer
527 views

s3cmd tool falls over on local directory

I'm trying to use s3cmd to copy a full bucket down to my local machine like so: s3cmd -c .s3cfg-bespoke sync s3://my_bucket/ ~/local_folder/ There are three folders and a smattering of files in the ...
2
votes
1answer
409 views

Subversion repository on Amazon S3

Is it possible to put a subversion repository on Amazon S3. I found SvnToS3 on google code but that project seems dead.
0
votes
0answers
439 views

Duplicity & S3: “The write operation timed out”

I'm trying to set up an automated backup with duplicity on Amazon S3, but I keep getting a weird error that doesn't show up on Google searches. machina:~# duplicity --version duplicity 0.6.14 Here ...
1
vote
3answers
1k views

Real-Time Automated Amazon S3 Backup for Windows

I'm looking for a service I can configure in Windows 7 that will run in the background to monitor selected file system(s) for changes, and immediately push those changes in a lazy fashion to my Amazon ...