Amazon S3 (Simple Storage Service) is a web service which provides storage and various interfaces for accessing data stored there. Questions about Amazon S3 should be asked on webapps.stackexchange.com.

learn more… | top users | synonyms (1)

1
vote
3answers
594 views

Initiate restore of directory hierarchy in Glacier to S3?

Using software that runs under Linux, is there a way to initiate a restore from Glacier to S3 of an entire directory hierarchy? The files are transferred to Glacier using a S3 bucket lifecycle rule. ...
2
votes
1answer
860 views

https proxy s3 aws via nginx with pagespeed

I'm trying to setup pagespeed to proxy s3 files via nginx. I want to "save" the files on amazon s3; The story I want is: User A 1. nginx serves page to user; and rewrites all ...
2
votes
1answer
810 views

Subversion repository on Amazon S3

Is it possible to put a subversion repository on Amazon S3. I found SvnToS3 on google code but that project seems dead.
1
vote
1answer
426 views

How to download a large S3 object from the command line much faster than s3cmd

With the s3cmd command you can download files from S3 like this: s3cmd get s3://my.private.bucket/some/location/hugefile.dat But that can take quite a while if the stored files are really big. Are ...
1
vote
1answer
598 views

Adding a disk to an Amazon EC2 instance

I am using Amazon EC2 instance where I have low disk space [root@ip-10-59-143-73 ~]# df -h Filesystem Size Used Avail Use% Mounted on /dev/xvde1 5.7G 3.3G 2.3G 60% / none ...
2
votes
0answers
156 views

Should i use AWS IAM or my root credentials for my webapp access to S3 bucket?

I have a webapp that requires uploading/deleting/reading files inside a S3 bucket. What I did was I created a brand new Amazon WebServices (aka AWS) account. Let's call this AWS account ...
1
vote
0answers
28 views

does s3cmd put command overwrite files?

I am trying to write a script that will automatically backup a drive I have to amazon s3. I have downloaded s3cmd and I am wondering what the put command does... It seems to me like it uploads the ...
1
vote
0answers
51 views

AWS server retired; new instance lost access to S3

My old company has a system with a node.js front end running on an AWS EC2 instance. The instance was 'retired' yesterday morning, and I got a frantic call from the CEO because they were down. I got ...
1
vote
0answers
99 views

How to transcode AES encrypted files with AWS Elastic Transcoder

I want to upload my encrypted videos to S3 and use Elastic Transcoder to transcode them. This is what I'm currently doing and isn't working at all. I'm using openssl to encrypt my video files. The ...
1
vote
0answers
2k views

Can't connect to S3 using cyberduck

I'm trying to connect to my S3 bucket using cyberduck. I select S3 from the dropdown. Input into server name: {bucket-name}.s3.amazonaws.com Access key ID and Secret Access Key into the next two ...
1
vote
0answers
1k views

How to use FFMPEG to transcode mp4 video for http stream in Amazon S3?

I want to use FFMPEG to transcode my mp4 video for http streaming on Amazon S3 without downloading. However, with reference to this post, I still cannot get it streaming: ffmpeg -i input.avi -c:v ...
1
vote
0answers
79 views

Is there a way to automate XML playlist creation for files in an S3 bucket?

I'm working on an XML-based, non-Flash music player for a client. They want to be able to upload files to a bucket and stream MP3s back to their website. I'm wondering if there's a way to ...
1
vote
0answers
166 views

s3fs gives me an empty directory

I built s3fs, and now I'm getting an empty directory where I mounted the s3 bucket. I put a text file in the directory, and I can see it in there, and it transfers into the bucket. How can I see the ...
0
votes
0answers
11 views

keep amazon s3 bucket public between uploads

I've setup an Amazon CloudFront CDN to point to an Amazon S3 Bucket. It works great, I love how it's streamlined much of my process! But I have a problem, every time I do a new upload to it, the new ...
0
votes
0answers
26 views

aws linuxAMI crontab ec2 to s3 backup command not working

I am new to Aws Platform and was trying to get Hands on experience on Command Line... but when i was configuring installed wordpress site...and syncing it to S3 bucket.. and for that my instructor was ...
0
votes
0answers
10 views

How do I change all objects within a S3 bucket to reduced redundancy?

I'd like to know if there is a bucket wide (not per object) way of doing this. Bash, s3cmd, python any possible way would work for me. Thank you!
0
votes
0answers
39 views

How can I restore a MySql database dump direct from S3?

I have a gzipped database backup stored on S3 and would like to restore it to MySql without having to first download it due to disk space constraints. I tried the two commands below but got gzip: ...
0
votes
0answers
51 views

Would be great to send a large file to AWS EC2

Background: I have battled to install an rstudio server on AWS EC2 for some time (since November). It has been like the peeling back layers of an onion, always another hurdle. For a windows user ...
0
votes
0answers
57 views

Amazon S3 upload error: An exception occurred while uploading parts to a multipart upload

I am trying to upload a 30 GB file to Amazon S3 using the AWS PHP SDK. require('../vendor/autoload.php'); $client = new Aws\S3\S3Client([ 'version' => 'latest', 'region' => 'us-east-1' ]); ...
0
votes
0answers
158 views

Tar a very large file directly to a drive

I was running my code to download some data on the Amazon cloud. The instance that I was running had an 8GB storage that I had bought with it plus 140GB extra instance storage (sort of plugged in as a ...
0
votes
0answers
692 views

Amazon S3 usage reports per bucket

Are there any good AWS Usage Report parsers that will separate S3 usage per bucket, in a more human-readable form? Right now, you can export the usage exports into an XML or CSV file, but these are ...
0
votes
0answers
258 views

Parallel upload of directory structure with small files to Amazon S3

How can I efficiently upload a big directory structure with many files to Amazon S3 from OSX? I would like to make parallel uploads.
0
votes
0answers
697 views

Duplicity & S3: “The write operation timed out”

I'm trying to set up an automated backup with duplicity on Amazon S3, but I keep getting a weird error that doesn't show up on Google searches. machina:~# duplicity --version duplicity 0.6.14 Here ...