Amazon S3 (Simple Storage Service) is a web service which provides storage and various interfaces for accessing data stored there. Questions about Amazon S3 should be asked on webapps.stackexchange.com.

learn more… | top users | synonyms (1)

0
votes
0answers
16 views

Would be great to send a large file to AWS EC2

Background: I have battled to install an rstudio server on AWS EC2 for some time (since November). It has been like the peeling back layers of an onion, always another hurdle. For a windows user ...
-1
votes
0answers
22 views

GitHub Desktop Installation error

I am trying to install GitHub Desktop and getting following error: Activation of http://github-windows.s3.amazonaws.com/GitHub.application resulted in exception. Following failure messages were ...
0
votes
1answer
33 views

s3 file access denied for large files using cyberduck

When I use a custom policy below, I get the following error when uploading large files (1G and over) using cyberduck file access denied. please contact your web hosting service provider for ...
1
vote
1answer
31 views

How to copy a .zip from within a .tar to a given location without extracting entire .tar using AWS S3 CLI

OSX 10.11 - python3.5 or AWS CLI (or other tool?) I have ~ 5,000 subdirectories within an Amazon S3 bucket, each subdirectory contains a single .tar. In each .tar it contains only one .zip, ~<1mb ...
0
votes
1answer
77 views

How to safely upload many GB of data to Amazon S3?

I am backing up my personal photo/video library to Amazon S3 (several hundred GB). I am currently using Cyberduck on my Mac to drag & drop, but I've already had a few fail without a clear ...
3
votes
4answers
499 views

Let's Encrypt with Amazon S3

Will it be possible to have https on the my static Amazon S3 website with Let's Encrypt? Even I have Let's Encrypt Closed Beta Invite now. But how to use it with Amazon S3?
1
vote
0answers
36 views

AWS server retired; new instance lost access to S3

My old company has a system with a node.js front end running on an AWS EC2 instance. The instance was 'retired' yesterday morning, and I got a frantic call from the CEO because they were down. I got ...
1
vote
0answers
33 views

How to transcode AES encrypted files with AWS Elastic Transcoder

I want to upload my encrypted videos to S3 and use Elastic Transcoder to transcode them. This is what I'm currently doing and isn't working at all. I'm using openssl to encrypt my video files. The ...
0
votes
1answer
43 views

Geo-balanced (static) website hosting

Abstract I'm rebuilding my website and this time around, I have decided to go with a static website generator (jekyll, sculpin.io, etc). Partially as an excercise, I want this site to be hosted on a ...
0
votes
0answers
35 views

Amazon S3 upload error: An exception occurred while uploading parts to a multipart upload

I am trying to upload a 30 GB file to Amazon S3 using the AWS PHP SDK. require('../vendor/autoload.php'); $client = new Aws\S3\S3Client([ 'version' => 'latest', 'region' => 'us-east-1' ]); ...
1
vote
3answers
61 views

Renaming files fetched via “wget --mirror” in Bash before uploading to an Amazon S3 statically hosted area

I’m trying to archive and upload an old website to statically hosted Amazon S3 area. I was able to get the contents with wget, using the following command: wget --mirror --no-parent --html-extension ...
0
votes
1answer
456 views

S3Fox Exception: Too Many Arguments

I'm running the S3Fox add-on in FireFox 38.0.1 Getting this error when I try to download a file from Amazon S3 to my local PC: [Exception... "Not enough arguments [nsIWebBrowserPersist.saveURI]" ...
0
votes
0answers
29 views

Get treehash for S3 files lifecycled to Glacier

I know how to get the treehash for objects in a Glacier vault, but objects automatically transitioned to Glacier via lifecycle settings are in a hidden vault, and are not accessible directly. Does ...
1
vote
2answers
158 views

Accsess S3 from the command line without a secret key

I have some files on a S3 account that I don’t own and therefore do not have the secret key for. Using a link that was sent to me, I can enter the “Account Number”, user name and password I can login ...
1
vote
1answer
2k views

How can I import a VMDK disk image to an AWS EC2 t2.micro instance on us-east-1e region using an S3 bucket on us-east-1?

I've recently purchased a reserved EC2 micro instance on region eu-east-1e. I am having trouble importing a virtual machine using ec2-api-tools: ec2iin -t t2.micro "CentOS 7 x86_64-disk1.vmdk" -g ...
1
vote
1answer
286 views

How to download a large S3 object from the command line much faster than s3cmd

With the s3cmd command you can download files from S3 like this: s3cmd get s3://my.private.bucket/some/location/hugefile.dat But that can take quite a while if the stored files are really big. Are ...
1
vote
1answer
304 views

File permissions with s3fs and ubuntu

I followed this guide to set up an amazon s3 upload procedure for my ember-js application with grunt-s3: http://www.octolabs.com/blogs/octoblog/2014/05/24/deploying-ember-cli-to-amazon-s3-with-grunt/ ...
1
vote
0answers
2k views

Can't connect to S3 using cyberduck

I'm trying to connect to my S3 bucket using cyberduck. I select S3 from the dropdown. Input into server name: {bucket-name}.s3.amazonaws.com Access key ID and Secret Access Key into the next two ...
2
votes
1answer
777 views

AWS S3 cp does not download 40 GB file

I just uploaded a 40GB backup file from my linux EC2 machine to an S3 bucket. However when I want to download it the aws command ends with no message and nothing was copied. Here is my command: ...
2
votes
1answer
759 views

https proxy s3 aws via nginx with pagespeed

I'm trying to setup pagespeed to proxy s3 files via nginx. I want to "save" the files on amazon s3; The story I want is: User A 1. nginx serves page to user; and rewrites all ...
1
vote
1answer
41 views

How to get the last time a particular file was downloaded from S3

I was wondering if there is a way to get the last downloaded time on of an S3 object. I had a use case where I need this data to decide whether to remove a file if its not downloaded for a set period. ...
0
votes
1answer
483 views

Sync local files to S3 similar to Robocopy

I am looking for a way to synchronize an entire local folder structure to Amazon S3, similar to how one might synchronize two folders using Robocopy. Whatever solution I come up with needs to be ...
0
votes
0answers
138 views

Tar a very large file directly to a drive

I was running my code to download some data on the Amazon cloud. The instance that I was running had an 8GB storage that I had bought with it plus 140GB extra instance storage (sort of plugged in as a ...
1
vote
0answers
1k views

How to use FFMPEG to transcode mp4 video for http stream in Amazon S3?

I want to use FFMPEG to transcode my mp4 video for http streaming on Amazon S3 without downloading. However, with reference to this post, I still cannot get it streaming: ffmpeg -i input.avi -c:v ...
1
vote
1answer
401 views

Arq app — Merge a backup folder from a fresh install

context I'm using Arq app, my disk have 2 partitions, os and data, the partition I'm backing up is data. added the content under data partition to backup and waited for the data upload to complete ...
0
votes
1answer
245 views

how to access an s3 bucket given user name and keys?

a friend gave me information on his s3 bucket, so I can look at his logs: user name access key secret key A lot of the material I have is to access your own bucket, but how do people share a ...
9
votes
1answer
2k views

How to automate regular google takeout backups to cloud storage

I would like create a regular google takeout backups (let's say every 3 months) and store them encrypted in some other cloud storage like DropBox or S3. It does not have to be cloud-to-cloud ...
1
vote
1answer
326 views

Allow a group to upload files on an Amazon S3 bucket

After a group trip abroad, I would like to gather the photos & videos that everybody took. I have an Amazon S3 account, how can I use it to allow people to send files to it ? Most people in the ...
1
vote
2answers
246 views

How do I backup all the photos I have in Picasa 3 to Amazon S3?

I have thousands of photos that I would like to push to Amazon S3. Picasa has them all indexed, but they are spread all over my computer and a USB drive. How do I backup all the photos I have in ...
2
votes
1answer
97 views

Where are these S3 requests coming from?

I've recently been working to create a CentOS 6.4 Amazon machine image (AMI) from scratch to be used as a base image for running Postfix email services on EC2. In my quest to learn the process, I ...
0
votes
1answer
49 views

Find out who delete the file

Hi we are using the S3 on AWS. and there are several people who have access to that box, however, everyone has to log in as the same user/ubuntu. I was doing some work, zipping a big file using ...
1
vote
1answer
3k views

GPG program not found on OS X

Trying to run s3cmd on my mac book air, receiving the following message. Success. Your access key and secret key worked fine :-) Now verifying that encryption works... ERROR: Test failed: GPG ...
0
votes
1answer
41 views

How to know what are in a file and what aren't in another?

I doing a nrpe check for my nagios about the files that I backup, sending to Amazon S3. I have two files then, s3, which list all my files that are in Amazon already. And local which list all my files ...
2
votes
0answers
151 views

Should i use AWS IAM or my root credentials for my webapp access to S3 bucket?

I have a webapp that requires uploading/deleting/reading files inside a S3 bucket. What I did was I created a brand new Amazon WebServices (aka AWS) account. Let's call this AWS account ...
0
votes
0answers
614 views

Amazon S3 usage reports per bucket

Are there any good AWS Usage Report parsers that will separate S3 usage per bucket, in a more human-readable form? Right now, you can export the usage exports into an XML or CSV file, but these are ...
-1
votes
3answers
609 views

How upload files larger than 5GB to Amazon S3 in Windows?

I need to send some SQL Server files from my Windows Server 2008 to Amazon S3. After doing some researches I found some programs that do that, but it (the freewares) can't : send files larger than ...
1
vote
1answer
554 views

Adding a disk to an Amazon EC2 instance

I am using Amazon EC2 instance where I have low disk space [root@ip-10-59-143-73 ~]# df -h Filesystem Size Used Avail Use% Mounted on /dev/xvde1 5.7G 3.3G 2.3G 60% / none ...
1
vote
1answer
518 views

Can't get instances of a video (mp4) to play in multiple tabs in Chrome

I have a mp4 that I would like to play in Chrome. The mp4 is stored on s3 and has a url like http://bucket.s3.amazonaws.com/vid.mp4 Now when I put that url into Chrome 27.0.1453.94 the video plays. ...
0
votes
2answers
2k views

How sync files with s3cmd to Amazon S3, check if sent and remove locally?

I'm trying to use Amazon S3 service to store logs from my applications. Given /user/bin/s3cmd --help tells me what I need to know how send the files: s3cmd --help usage: s3cmd [options] COMMAND ...
0
votes
0answers
252 views

Parallel upload of directory structure with small files to Amazon S3

How can I efficiently upload a big directory structure with many files to Amazon S3 from OSX? I would like to make parallel uploads.
4
votes
2answers
1k views

How to upload big files to S3 on a flaky connection?

I have a bunch of files (between 500MB and 7GB) that I need uploaded to an S3 bucket. My connection is very flaky. I tried uploading a 500MB file via s3cmd but it timed out after it was 91% done ...
1
vote
3answers
577 views

Initiate restore of directory hierarchy in Glacier to S3?

Using software that runs under Linux, is there a way to initiate a restore from Glacier to S3 of an entire directory hierarchy? The files are transferred to Glacier using a S3 bucket lifecycle rule. ...
6
votes
1answer
4k views

Why can't I connect to my Amazon S3 storage with two of my three clients?

I use Transmit, Cyberduck, and Espresso, all of which support connecting to Amazon S3. But for some reason, I can only connect to my S3 storage successfully in Transmit; Cyberduck and Espresso both ...
1
vote
1answer
2k views

Would it be okay to use the Amazon S3 for personal use? [closed]

I understand that AWS is meant for corporate use, but I just thought about using the S3 for personal backups, and by using their calculator it seems like it would be quite cheap in comparison to other ...
2
votes
1answer
933 views

Automating backup of Amazon S3 data - Alternatives to Bucket Commander? [closed]

I need to back up an entire Amazon S3 110 GB bucket on an automatic basis, to a location only accessible to me. We do not store data physically, all our data is in the cloud, so what I am looking for ...
1
vote
1answer
3k views

Why is my iPad connecting to S3 and using lots of bandwidth? [closed]

I noticed my connection has been extremely slow lately at some random times. I figured someone in my house was torrenting, so I booted up tcpdump on the router. What I found out is that it appears ...
1
vote
1answer
2k views

How can I download a copy of an S3 public data set?

i was naively assuming I could do something like s3cmd sync s3://snap-d203feb5 /var/tmp/copy but I seem to have the wrong idea of how to go about this. I cannot even get a simple thing to work; ...
1
vote
0answers
76 views

Is there a way to automate XML playlist creation for files in an S3 bucket?

I'm working on an XML-based, non-Flash music player for a client. They want to be able to upload files to a bucket and stream MP3s back to their website. I'm wondering if there's a way to ...
1
vote
1answer
585 views

Is it possible to transfer files from Amazon S3 directly to another web server? [closed]

I need to transfer some files from several Amazon S3 buckets to a different web server. The amount of data is several gigs, so downloading and re-uploading is not favorable. I have done some ...
0
votes
1answer
120 views

Methods of moving all of my local files into cloud storage [closed]

I have a large amount of data that I would like to move into cloud storage. Some of the files (~30 GB) are archived, but uncompressed, files (text, documents, images, videos, and other media). Other ...