Amazon S3 (Simple Storage Service) is a web service which provides storage and various interfaces for accessing data stored there. Questions about Amazon S3 should be asked on webapps.stackexchange.com.

learn more… | top users | synonyms (1)

0
votes
0answers
5 views

SES receiving rule set can write to S3 bucket, but sends AMAZON_SES_SETUP_NOTIFICATION AccessDenied file [migrated]

I created an S3 bucket named klein-email, and set the following bucket policy as directed. { "Version": "2008-10-17", "Statement": [ { "Sid": "...
-1
votes
0answers
6 views

Amazon encrypted connection

I am using a command like: aws s3 sync "$local_dir" "s3://$cloud_dir" --sse to sync files with my Amazon bucket ...Everything syncs properly. But I do not know if my connection to Amazon is ...
1
vote
1answer
29 views

Unable to import my vmdk to EC2 [duplicate]

I am trying to import my vmdk to EC2 as a instance using S3 bucket I am using this syntax ec2-user@ip-10-0-x-x ~$ ec2-import-instance disk1.vmdk -f VMDK -t m1.xlarge -a x86_64 -b import-raj -o ...
14
votes
4answers
12k views

Can I use rsync for backing up at Amazon S3

I have bought some space from evbackup which provides me FTP, rsync and SSH. But I have also read that Amazon S3 can also be used to backups. So I am really confused that do Amazon give FTP access ...
1
vote
1answer
2k views

How can I import a VMDK disk image to an AWS EC2 t2.micro instance on us-east-1e region using an S3 bucket on us-east-1?

I've recently purchased a reserved EC2 micro instance on region eu-east-1e. I am having trouble importing a virtual machine using ec2-api-tools: ec2iin -t t2.micro "CentOS 7 x86_64-disk1.vmdk" -g my-...
1
vote
2answers
2k views

can I create a symlink from an ec2 disk to S3 bucket?

Is it possible to create a symlink from a file on the local disk of a Windows machine in ec2 so that it is actually stored in an S3 bucket? MSMQ wants to write our queue to a local disk and this ...
23
votes
5answers
12k views

Time machine backup on S3

Is there any possibility to use Amazon S3 for Mac OS X time machine backups? Or in other words: Use S3 rather an external hard disk for time machine backups?
0
votes
0answers
11 views

keep amazon s3 bucket public between uploads

I've setup an Amazon CloudFront CDN to point to an Amazon S3 Bucket. It works great, I love how it's streamlined much of my process! But I have a problem, every time I do a new upload to it, the new ...
0
votes
0answers
36 views

aws linuxAMI crontab ec2 to s3 backup command not working

I am new to Aws Platform and was trying to get Hands on experience on Command Line... but when i was configuring installed wordpress site...and syncing it to S3 bucket.. and for that my instructor was ...
0
votes
0answers
12 views

How do I change all objects within a S3 bucket to reduced redundancy?

I'd like to know if there is a bucket wide (not per object) way of doing this. Bash, s3cmd, python any possible way would work for me. Thank you!
0
votes
0answers
48 views

How can I restore a MySql database dump direct from S3?

I have a gzipped database backup stored on S3 and would like to restore it to MySql without having to first download it due to disk space constraints. I tried the two commands below but got gzip: ...
1
vote
0answers
33 views

does s3cmd put command overwrite files?

I am trying to write a script that will automatically backup a drive I have to amazon s3. I have downloaded s3cmd and I am wondering what the put command does... It seems to me like it uploads the ...
4
votes
5answers
825 views

Let's Encrypt with Amazon S3

Will it be possible to have https on the my static Amazon S3 website with Let's Encrypt? Even I have Let's Encrypt Closed Beta Invite now. But how to use it with Amazon S3?
0
votes
0answers
64 views

Would be great to send a large file to AWS EC2

Background: I have battled to install an rstudio server on AWS EC2 for some time (since November). It has been like the peeling back layers of an onion, always another hurdle. For a windows user ...
1
vote
1answer
56 views

How to copy a .zip from within a .tar to a given location without extracting entire .tar using AWS S3 CLI

OSX 10.11 - python3.5 or AWS CLI (or other tool?) I have ~ 5,000 subdirectories within an Amazon S3 bucket, each subdirectory contains a single .tar. In each .tar it contains only one .zip, ~<1mb ...
0
votes
1answer
329 views

s3 file access denied for large files using cyberduck

When I use a custom policy below, I get the following error when uploading large files (1G and over) using cyberduck file access denied. please contact your web hosting service provider for ...
0
votes
1answer
99 views

How to safely upload many GB of data to Amazon S3?

I am backing up my personal photo/video library to Amazon S3 (several hundred GB). I am currently using Cyberduck on my Mac to drag & drop, but I've already had a few fail without a clear retry/...
8
votes
3answers
12k views

Amazon S3 Recover Deleted File

Is it possible to recover a file I deleted from my S3 bucket?
1
vote
0answers
113 views

How to transcode AES encrypted files with AWS Elastic Transcoder

I want to upload my encrypted videos to S3 and use Elastic Transcoder to transcode them. This is what I'm currently doing and isn't working at all. I'm using openssl to encrypt my video files. The ...
-1
votes
3answers
714 views

How upload files larger than 5GB to Amazon S3 in Windows?

I need to send some SQL Server files from my Windows Server 2008 to Amazon S3. After doing some researches I found some programs that do that, but it (the freewares) can't : send files larger than ...
2
votes
3answers
1k views

Transfer file to Amazon S3 from web server

How do I transfer a tarball from my web server (e.g. http://example.com/backup.tar.gz) to an Amazon S3 bucket? Do I have to download it locally and upload it?
1
vote
2answers
283 views

How do I backup all the photos I have in Picasa 3 to Amazon S3?

I have thousands of photos that I would like to push to Amazon S3. Picasa has them all indexed, but they are spread all over my computer and a USB drive. How do I backup all the photos I have in ...
2
votes
4answers
1k views
39
votes
6answers
39k views

Uploading files to S3 account from linux command prompt

I've got several large files sitting in my linux hosted account that I need to upload to my S3 account. I dont want to download them first and then upload it into S3. Is there any way I can "upload" ...
1
vote
0answers
56 views

AWS server retired; new instance lost access to S3

My old company has a system with a node.js front end running on an AWS EC2 instance. The instance was 'retired' yesterday morning, and I got a frantic call from the CEO because they were down. I got ...
0
votes
1answer
60 views

Geo-balanced (static) website hosting

Abstract I'm rebuilding my website and this time around, I have decided to go with a static website generator (jekyll, sculpin.io, etc). Partially as an excercise, I want this site to be hosted on a ...
0
votes
0answers
71 views

Amazon S3 upload error: An exception occurred while uploading parts to a multipart upload

I am trying to upload a 30 GB file to Amazon S3 using the AWS PHP SDK. require('../vendor/autoload.php'); $client = new Aws\S3\S3Client([ 'version' => 'latest', 'region' => 'us-east-1' ]); $...
1
vote
3answers
80 views

Renaming files fetched via “wget --mirror” in Bash before uploading to an Amazon S3 statically hosted area

I’m trying to archive and upload an old website to statically hosted Amazon S3 area. I was able to get the contents with wget, using the following command: wget --mirror --no-parent --html-extension ...
0
votes
1answer
471 views

S3Fox Exception: Too Many Arguments

I'm running the S3Fox add-on in FireFox 38.0.1 Getting this error when I try to download a file from Amazon S3 to my local PC: [Exception... "Not enough arguments [nsIWebBrowserPersist.saveURI]" ...
1
vote
1answer
619 views

Adding a disk to an Amazon EC2 instance

I am using Amazon EC2 instance where I have low disk space [root@ip-10-59-143-73 ~]# df -h Filesystem Size Used Avail Use% Mounted on /dev/xvde1 5.7G 3.3G 2.3G 60% / none ...
1
vote
2answers
286 views

Accsess S3 from the command line without a secret key

I have some files on a S3 account that I don’t own and therefore do not have the secret key for. Using a link that was sent to me, I can enter the “Account Number”, user name and password I can login ...
0
votes
2answers
2k views

How sync files with s3cmd to Amazon S3, check if sent and remove locally?

I'm trying to use Amazon S3 service to store logs from my applications. Given /user/bin/s3cmd --help tells me what I need to know how send the files: s3cmd --help usage: s3cmd [options] COMMAND [...
0
votes
0answers
710 views

Amazon S3 usage reports per bucket

Are there any good AWS Usage Report parsers that will separate S3 usage per bucket, in a more human-readable form? Right now, you can export the usage exports into an XML or CSV file, but these are ...
0
votes
1answer
41 views

How to know what are in a file and what aren't in another?

I doing a nrpe check for my nagios about the files that I backup, sending to Amazon S3. I have two files then, s3, which list all my files that are in Amazon already. And local which list all my files ...
2
votes
1answer
1k views

Automating backup of Amazon S3 data - Alternatives to Bucket Commander? [closed]

I need to back up an entire Amazon S3 110 GB bucket on an automatic basis, to a location only accessible to me. We do not store data physically, all our data is in the cloud, so what I am looking for ...
2
votes
1answer
892 views

https proxy s3 aws via nginx with pagespeed

I'm trying to setup pagespeed to proxy s3 files via nginx. I want to "save" the files on amazon s3; The story I want is: User A 1. nginx serves page to user; and rewrites all https://s3.amazonaws....
4
votes
2answers
2k views

How to upload big files to S3 on a flaky connection?

I have a bunch of files (between 500MB and 7GB) that I need uploaded to an S3 bucket. My connection is very flaky. I tried uploading a 500MB file via s3cmd but it timed out after it was 91% done (...
1
vote
1answer
460 views

How to download a large S3 object from the command line much faster than s3cmd

With the s3cmd command you can download files from S3 like this: s3cmd get s3://my.private.bucket/some/location/hugefile.dat But that can take quite a while if the stored files are really big. Are ...
1
vote
1answer
384 views

File permissions with s3fs and ubuntu

I followed this guide to set up an amazon s3 upload procedure for my ember-js application with grunt-s3: http://www.octolabs.com/blogs/octoblog/2014/05/24/deploying-ember-cli-to-amazon-s3-with-grunt/ ...
2
votes
1answer
878 views

AWS S3 cp does not download 40 GB file

I just uploaded a 40GB backup file from my linux EC2 machine to an S3 bucket. However when I want to download it the aws command ends with no message and nothing was copied. Here is my command: ...
14
votes
1answer
3k views

How to automate regular google takeout backups to cloud storage

I would like create a regular google takeout backups (let's say every 3 months) and store them encrypted in some other cloud storage like DropBox or S3. It does not have to be cloud-to-cloud solution,...
1
vote
0answers
2k views

Can't connect to S3 using cyberduck

I'm trying to connect to my S3 bucket using cyberduck. I select S3 from the dropdown. Input into server name: {bucket-name}.s3.amazonaws.com Access key ID and Secret Access Key into the next two ...
10
votes
6answers
11k views

Alternative to Amazon's S3 service? [closed]

Just wondering if there is good alternative to Amazon's S3 service? I like S3 but the bandwidth cost is high. I looked at CouldFiles from Rackspace but the cost is even higher. I don't mind ...
1
vote
1answer
611 views

Can't get instances of a video (mp4) to play in multiple tabs in Chrome

I have a mp4 that I would like to play in Chrome. The mp4 is stored on s3 and has a url like http://bucket.s3.amazonaws.com/vid.mp4 Now when I put that url into Chrome 27.0.1453.94 the video plays. ...
1
vote
1answer
596 views

Sync local files to S3 similar to Robocopy

I am looking for a way to synchronize an entire local folder structure to Amazon S3, similar to how one might synchronize two folders using Robocopy. Whatever solution I come up with needs to be ...
1
vote
1answer
57 views

How to get the last time a particular file was downloaded from S3

I was wondering if there is a way to get the last downloaded time on of an S3 object. I had a use case where I need this data to decide whether to remove a file if its not downloaded for a set period.
0
votes
0answers
163 views

Tar a very large file directly to a drive

I was running my code to download some data on the Amazon cloud. The instance that I was running had an 8GB storage that I had bought with it plus 140GB extra instance storage (sort of plugged in as a ...
1
vote
0answers
1k views

How to use FFMPEG to transcode mp4 video for http stream in Amazon S3?

I want to use FFMPEG to transcode my mp4 video for http streaming on Amazon S3 without downloading. However, with reference to this post, I still cannot get it streaming: ffmpeg -i input.avi -c:v ...
1
vote
1answer
481 views

Arq app — Merge a backup folder from a fresh install

context I'm using Arq app, my disk have 2 partitions, os and data, the partition I'm backing up is data. added the content under data partition to backup and waited for the data upload to complete ...
0
votes
1answer
306 views

how to access an s3 bucket given user name and keys?

a friend gave me information on his s3 bucket, so I can look at his logs: user name access key secret key A lot of the material I have is to access your own bucket, but how do people share a ...