Amazon S3 (Simple Storage Service) is a web service which provides storage and various interfaces for accessing data stored there.

learn more… | top users | synonyms (1)

0
votes
1answer
68 views

How can I import a VMDK disk image to an AWS EC2 t2.micro instance on us-east-1e region using an S3 bucket on us-east-1?

I've recently purchased a reserved EC2 micro instance on region eu-east-1e. I am having trouble importing a virtual machine using ec2-api-tools: ec2iin -t t2.micro "CentOS 7 x86_64-disk1.vmdk" -g ...
0
votes
0answers
27 views

'git status --porcelain' failed in submodule

Whenever I try to commit I get these errors: error: bad index file sha1 signature fatal: index file corrupt fatal: 'git status --porcelain' failed in submodule amazon-s3-php-class Why? What's ...
1
vote
1answer
21 views

How to download a large S3 object from the command line much faster than s3cmd

With the s3cmd command you can download files from S3 like this: s3cmd get s3://my.private.bucket/some/location/hugefile.dat But that can take quite a while if the stored files are really big. Are ...
1
vote
1answer
48 views

File permissions with s3fs and ubuntu

I followed this guide to set up an amazon s3 upload procedure for my ember-js application with grunt-s3: http://www.octolabs.com/blogs/octoblog/2014/05/24/deploying-ember-cli-to-amazon-s3-with-grunt/ ...
0
votes
0answers
87 views

Cyberduck Amazon S3 upload getting “The target server failed to respond.”

I'm uploading 26 GB of video files using Cyberduck, to an S3 bucket getting "The target server failed to respond." error for some files. There are 8 files, all less than 5 GB. The error cancels the ...
1
vote
0answers
269 views

Can't connect to S3 using cyberduck

I'm trying to connect to my S3 bucket using cyberduck. I select S3 from the dropdown. Input into server name: {bucket-name}.s3.amazonaws.com Access key ID and Secret Access Key into the next two ...
1
vote
1answer
116 views

AWS S3 cp does not download 40 GB file

I just uploaded a 40GB backup file from my linux EC2 machine to an S3 bucket. However when I want to download it the aws command ends with no message and nothing was copied. Here is my command: ...
0
votes
0answers
19 views

How to know when a file was deleted from Amazon S3?

Some files in our S3 bucket have been deleted (unintentionally). Is there a way to find out when or who deleted these files? Is there a log file or website that might contain this information.
1
vote
0answers
404 views

https proxy s3 aws via nginx with pagespeed

I'm trying to setup pagespeed to proxy s3 files via nginx. I want to "save" the files on amazon s3; The story I want is: User A 1. nginx serves page to user; and rewrites all ...
1
vote
1answer
22 views

How to get the last time a particular file was downloaded from S3

I was wondering if there is a way to get the last downloaded time on of an S3 object. I had a use case where I need this data to decide whether to remove a file if its not downloaded for a set period. ...
0
votes
1answer
162 views

Sync local files to S3 similar to Robocopy

I am looking for a way to synchronize an entire local folder structure to Amazon S3, similar to how one might synchronize two folders using Robocopy. Whatever solution I come up with needs to be ...
0
votes
0answers
80 views

Tar a very large file directly to a drive

I was running my code to download some data on the Amazon cloud. The instance that I was running had an 8GB storage that I had bought with it plus 140GB extra instance storage (sort of plugged in as a ...
1
vote
0answers
792 views

How to use FFMPEG to transcode mp4 video for http stream in Amazon S3?

I want to use FFMPEG to transcode my mp4 video for http streaming on Amazon S3 without downloading. However, with reference to this post, I still cannot get it streaming: ffmpeg -i input.avi -c:v ...
0
votes
1answer
94 views

Arq app — Merge a backup folder from a fresh install

context I'm using Arq app, my disk have 2 partitions, os and data, the partition I'm backing up is data. added the content under data partition to backup and waited for the data upload to complete ...
0
votes
1answer
103 views

how to access an s3 bucket given user name and keys?

a friend gave me information on his s3 bucket, so I can look at his logs: user name access key secret key A lot of the material I have is to access your own bucket, but how do people share a ...
5
votes
1answer
435 views

How to automate regular google takeout backups to cloud storage

I would like create a regular google takeout backups (let's say every 3 months) and store them encrypted in some other cloud storage like DropBox or S3. It does not have to be cloud-to-cloud ...
1
vote
1answer
150 views

Allow a group to upload files on an Amazon S3 bucket

After a group trip abroad, I would like to gather the photos & videos that everybody took. I have an Amazon S3 account, how can I use it to allow people to send files to it ? Most people in the ...
1
vote
1answer
127 views

How do I backup all the photos I have in Picasa 3 to Amazon S3?

I have thousands of photos that I would like to push to Amazon S3. Picasa has them all indexed, but they are spread all over my computer and a USB drive. How do I backup all the photos I have in ...
2
votes
1answer
57 views

Where are these S3 requests coming from?

I've recently been working to create a CentOS 6.4 Amazon machine image (AMI) from scratch to be used as a base image for running Postfix email services on EC2. In my quest to learn the process, I ...
0
votes
1answer
45 views

Find out who delete the file

Hi we are using the S3 on AWS. and there are several people who have access to that box, however, everyone has to log in as the same user/ubuntu. I was doing some work, zipping a big file using ...
0
votes
1answer
1k views

GPG program not found on OS X

Trying to run s3cmd on my mac book air, receiving the following message. Success. Your access key and secret key worked fine :-) Now verifying that encryption works... ERROR: Test failed: GPG ...
0
votes
1answer
36 views

How to know what are in a file and what aren't in another?

I doing a nrpe check for my nagios about the files that I backup, sending to Amazon S3. I have two files then, s3, which list all my files that are in Amazon already. And local which list all my files ...
2
votes
2answers
831 views

What actually is Amazon EC2's 'pay per hour' for on demand instances?

I'm thinking to host my ROR website on Amazon EC2. I wont be needing a S3 as of now. But when I check the their pricing it's like Micro - $0.020 per Hour I don't get this per hour billing.My ...
1
vote
0answers
111 views

Should i use AWS IAM or my root credentials for my webapp access to S3 bucket?

I have a webapp that requires uploading/deleting/reading files inside a S3 bucket. What I did was I created a brand new Amazon WebServices (aka AWS) account. Let's call this AWS account ...
0
votes
0answers
291 views

S3 usage reports per bucket

Are there any good AWS Usage Report parsers that will separate S3 usage per bucket, in a more human-readable form? Right now, you can export the usage exports into an XML or CSV file, but these are ...
0
votes
2answers
258 views

How upload files larger than 5GB to Amazon S3 in Windows?

I need to send some SQL Server files from my Windows Server 2008 to Amazon S3. After doing some researches I found some programs that do that, but it (the freewares) can't : send files larger than ...
1
vote
0answers
370 views

Adding a disk to an Amazon EC2 instance

I am using Amazon EC2 instance where I have low disk space [root@ip-10-59-143-73 ~]# df -h Filesystem Size Used Avail Use% Mounted on /dev/xvde1 5.7G 3.3G 2.3G 60% / none ...
1
vote
1answer
276 views

Can't get instances of a video (mp4) to play in multiple tabs in Chrome

I have a mp4 that I would like to play in Chrome. The mp4 is stored on s3 and has a url like http://bucket.s3.amazonaws.com/vid.mp4 Now when I put that url into Chrome 27.0.1453.94 the video plays. ...
0
votes
2answers
1k views

How sync files with s3cmd to Amazon S3, check if sent and remove locally?

I'm trying to use Amazon S3 service to store logs from my applications. Given /user/bin/s3cmd --help tells me what I need to know how send the files: s3cmd --help usage: s3cmd [options] COMMAND ...
0
votes
0answers
190 views

Parallel upload of directory structure with small files to Amazon S3

How can I efficiently upload a big directory structure with many files to Amazon S3 from OSX? I would like to make parallel uploads.
2
votes
2answers
503 views

How to upload big files to S3 on a flaky connection?

I have a bunch of files (between 500MB and 7GB) that I need uploaded to an S3 bucket. My connection is very flaky. I tried uploading a 500MB file via s3cmd but it timed out after it was 91% done ...
1
vote
3answers
465 views

Initiate restore of directory hierarchy in Glacier to S3?

Using software that runs under Linux, is there a way to initiate a restore from Glacier to S3 of an entire directory hierarchy? The files are transferred to Glacier using a S3 bucket lifecycle rule. ...
4
votes
1answer
2k views

Why can't I connect to my Amazon S3 storage with two of my three clients?

I use Transmit, Cyberduck, and Espresso, all of which support connecting to Amazon S3. But for some reason, I can only connect to my S3 storage successfully in Transmit; Cyberduck and Espresso both ...
1
vote
1answer
1k views

Would it be okay to use the Amazon S3 for personal use? [closed]

I understand that AWS is meant for corporate use, but I just thought about using the S3 for personal backups, and by using their calculator it seems like it would be quite cheap in comparison to other ...
2
votes
0answers
714 views

Automating backup of Amazon S3 data - Alternatives to Bucket Commander?

I need to back up an entire Amazon S3 110 GB bucket on an automatic basis, to a location only accessible to me. We do not store data physically, all our data is in the cloud, so what I am looking for ...
1
vote
1answer
1k views

Why is my iPad connecting to S3 and using lots of bandwidth? [closed]

I noticed my connection has been extremely slow lately at some random times. I figured someone in my house was torrenting, so I booted up tcpdump on the router. What I found out is that it appears ...
1
vote
1answer
1k views

How can I download a copy of an S3 public data set?

i was naively assuming I could do something like s3cmd sync s3://snap-d203feb5 /var/tmp/copy but I seem to have the wrong idea of how to go about this. I cannot even get a simple thing to work; ...
1
vote
0answers
69 views

Is there a way to automate XML playlist creation for files in an S3 bucket?

I'm working on an XML-based, non-Flash music player for a client. They want to be able to upload files to a bucket and stream MP3s back to their website. I'm wondering if there's a way to ...
1
vote
1answer
460 views

Is it possible to transfer files from Amazon S3 directly to another web server? [closed]

I need to transfer some files from several Amazon S3 buckets to a different web server. The amount of data is several gigs, so downloading and re-uploading is not favorable. I have done some ...
0
votes
1answer
116 views

Methods of moving all of my local files into cloud storage [closed]

I have a large amount of data that I would like to move into cloud storage. Some of the files (~30 GB) are archived, but uncompressed, files (text, documents, images, videos, and other media). Other ...
0
votes
1answer
847 views

s3cmd: how to copy files from local to S3 bucket with existing structure

I'm trying to copy files with s3cmd to a bucket with an existing folder structure. Both structures already exist both on local dev machine and in the bucket. The folders structure is as follows ...
2
votes
1answer
791 views

Can Git GPG program be used for s3cmd?

My ultimate goal is to be able to put files onto my Amazon EC2 server. After a month of failed attempts at getting SSH access to the server, I have decided to try s3cmd and eventually migrate files ...
1
vote
0answers
137 views

s3fs gives me an empty directory

I built s3fs, and now I'm getting an empty directory where I mounted the s3 bucket. I put a text file in the directory, and I can see it in there, and it transfers into the bucket. How can I see the ...
1
vote
2answers
1k views

can i create a symlink from an ec2 disk to S3 bucket?

Is it possible to create a symlink from a file on the local disk of a windows machine in ec2 so that it is actually stored in an S3 bucket? MSMQ wants to write our queue to a local disk and this ...
0
votes
1answer
782 views

Environment Variables and Shell Rc File [duplicate]

Possible Duplicate: What are PATH and other environment variables, and how can I set or use them? I am trying to automatically establish a connection with Amazon s3 using keys. This ...
0
votes
1answer
1k views

Mount a S3 bucket on Linux without 3rd party tool?

Is there any way to mount a S3 bucket on the Linux filesystem without any 3rd party tools? Assuming I have a standard Ubuntu installation.
4
votes
1answer
4k views

Amazon S3 GUI client for OS X [closed]

I'm looking for a good GUI client for Amazon S3. On Windows I used Cloudberry Explorer and I would like to know if there's anything like that for Mac OS X.
2
votes
1answer
2k views

S3 based dropbox like program for mac os and windows [closed]

I use dropbox to sync file between several computers. It does the job quite well but it have several disadvantages: Storing files on S3 is much cheaper (I need about 10Gb for all my shared files) ...
1
vote
1answer
248 views

Can I convert a Jungle Disk 2.0 bucket to a “compatible” bucket?

I have some data in a Jungle Disk 2.0 bucket on Amazon S3. It seems like the data in this bucket cannot be accessed via Amazon's own web interface to S3 - at least not very conveniently (the data is ...
0
votes
3answers
804 views

Upload very many files to S3

I have about 1 million images (organized in directories) that I need to get into S3. I started using s3sync.rb, but since it is built for syncing it creates tons of extra files for keeping track of ...