Amazon S3 (Simple Storage Service) is a web service which provides storage and various interfaces for accessing data stored there.

learn more… | top users | synonyms (1)

1
vote
1answer
330 views

Can't get instances of a video (mp4) to play in multiple tabs in Chrome

I have a mp4 that I would like to play in Chrome. The mp4 is stored on s3 and has a url like http://bucket.s3.amazonaws.com/vid.mp4 Now when I put that url into Chrome 27.0.1453.94 the video plays. ...
1
vote
1answer
500 views

Is it possible to transfer files from Amazon S3 directly to another web server? [closed]

I need to transfer some files from several Amazon S3 buckets to a different web server. The amount of data is several gigs, so downloading and re-uploading is not favorable. I have done some ...
1
vote
1answer
1k views

Using a script that uses Duplicity + S3 excluding large files

I'm trying to write an backup script that will exclude files over a certain size. If i run the script duplicity gives an error. However if I copy and paste the same command generated by the script ...
1
vote
2answers
284 views

All documents from S3 backup corrupted

Before I left for my trip I made a backup of all my important data to an Amazon S3 bucket. I also have a Citrix remote desktop to my disposal. Today I installed the citrix client and logged in to my ...
1
vote
1answer
600 views

Limited access to Amazon S3 buckets

Is it possible to somehow limit the access to an Amazon S3 account. I don't really like the idea of distributing my secret access key to all of my applications, that want to access just a single ...
1
vote
1answer
70 views

How to download a large S3 object from the command line much faster than s3cmd

With the s3cmd command you can download files from S3 like this: s3cmd get s3://my.private.bucket/some/location/hugefile.dat But that can take quite a while if the stored files are really big. Are ...
1
vote
1answer
119 views

File permissions with s3fs and ubuntu

I followed this guide to set up an amazon s3 upload procedure for my ember-js application with grunt-s3: http://www.octolabs.com/blogs/octoblog/2014/05/24/deploying-ember-cli-to-amazon-s3-with-grunt/ ...
1
vote
0answers
766 views

Can't connect to S3 using cyberduck

I'm trying to connect to my S3 bucket using cyberduck. I select S3 from the dropdown. Input into server name: {bucket-name}.s3.amazonaws.com Access key ID and Secret Access Key into the next two ...
1
vote
0answers
911 views

How to use FFMPEG to transcode mp4 video for http stream in Amazon S3?

I want to use FFMPEG to transcode my mp4 video for http streaming on Amazon S3 without downloading. However, with reference to this post, I still cannot get it streaming: ffmpeg -i input.avi -c:v ...
1
vote
1answer
206 views

Allow a group to upload files on an Amazon S3 bucket

After a group trip abroad, I would like to gather the photos & videos that everybody took. I have an Amazon S3 account, how can I use it to allow people to send files to it ? Most people in the ...
1
vote
1answer
172 views

How do I backup all the photos I have in Picasa 3 to Amazon S3?

I have thousands of photos that I would like to push to Amazon S3. Picasa has them all indexed, but they are spread all over my computer and a USB drive. How do I backup all the photos I have in ...
1
vote
3answers
504 views

Initiate restore of directory hierarchy in Glacier to S3?

Using software that runs under Linux, is there a way to initiate a restore from Glacier to S3 of an entire directory hierarchy? The files are transferred to Glacier using a S3 bucket lifecycle rule. ...
1
vote
1answer
1k views

Would it be okay to use the Amazon S3 for personal use? [closed]

I understand that AWS is meant for corporate use, but I just thought about using the S3 for personal backups, and by using their calculator it seems like it would be quite cheap in comparison to other ...
1
vote
0answers
73 views

Is there a way to automate XML playlist creation for files in an S3 bucket?

I'm working on an XML-based, non-Flash music player for a client. They want to be able to upload files to a bucket and stream MP3s back to their website. I'm wondering if there's a way to ...
1
vote
0answers
144 views

s3fs gives me an empty directory

I built s3fs, and now I'm getting an empty directory where I mounted the s3 bucket. I put a text file in the directory, and I can see it in there, and it transfers into the bucket. How can I see the ...
1
vote
1answer
270 views

Can I convert a Jungle Disk 2.0 bucket to a “compatible” bucket?

I have some data in a Jungle Disk 2.0 bucket on Amazon S3. It seems like the data in this bucket cannot be accessed via Amazon's own web interface to S3 - at least not very conveniently (the data is ...
1
vote
1answer
443 views

Adding a disk to an Amazon EC2 instance

I am using Amazon EC2 instance where I have low disk space [root@ip-10-59-143-73 ~]# df -h Filesystem Size Used Avail Use% Mounted on /dev/xvde1 5.7G 3.3G 2.3G 60% / none ...
0
votes
3answers
900 views

Upload very many files to S3

I have about 1 million images (organized in directories) that I need to get into S3. I started using s3sync.rb, but since it is built for syncing it creates tons of extra files for keeping track of ...
0
votes
1answer
171 views

Arq app — Merge a backup folder from a fresh install

context I'm using Arq app, my disk have 2 partitions, os and data, the partition I'm backing up is data. added the content under data partition to backup and waited for the data upload to complete ...
0
votes
1answer
129 views

how to access an s3 bucket given user name and keys?

a friend gave me information on his s3 bucket, so I can look at his logs: user name access key secret key A lot of the material I have is to access your own bucket, but how do people share a ...
0
votes
1answer
38 views

How to know what are in a file and what aren't in another?

I doing a nrpe check for my nagios about the files that I backup, sending to Amazon S3. I have two files then, s3, which list all my files that are in Amazon already. And local which list all my files ...
0
votes
1answer
1k views

I can't resolve s3 dns from time-to-time

I'm using the .net SDK to talk to S3, but too often I get the following exception: The remote name could not be resolved: 's3.amazonaws.com' I'm using the two standard OpenDNS DNS servers, and ...
0
votes
1answer
23 views

S3Fox Exception: Too Many Arguments

I'm running the S3Fox add-on in FireFox 38.0.1 Getting this error when I try to download a file from Amazon S3 to my local PC: [Exception... "Not enough arguments [nsIWebBrowserPersist.saveURI]" ...
0
votes
1answer
264 views

Sync local files to S3 similar to Robocopy

I am looking for a way to synchronize an entire local folder structure to Amazon S3, similar to how one might synchronize two folders using Robocopy. Whatever solution I come up with needs to be ...
0
votes
1answer
47 views

Find out who delete the file

Hi we are using the S3 on AWS. and there are several people who have access to that box, however, everyone has to log in as the same user/ubuntu. I was doing some work, zipping a big file using ...
0
votes
1answer
2k views

GPG program not found on OS X

Trying to run s3cmd on my mac book air, receiving the following message. Success. Your access key and secret key worked fine :-) Now verifying that encryption works... ERROR: Test failed: GPG ...
0
votes
2answers
1k views

How sync files with s3cmd to Amazon S3, check if sent and remove locally?

I'm trying to use Amazon S3 service to store logs from my applications. Given /user/bin/s3cmd --help tells me what I need to know how send the files: s3cmd --help usage: s3cmd [options] COMMAND ...
0
votes
1answer
960 views

s3cmd: how to copy files from local to S3 bucket with existing structure

I'm trying to copy files with s3cmd to a bucket with an existing folder structure. Both structures already exist both on local dev machine and in the bucket. The folders structure is as follows ...
0
votes
1answer
965 views

Environment Variables and Shell Rc File [duplicate]

Possible Duplicate: What are PATH and other environment variables, and how can I set or use them? I am trying to automatically establish a connection with Amazon s3 using keys. This ...
0
votes
1answer
1k views

Mount a S3 bucket on Linux without 3rd party tool?

Is there any way to mount a S3 bucket on the Linux filesystem without any 3rd party tools? Assuming I have a standard Ubuntu installation.
0
votes
1answer
2k views

Tortoise SVN on Amazon S3

I would like to setup a Tortoise SVN repository on my Amazon S3 server. I know how to do the setup on my local machine, and I know how to do it on a server (virtual or nonvirtual) running windows. I ...
0
votes
1answer
709 views

Ubuntu: Backing up network files with duplicity?

I just installed Duplicity on Ubuntu and got everything working. However, when I try to backup a network samba-connected windows drive, The following occurs: Backup source directory ...
0
votes
0answers
6 views

How is S3/Glacier Class Storage Billed?

I have an S3 bucket with a lifecycle policy set to move items automatically to Glacier class. In this bucket I have ~212GB of data stored so far according to s3cmd. In May I retrieved two files. One ...
0
votes
0answers
16 views

Get treehash for S3 files lifecycled to Glacier

I know how to get the treehash for objects in a Glacier vault, but objects automatically transitioned to Glacier via lifecycle settings are in a hidden vault, and are not accessible directly. Does ...
0
votes
0answers
77 views

'git status --porcelain' failed in submodule

Whenever I try to commit I get these errors: error: bad index file sha1 signature fatal: index file corrupt fatal: 'git status --porcelain' failed in submodule amazon-s3-php-class Why? What's ...
0
votes
0answers
164 views

Cyberduck Amazon S3 upload getting “The target server failed to respond.”

I'm uploading 26 GB of video files using Cyberduck, to an S3 bucket getting "The target server failed to respond." error for some files. There are 8 files, all less than 5 GB. The error cancels the ...
0
votes
0answers
19 views

How to know when a file was deleted from Amazon S3?

Some files in our S3 bucket have been deleted (unintentionally). Is there a way to find out when or who deleted these files? Is there a log file or website that might contain this information.
0
votes
0answers
96 views

Tar a very large file directly to a drive

I was running my code to download some data on the Amazon cloud. The instance that I was running had an 8GB storage that I had bought with it plus 140GB extra instance storage (sort of plugged in as a ...
0
votes
0answers
415 views

Amazon S3 usage reports per bucket

Are there any good AWS Usage Report parsers that will separate S3 usage per bucket, in a more human-readable form? Right now, you can export the usage exports into an XML or CSV file, but these are ...
0
votes
2answers
345 views

How upload files larger than 5GB to Amazon S3 in Windows?

I need to send some SQL Server files from my Windows Server 2008 to Amazon S3. After doing some researches I found some programs that do that, but it (the freewares) can't : send files larger than ...
0
votes
0answers
214 views

Parallel upload of directory structure with small files to Amazon S3

How can I efficiently upload a big directory structure with many files to Amazon S3 from OSX? I would like to make parallel uploads.
0
votes
1answer
117 views

Methods of moving all of my local files into cloud storage [closed]

I have a large amount of data that I would like to move into cloud storage. Some of the files (~30 GB) are archived, but uncompressed, files (text, documents, images, videos, and other media). Other ...
0
votes
0answers
556 views

Duplicity & S3: “The write operation timed out”

I'm trying to set up an automated backup with duplicity on Amazon S3, but I keep getting a weird error that doesn't show up on Google searches. machina:~# duplicity --version duplicity 0.6.14 Here ...
0
votes
1answer
451 views

Mac OS X automatic backup: launchd + s3cmd = «Error: Can't find a config file»

I want to setup automatic backup on schedule from my mac to amazone s3. I'm using for this purpose launchd + s3cmd. s3cmd is working fine in terminal.app. But launchd can't run s3cmd. I see in ...