Amazon S3 (Simple Storage Service) is a web service which provides storage and various interfaces for accessing data stored there. S3 can store objects up to 5TB in size, along with 2KB of data. Objects are grouped into buckets which correspond to an Amazon Web Services account. Buckets and ...
0
votes
0answers
6 views
Monitoring Amazon s3 data transfer [migrated]
I'm hosting a few files on Amazon s3. These are just images for my website. Lately the traffic to my website has been growing. I'd like to monitor my data transfer from s3. How can I do this?
I've ...
0
votes
0answers
18 views
Simple tool to download a whole S3 bucket from the command line
Is there a simple tool to download a whole S3 bucket from the command line? I know about s3cmd and s3sync, none of them work (I think due to not being updated to Ruby 1.9, but I'm not sure, are they ...
0
votes
3answers
34 views
Upload very many files to S3
I have about 1 million images (organized in directories) that I need to get into S3. I started using s3sync.rb, but since it is built for syncing it creates tons of extra files for keeping track of ...
0
votes
0answers
37 views
s3cmd tool falls over on local directory
I'm trying to use s3cmd to copy a full bucket down to my local machine like so:
s3cmd -c .s3cfg-bespoke sync s3://my_bucket/ ~/local_folder/
There are three folders and a smattering of files in the ...
1
vote
0answers
74 views
Subversion repository on Amazon S3
Is it possible to put a subversion repository on Amazon S3.
I found SvnToS3 on google code but that project seems dead.
0
votes
0answers
88 views
Duplicity & S3: “The write operation timed out”
I'm trying to set up an automated backup with duplicity on Amazon S3, but I keep getting a weird error that doesn't show up on Google searches.
machina:~# duplicity --version
duplicity 0.6.14
Here ...
1
vote
3answers
128 views
Real-Time Automated Amazon S3 Backup for Windows
I'm looking for a service I can configure in Windows 7 that will run in the background to monitor selected file system(s) for changes, and immediately push those changes in a lazy fashion to my Amazon ...
0
votes
0answers
72 views
I can't resolve s3 dns from time-to-time
I'm using the .net SDK to talk to S3, but too often I get the following exception:
The remote name could not be resolved: 's3.amazonaws.com'
I'm using the two standard OpenDNS DNS servers, and ...
2
votes
1answer
84 views
How to mount Amazon S3 bucket to a directory on FreeBSD?
I can't find a solution on how to mount an Amazon S3 bucket to an existing directory on FreeBSD.
I suspect, I need to install port fusefs-s3fs.
But how should I configure it? I can't find any info.
4
votes
1answer
85 views
Automatically Transcode Video and Upload to Cloud
I'm looking for a solution to take video files from my HD Camera and automate transcoding to a smaller format and then uploading to the cloud (AWS or otherwise).
The ideal workflow would be, I have a ...
0
votes
0answers
128 views
Exclude directories s3cmd sync
I am trying to backup some stuff I have on my Ubuntu server to my s3 bucket using s3cmd.
This is what I am doing to sync..
s3cmd --dry-run -v sync --exclude="/home/user_name/exclude_me" ...
1
vote
2answers
70 views
Using S3 instead of FTP- any reason NOT to?
Whenever a client wants an FTP storage solution, my instinct it to direct them to S3 instead, as a secure and cost-effective alternative. Is there any good reason NOT to use S3 instead of FTP/SFTP in ...
0
votes
3answers
75 views
How concerned do you think I need to be about the security and integrity of my Dropbox and Amazon S3 accounts? [closed]
What are the risks? Where are the vulnerabilities?
Is my Dropbox encrypted?
1
vote
1answer
204 views
Is having Linux VPS same as Amazon EC2 or S3 [closed]
I am new to Amazon services so have no idea, whenever i ask some questions on forums , few recommend Amazon instead of VPS.
So i want to know is having Amazon EC2 or S3 is exact replacement of VPS. i ...
2
votes
0answers
84 views
Can I prevent Jungle Disk's “Compressing Backup Database” process from spiking my CPU?
Every time my scheduled backup runs, it spikes my CPU usage up to 100%, literally freezing everything else I'm doing.
It is only during the 'Compressing Backup Database' part of the backup process ...
3
votes
2answers
120 views
Amazon S3 - To Backup or Not to Backup
So heres a question: Should I back up my data if I store using S3 (not RRS) or does S3 already handle a good enough multiple site data replication redundancy?
If backing up is desired, I'd like to ...
5
votes
2answers
326 views
Can I use rsync for backing up at Amazon S3
I have bought some space from evbackup which provides me FTP, rsync and SSH.
But I have also read that Amazon S3 can also be used to backups.
So I am really confused that do Amazon give FTP access ...
4
votes
1answer
240 views
A company wide dropbox like system on top of Amazon S3
Is there a system that will provide dropbox like features on top of Amazon s3?
It would be used company wide, mostly for documents, recordings, etc...
Some users work on Microsoft Windows, others on ...
0
votes
0answers
83 views
Amazon S3 LIST Requests
I have been using S3 throughout the day, loading files that I want to back up on there and using Cyberduck to do this. I am curious what a LIST request is considered and how to see what your usage is ...
4
votes
1answer
417 views
Uploading files to S3 account from linux command prompt
I've got several large files sitting in my linux hosted account that I need to upload to my S3 account. I dont want to download them first and then upload it into S3.
Is there any way I can "upload" ...
2
votes
1answer
180 views
Transfer file to Amazon S3 from web server
How do I transfer a tarball from my web server (e.g. http://example.com/backup.tar.gz) to an Amazon S3 bucket? Do I have to download it locally and upload it?
0
votes
0answers
123 views
EC2 Accessing S3 buckets fuse tool
It seems it's been a while since S3 has been available, but the tools to use it are still the same ones I saw several years ago (i.e. s3cmd and s3sync and s3fs).
I think the ones that use the REST ...
0
votes
1answer
314 views
Tortoise SVN on Amazon S3
I would like to setup a Tortoise SVN repository on my Amazon S3 server. I know how to do the setup on my local machine, and I know how to do it on a server (virtual or nonvirtual) running windows. I ...
2
votes
1answer
68 views
Zip Multiple Text Files from Multiple Directories into One ZIP File in One Command in Bash
I have an account on AWS and I use S3 for storing data. I have commands that will enable me to zip data files like so:
data.zip s3_dir/level-1/level-2/*/*/data.txt
But there are, say, 50 or more ...
2
votes
2answers
186 views
What desktop app can sync Amazon S3 with an FTP folder?
What I'm trying to do is migrate large files off my web site to S3.
0
votes
1answer
240 views
Mac OS X automatic backup: launchd + s3cmd = «Error: Can't find a config file»
I want to setup automatic backup on schedule from my mac to amazone s3. I'm using for this purpose launchd + s3cmd.
s3cmd is working fine in terminal.app. But launchd can't run s3cmd. I see in ...
3
votes
1answer
390 views
Use personal Amazon S3 account to backup Gmail using Ubuntu
As question, I have found online that backupify offer shifting from their S3 to user's personal S3, I have a backupify account but I can't find this options, besides, I don't prefer having my email ...
0
votes
0answers
51 views
Is it possible for emacs to load a buffer from a Amazon S3 bucket? [closed]
Is it possible for emacs to load a buffer from a Amazon S3 bucket? If so has somebody already built something that can do this?
1
vote
1answer
409 views
Using a script that uses Duplicity + S3 excluding large files
I'm trying to write an backup script that will exclude files over a certain size.
If i run the script duplicity gives an error. However if I copy and paste the same command generated by the script ...
0
votes
2answers
622 views
Auto-set permissions when uploading to Amazon S3 with Transmit 4 [closed]
Does anyone know how to auto-set the read permissions for "World" upon upload of a file to Amazon S3 with Transmit? It is currently a two step process in my workflow:
upload the file
change ...
0
votes
5answers
452 views
Setting up scripts in Amazon EC2 Cloud
I am currently running a few perl and python scripts on a windows pc and would like to port over to the Amazon EC2 servers running 64-bit LINUX. The scripts are basic web scrapers that go to a ...
3
votes
1answer
2k views
Encryption strategy for Amazon S3?
I'm running Windows and strongly considering using Amazon S3 to back up some of my more important data, but i'm having trouble coming up with a good encryption strategy. I'm a fan of Truecypt and use ...
2
votes
1answer
201 views
Backup software for Ubuntu - which one?
I have spent some time testing out different backup solutions for my small home office during the last weeks, but still haven't found anything that have been working out too well yet. We can ...
0
votes
1answer
221 views
Ubuntu: Backing up network files with duplicity?
I just installed Duplicity on Ubuntu and got everything working. However, when I try to backup a network samba-connected windows drive, The following occurs:
Backup source directory ...
0
votes
1answer
397 views
Any UK-based cloud solutions? [closed]
I'm looking for a cloud computing provider based in the UK. Can anyone recommend a suitable provider? Ideally with ssh access, fully configurable server, *nix preferable. (Essentially something like ...
2
votes
2answers
162 views
Is there the equivalent of cloud computing for modems?
I asked this question on SF, and someone recommended that I ask it on SO, and on SO, it was voted to be closed, and someone suggest that I post it here - (and so, the merry go round continues) - so ...
3
votes
2answers
614 views
Amazon S3/Cloudfront backup software for windows
Is there any (free?) backup solutions for Amazon Cloudfront / S3 out there that features scheduling in windows?
0
votes
1answer
119 views
What's your opinion in Amazon S3? [closed]
i searching for best online file storage and i found a lot with different features ... i feel that Amazon S3 is the best ...
Could any who try such a service give me his opinion on it and if is there ...
13
votes
4answers
9k views
Replacing Dropbox with: Amazon S3 + SSL + GPG/TrueCrypt + Mounting on OSX ??
So, right now we're using Dropbox to share various data files around between approximately 10 Mac OS X systems.
However, we already have an S3 account and everyone on the lowest Dropbox plan of ...
5
votes
2answers
469 views
What free method would you recommend for mounting an Amazon S3 bucket on OS X 10.6?
It seems s3fs is broken on Snow Leopard
( http://mark.aufflick.com/blog/2007/10/28/leopard-amazon-s3-network-storage )
Does anyone know of a free (and preferably open source) way to mount a bucket so ...
7
votes
6answers
4k views
Alternative to Amazon's S3 service? [closed]
Just wondering if there is good alternative to Amazon's S3 service? I like S3 but the bandwidth cost is high. I looked at CouldFiles from Rackspace but the cost is even higher.
I don't mind ...
4
votes
4answers
678 views
Can I rely on S3 to keep my data secure?
I want to back up sensitive personal data to S3 via an rsync-style interface. I'm currently using s3cmd - a great tool - but it doesn't yet support encrypted syncs. This means that while my data is ...
1
vote
2answers
130 views
All documents from S3 backup corrupted
Before I left for my trip I made a backup of all my important data to an Amazon S3 bucket. I also have a Citrix remote desktop to my disposal. Today I installed the citrix client and logged in to my ...
2
votes
1answer
561 views
Getting a Quicktime Movie to Stream Instead of Download
In the past, I've placed Quicktime movies on Amazon S3, and when a user loads the file's in Firefox (on OS X), the movie starts playing immediately, doing that pseudo streaming quicktime thing where ...
3
votes
1answer
453 views
Are whole VM images backed up on Amazon EC2/S3?
I've been trying to get my head around Amazon Web Services as a VPS provider. My understanding is a EC2 instance running Windows is basically a Windows VM, very similar to renting a VPS from a more ...
3
votes
2answers
899 views
4
votes
4answers
452 views
Cloud based backup solutions based on open standards?
I am looking for a solution to backup and consolidate important media from a couple Windows laptops and Mac laptop.
I would like a solutions that based on open standards, so my data isn't trapped by ...
2
votes
1answer
219 views
Amazon S3 bucket - download only certain files
I have an Amazon S3 bucket with 10,000 images sitting in it with a standard naming convention:
001_small.jpg
001_large.jpg
002_small.jpg
002_large.jpg
Since there is such a large amount of files I ...
1
vote
1answer
383 views
Limited access to Amazon S3 buckets
Is it possible to somehow limit the access to an Amazon S3 account. I don't really like the idea of distributing my secret access key to all of my applications, that want to access just a single ...
6
votes
3answers
4k views
A decent S3 bucket manager for Ubuntu
I'm looking for a decent S3 bucket manager for Ubuntu (Gnome). I prefer it to integrate with Nautilus so it will look like just any other drive (a la WebDAV) but so far I haven't been able to find ...
