Amazon S3 (Simple Storage Service) is a web service which provides storage and various interfaces for accessing data stored there.
0
votes
0answers
38 views
How sync files with s3cmd to Amazon S3, check if sent and remove locally?
I'm trying to use Amazon S3 service to store logs from my applications.
Given /user/bin/s3cmd --help tells me what I need to know how send the files:
s3cmd --help
usage: s3cmd [options] COMMAND ...
2
votes
1answer
82 views
Why can't I connect to my Amazon S3 storage with two of my three clients?
I use Transmit, Cyberduck, and Espresso, all of which support connecting to Amazon S3. But for some reason, I can only connect to my S3 storage successfully in Transmit; Cyberduck and Espresso both ...
18
votes
6answers
14k views
Replacing Dropbox with: Amazon S3 + SSL + GPG/TrueCrypt + Mounting on OSX ??
So, right now we're using Dropbox to share various data files around between approximately 10 Mac OS X systems.
However, we already have an S3 account and everyone on the lowest Dropbox plan of ...
1
vote
2answers
127 views
Initiate restore of directory hierarchy in Glacier to S3?
Using software that runs under Linux, is there a way to initiate a restore from Glacier to S3 of an entire directory hierarchy? The files are transferred to Glacier using a S3 bucket lifecycle rule.
...
0
votes
0answers
47 views
run S3cmd with other user other than root
I am using S3cmd. To run commands in my cron script. cron Script is a PHP script.
The user running the cron is web11 and the s3cmd is configured using the root user.
so when i run s3cmd using ...
0
votes
0answers
73 views
Parallel upload of directory structure with small files to Amazon S3
How can I efficiently upload a big directory structure with many files to Amazon S3 from OSX? I would like to make parallel uploads.
0
votes
1answer
283 views
s3cmd: how to copy files from local to S3 bucket with existing structure
I'm trying to copy files with s3cmd to a bucket with an existing folder structure. Both structures already exist both on local dev machine and in the bucket.
The folders structure is as follows ...
0
votes
0answers
47 views
Steps to Map my Domain in AWS
I just bought an "on demand instance" in AWS, would like to know the steps to map my domain ( www.abc.com ) for my amazon instance to perform the name servers updates, etc ?
I got to know about Route ...
2
votes
1answer
201 views
Can I prevent Jungle Disk's “Compressing Backup Database” process from spiking my CPU?
Every time my scheduled backup runs, it spikes my CPU usage up to 100%, literally freezing everything else I'm doing.
It is only during the 'Compressing Backup Database' part of the backup process ...
1
vote
1answer
128 views
How to upload big files to S3 on a flaky connection?
I have a bunch of files (between 500MB and 7GB) that I need uploaded to an S3 bucket. My connection is very flaky.
I tried uploading a 500MB file via s3cmd but it timed out after it was 91% done ...
3
votes
3answers
2k views
1
vote
1answer
365 views
Would it be okay to use the Amazon S3 for personal use? [closed]
I understand that AWS is meant for corporate use, but I just thought about using the S3 for personal backups, and by using their calculator it seems like it would be quite cheap in comparison to other ...
0
votes
0answers
42 views
NetGear Router loses connection when uploading to Amazon S3
Does anyone have an idea why my internet connection disconnects everytime I try to upload something to Amazon S3 (Client or Web).
I tried to check the logs but no success, maybe someone else got some ...
2
votes
0answers
289 views
Automating backup of Amazon S3 data - Alternatives to Bucket Commander?
I need to back up an entire Amazon S3 110 GB bucket on an automatic basis, to a location only accessible to me. We do not store data physically, all our data is in the cloud, so what I am looking for ...
1
vote
1answer
289 views
Why is my iPad connecting to S3 and using lots of bandwidth? [closed]
I noticed my connection has been extremely slow lately at some random times. I figured someone in my house was torrenting, so I booted up tcpdump on the router. What I found out is that it appears ...
17
votes
2answers
8k views
Amazon Glacier clients [closed]
Do you know about any affordable client software to upload/retrieve archives from Amazon Glacier? A big plus would be the ability to migrate data from Amazon S3 to Amazon Glacier directly from the ...
1
vote
1answer
311 views
How can I download a copy of an S3 public data set?
i was naively assuming I could do something like
s3cmd sync s3://snap-d203feb5 /var/tmp/copy
but I seem to have the wrong idea of how to go about this. I cannot even get a simple thing to work;
...
4
votes
5answers
651 views
Cloud based backup solutions based on open standards?
I am looking for a solution to backup and consolidate important media from a couple Windows laptops and Mac laptop.
I would like a solutions that based on open standards, so my data isn't trapped by ...
1
vote
2answers
433 views
can i create a symlink from an ec2 disk to S3 bucket?
Is it possible to create a symlink from a file on the local disk of a windows machine in ec2 so that it is actually stored in an S3 bucket?
MSMQ wants to write our queue to a local disk and this ...
0
votes
1answer
314 views
I can't resolve s3 dns from time-to-time
I'm using the .net SDK to talk to S3, but too often I get the following exception:
The remote name could not be resolved: 's3.amazonaws.com'
I'm using the two standard OpenDNS DNS servers, and ...
6
votes
3answers
886 views
What free method would you recommend for mounting an Amazon S3 bucket on OS X 10.6?
It seems s3fs is broken on Snow Leopard
( http://mark.aufflick.com/blog/2007/10/28/leopard-amazon-s3-network-storage )
Does anyone know of a free (and preferably open source) way to mount a bucket so ...
0
votes
1answer
262 views
s3cmd tool falls over on local directory
I'm trying to use s3cmd to copy a full bucket down to my local machine like so:
s3cmd -c .s3cfg-bespoke sync s3://my_bucket/ ~/local_folder/
There are three folders and a smattering of files in the ...
2
votes
2answers
244 views
Need PC Software that does real-time syncing for files from a local desktop folder to an amazon S3 account?
I need pc software with a GUI that will allow me to sync a folder on my computer with a folder on my amazon s3 account. The syncing needs to be in real time. It should listen for changes and then sync ...
1
vote
0answers
47 views
Is there a way to automate XML playlist creation for files in an S3 bucket?
I'm working on an XML-based, non-Flash music player for a client. They want to be able to upload files to a bucket and stream MP3s back to their website.
I'm wondering if there's a way to ...
1
vote
1answer
203 views
Is it possible to transfer files from Amazon S3 directly to another web server? [closed]
I need to transfer some files from several Amazon S3 buckets to a different web server.
The amount of data is several gigs, so downloading and re-uploading is not favorable.
I have done some ...
0
votes
1answer
91 views
Methods of moving all of my local files into cloud storage [closed]
I have a large amount of data that I would like to move into cloud storage. Some of the files (~30 GB) are archived, but uncompressed, files (text, documents, images, videos, and other media). Other ...
1
vote
1answer
315 views
Can Git GPG program be used for s3cmd?
My ultimate goal is to be able to put files onto my Amazon EC2 server. After a month of failed attempts at getting SSH access to the server, I have decided to try s3cmd and eventually migrate files ...
3
votes
3answers
962 views
Amazon S3/Cloudfront backup software for windows
Is there any (free?) backup solutions for Amazon Cloudfront / S3 out there that features scheduling in windows?
1
vote
0answers
102 views
s3fs gives me an empty directory
I built s3fs, and now I'm getting an empty directory where I mounted the s3 bucket. I put a text file in the directory, and I can see it in there, and it transfers into the bucket. How can I see the ...
8
votes
3answers
4k views
Can I use rsync for backing up at Amazon S3
I have bought some space from evbackup which provides me FTP, rsync and SSH.
But I have also read that Amazon S3 can also be used to backups.
So I am really confused that do Amazon give FTP access ...
10
votes
4answers
7k views
A decent S3 bucket manager for Ubuntu
I'm looking for a decent S3 bucket manager for Ubuntu (Gnome). I prefer it to integrate with Nautilus so it will look like just any other drive (a la WebDAV) but so far I haven't been able to find ...
0
votes
0answers
162 views
Amazon s3 as backup and remote file access [closed]
Looking to use Amazon s3 as storage backup and remote file access.
What are any pitfalls I should be aware of?
Any comparisons between Cloudberry and Dragon Disk as a backup client?
And has anyone ...
0
votes
1answer
256 views
Environment Variables and Shell Rc File [duplicate]
Possible Duplicate:
What are PATH and other environment variables, and how can I set or use them?
I am trying to automatically establish a connection with Amazon s3 using keys. This ...
0
votes
1answer
1k views
Mount a S3 bucket on Linux without 3rd party tool?
Is there any way to mount a S3 bucket on the Linux filesystem without any 3rd party tools? Assuming I have a standard Ubuntu installation.
2
votes
1answer
2k views
Amazon S3 GUI Client For Mac OS X [closed]
I'm looking for a good GUI client for Amazon S3. On Windows I used Cloudberry Explorer and I would like to know if there's anything like that for Mac OS X.
1
vote
1answer
1k views
S3 based dropbox like program for mac os and windows
I use dropbox to sync file between several computers. It does the job quite well but it have several disadvantages:
Storing files on S3 is much cheaper (I need about 10Gb for all my shared files) ...
2
votes
2answers
522 views
What desktop app can sync Amazon S3 with an FTP folder?
What I'm trying to do is migrate large files off my web site to S3.
1
vote
1answer
143 views
Can I convert a Jungle Disk 2.0 bucket to a “compatible” bucket?
I have some data in a Jungle Disk 2.0 bucket on Amazon S3. It seems like the data in this bucket cannot be accessed via Amazon's own web interface to S3 - at least not very conveniently (the data is ...
3
votes
1answer
824 views
Use personal Amazon S3 account to backup Gmail using Ubuntu
As question, I have found online that backupify offer shifting from their S3 to user's personal S3, I have a backupify account but I can't find this options, besides, I don't prefer having my email ...
2
votes
1answer
584 views
Is having Linux VPS same as Amazon EC2 or S3 [closed]
I am new to Amazon services so have no idea, whenever i ask some questions on forums , few recommend Amazon instead of VPS.
So i want to know is having Amazon EC2 or S3 is exact replacement of VPS. i ...
2
votes
1answer
411 views
Transfer file to Amazon S3 from web server
How do I transfer a tarball from my web server (e.g. http://example.com/backup.tar.gz) to an Amazon S3 bucket? Do I have to download it locally and upload it?
0
votes
3answers
395 views
Upload very many files to S3
I have about 1 million images (organized in directories) that I need to get into S3. I started using s3sync.rb, but since it is built for syncing it creates tons of extra files for keeping track of ...
4
votes
1answer
153 views
Automatically Transcode Video and Upload to Cloud
I'm looking for a solution to take video files from my HD Camera and automate transcoding to a smaller format and then uploading to the cloud (AWS or otherwise).
The ideal workflow would be, I have a ...
4
votes
1answer
805 views
How to mount Amazon S3 bucket to a directory on FreeBSD?
I can't find a solution on how to mount an Amazon S3 bucket to an existing directory on FreeBSD.
I suspect, I need to install port fusefs-s3fs.
But how should I configure it? I can't find any info.
9
votes
6answers
7k views
Alternative to Amazon's S3 service? [closed]
Just wondering if there is good alternative to Amazon's S3 service? I like S3 but the bandwidth cost is high. I looked at CouldFiles from Rackspace but the cost is even higher.
I don't mind ...
0
votes
0answers
295 views
Duplicity & S3: “The write operation timed out”
I'm trying to set up an automated backup with duplicity on Amazon S3, but I keep getting a weird error that doesn't show up on Google searches.
machina:~# duplicity --version
duplicity 0.6.14
Here ...
2
votes
0answers
185 views
Subversion repository on Amazon S3
Is it possible to put a subversion repository on Amazon S3.
I found SvnToS3 on google code but that project seems dead.
1
vote
3answers
961 views
Real-Time Automated Amazon S3 Backup for Windows
I'm looking for a service I can configure in Windows 7 that will run in the background to monitor selected file system(s) for changes, and immediately push those changes in a lazy fashion to my Amazon ...
2
votes
1answer
349 views
Amazon S3 bucket - download only certain files
I have an Amazon S3 bucket with 10,000 images sitting in it with a standard naming convention:
001_small.jpg
001_large.jpg
002_small.jpg
002_large.jpg
Since there is such a large amount of files I ...
1
vote
2answers
308 views
Using S3 instead of FTP- any reason NOT to?
Whenever a client wants an FTP storage solution, my instinct it to direct them to S3 instead, as a secure and cost-effective alternative. Is there any good reason NOT to use S3 instead of FTP/SFTP in ...
