Amazon S3 (Simple Storage Service) is a web service which provides storage and various interfaces for accessing data stored there.
0
votes
1answer
41 views
How sync files with s3cmd to Amazon S3, check if sent and remove locally?
I'm trying to use Amazon S3 service to store logs from my applications.
Given /user/bin/s3cmd --help tells me what I need to know how send the files:
s3cmd --help
usage: s3cmd [options] COMMAND ...
0
votes
0answers
47 views
run S3cmd with other user other than root
I am using S3cmd. To run commands in my cron script. cron Script is a PHP script.
The user running the cron is web11 and the s3cmd is configured using the root user.
so when i run s3cmd using ...
0
votes
0answers
73 views
Parallel upload of directory structure with small files to Amazon S3
How can I efficiently upload a big directory structure with many files to Amazon S3 from OSX? I would like to make parallel uploads.
0
votes
0answers
47 views
Steps to Map my Domain in AWS
I just bought an "on demand instance" in AWS, would like to know the steps to map my domain ( www.abc.com ) for my amazon instance to perform the name servers updates, etc ?
I got to know about Route ...
1
vote
1answer
128 views
How to upload big files to S3 on a flaky connection?
I have a bunch of files (between 500MB and 7GB) that I need uploaded to an S3 bucket. My connection is very flaky.
I tried uploading a 500MB file via s3cmd but it timed out after it was 91% done ...
1
vote
2answers
127 views
Initiate restore of directory hierarchy in Glacier to S3?
Using software that runs under Linux, is there a way to initiate a restore from Glacier to S3 of an entire directory hierarchy? The files are transferred to Glacier using a S3 bucket lifecycle rule.
...
2
votes
1answer
82 views
Why can't I connect to my Amazon S3 storage with two of my three clients?
I use Transmit, Cyberduck, and Espresso, all of which support connecting to Amazon S3. But for some reason, I can only connect to my S3 storage successfully in Transmit; Cyberduck and Espresso both ...
1
vote
1answer
365 views
Would it be okay to use the Amazon S3 for personal use? [closed]
I understand that AWS is meant for corporate use, but I just thought about using the S3 for personal backups, and by using their calculator it seems like it would be quite cheap in comparison to other ...
0
votes
0answers
42 views
NetGear Router loses connection when uploading to Amazon S3
Does anyone have an idea why my internet connection disconnects everytime I try to upload something to Amazon S3 (Client or Web).
I tried to check the logs but no success, maybe someone else got some ...
2
votes
0answers
289 views
Automating backup of Amazon S3 data - Alternatives to Bucket Commander?
I need to back up an entire Amazon S3 110 GB bucket on an automatic basis, to a location only accessible to me. We do not store data physically, all our data is in the cloud, so what I am looking for ...
1
vote
1answer
289 views
Why is my iPad connecting to S3 and using lots of bandwidth? [closed]
I noticed my connection has been extremely slow lately at some random times. I figured someone in my house was torrenting, so I booted up tcpdump on the router. What I found out is that it appears ...
17
votes
2answers
8k views
Amazon Glacier clients [closed]
Do you know about any affordable client software to upload/retrieve archives from Amazon Glacier? A big plus would be the ability to migrate data from Amazon S3 to Amazon Glacier directly from the ...
1
vote
1answer
312 views
How can I download a copy of an S3 public data set?
i was naively assuming I could do something like
s3cmd sync s3://snap-d203feb5 /var/tmp/copy
but I seem to have the wrong idea of how to go about this. I cannot even get a simple thing to work;
...
1
vote
0answers
47 views
Is there a way to automate XML playlist creation for files in an S3 bucket?
I'm working on an XML-based, non-Flash music player for a client. They want to be able to upload files to a bucket and stream MP3s back to their website.
I'm wondering if there's a way to ...
1
vote
1answer
204 views
Is it possible to transfer files from Amazon S3 directly to another web server? [closed]
I need to transfer some files from several Amazon S3 buckets to a different web server.
The amount of data is several gigs, so downloading and re-uploading is not favorable.
I have done some ...
2
votes
2answers
244 views
Need PC Software that does real-time syncing for files from a local desktop folder to an amazon S3 account?
I need pc software with a GUI that will allow me to sync a folder on my computer with a folder on my amazon s3 account. The syncing needs to be in real time. It should listen for changes and then sync ...
0
votes
1answer
91 views
Methods of moving all of my local files into cloud storage [closed]
I have a large amount of data that I would like to move into cloud storage. Some of the files (~30 GB) are archived, but uncompressed, files (text, documents, images, videos, and other media). Other ...
0
votes
1answer
283 views
s3cmd: how to copy files from local to S3 bucket with existing structure
I'm trying to copy files with s3cmd to a bucket with an existing folder structure. Both structures already exist both on local dev machine and in the bucket.
The folders structure is as follows ...
1
vote
1answer
315 views
Can Git GPG program be used for s3cmd?
My ultimate goal is to be able to put files onto my Amazon EC2 server. After a month of failed attempts at getting SSH access to the server, I have decided to try s3cmd and eventually migrate files ...
1
vote
0answers
102 views
s3fs gives me an empty directory
I built s3fs, and now I'm getting an empty directory where I mounted the s3 bucket. I put a text file in the directory, and I can see it in there, and it transfers into the bucket. How can I see the ...
1
vote
2answers
433 views
can i create a symlink from an ec2 disk to S3 bucket?
Is it possible to create a symlink from a file on the local disk of a windows machine in ec2 so that it is actually stored in an S3 bucket?
MSMQ wants to write our queue to a local disk and this ...
0
votes
0answers
162 views
Amazon s3 as backup and remote file access [closed]
Looking to use Amazon s3 as storage backup and remote file access.
What are any pitfalls I should be aware of?
Any comparisons between Cloudberry and Dragon Disk as a backup client?
And has anyone ...
0
votes
1answer
256 views
Environment Variables and Shell Rc File [duplicate]
Possible Duplicate:
What are PATH and other environment variables, and how can I set or use them?
I am trying to automatically establish a connection with Amazon s3 using keys. This ...
0
votes
1answer
1k views
Mount a S3 bucket on Linux without 3rd party tool?
Is there any way to mount a S3 bucket on the Linux filesystem without any 3rd party tools? Assuming I have a standard Ubuntu installation.
2
votes
1answer
2k views
Amazon S3 GUI Client For Mac OS X [closed]
I'm looking for a good GUI client for Amazon S3. On Windows I used Cloudberry Explorer and I would like to know if there's anything like that for Mac OS X.
1
vote
1answer
1k views
S3 based dropbox like program for mac os and windows
I use dropbox to sync file between several computers. It does the job quite well but it have several disadvantages:
Storing files on S3 is much cheaper (I need about 10Gb for all my shared files) ...
1
vote
1answer
143 views
Can I convert a Jungle Disk 2.0 bucket to a “compatible” bucket?
I have some data in a Jungle Disk 2.0 bucket on Amazon S3. It seems like the data in this bucket cannot be accessed via Amazon's own web interface to S3 - at least not very conveniently (the data is ...
0
votes
3answers
395 views
Upload very many files to S3
I have about 1 million images (organized in directories) that I need to get into S3. I started using s3sync.rb, but since it is built for syncing it creates tons of extra files for keeping track of ...
0
votes
1answer
262 views
s3cmd tool falls over on local directory
I'm trying to use s3cmd to copy a full bucket down to my local machine like so:
s3cmd -c .s3cfg-bespoke sync s3://my_bucket/ ~/local_folder/
There are three folders and a smattering of files in the ...
2
votes
0answers
185 views
Subversion repository on Amazon S3
Is it possible to put a subversion repository on Amazon S3.
I found SvnToS3 on google code but that project seems dead.
0
votes
0answers
295 views
Duplicity & S3: “The write operation timed out”
I'm trying to set up an automated backup with duplicity on Amazon S3, but I keep getting a weird error that doesn't show up on Google searches.
machina:~# duplicity --version
duplicity 0.6.14
Here ...
1
vote
3answers
962 views
Real-Time Automated Amazon S3 Backup for Windows
I'm looking for a service I can configure in Windows 7 that will run in the background to monitor selected file system(s) for changes, and immediately push those changes in a lazy fashion to my Amazon ...
0
votes
1answer
317 views
I can't resolve s3 dns from time-to-time
I'm using the .net SDK to talk to S3, but too often I get the following exception:
The remote name could not be resolved: 's3.amazonaws.com'
I'm using the two standard OpenDNS DNS servers, and ...
4
votes
1answer
805 views
How to mount Amazon S3 bucket to a directory on FreeBSD?
I can't find a solution on how to mount an Amazon S3 bucket to an existing directory on FreeBSD.
I suspect, I need to install port fusefs-s3fs.
But how should I configure it? I can't find any info.
4
votes
1answer
153 views
Automatically Transcode Video and Upload to Cloud
I'm looking for a solution to take video files from my HD Camera and automate transcoding to a smaller format and then uploading to the cloud (AWS or otherwise).
The ideal workflow would be, I have a ...
1
vote
2answers
308 views
Using S3 instead of FTP- any reason NOT to?
Whenever a client wants an FTP storage solution, my instinct it to direct them to S3 instead, as a secure and cost-effective alternative. Is there any good reason NOT to use S3 instead of FTP/SFTP in ...
0
votes
3answers
100 views
How concerned do you think I need to be about the security and integrity of my Dropbox and Amazon S3 accounts? [closed]
What are the risks? Where are the vulnerabilities?
Is my Dropbox encrypted?
2
votes
1answer
584 views
Is having Linux VPS same as Amazon EC2 or S3 [closed]
I am new to Amazon services so have no idea, whenever i ask some questions on forums , few recommend Amazon instead of VPS.
So i want to know is having Amazon EC2 or S3 is exact replacement of VPS. i ...
2
votes
1answer
201 views
Can I prevent Jungle Disk's “Compressing Backup Database” process from spiking my CPU?
Every time my scheduled backup runs, it spikes my CPU usage up to 100%, literally freezing everything else I'm doing.
It is only during the 'Compressing Backup Database' part of the backup process ...
3
votes
2answers
293 views
Amazon S3 - To Backup or Not to Backup
So heres a question: Should I back up my data if I store using S3 (not RRS) or does S3 already handle a good enough multiple site data replication redundancy?
If backing up is desired, I'd like to ...
8
votes
3answers
4k views
Can I use rsync for backing up at Amazon S3
I have bought some space from evbackup which provides me FTP, rsync and SSH.
But I have also read that Amazon S3 can also be used to backups.
So I am really confused that do Amazon give FTP access ...
4
votes
1answer
458 views
A company wide dropbox like system on top of Amazon S3
Is there a system that will provide dropbox like features on top of Amazon s3?
It would be used company wide, mostly for documents, recordings, etc...
Some users work on Microsoft Windows, others on ...
15
votes
1answer
3k views
Uploading files to S3 account from linux command prompt
I've got several large files sitting in my linux hosted account that I need to upload to my S3 account. I dont want to download them first and then upload it into S3.
Is there any way I can "upload" ...
2
votes
1answer
413 views
Transfer file to Amazon S3 from web server
How do I transfer a tarball from my web server (e.g. http://example.com/backup.tar.gz) to an Amazon S3 bucket? Do I have to download it locally and upload it?
0
votes
1answer
969 views
Tortoise SVN on Amazon S3
I would like to setup a Tortoise SVN repository on my Amazon S3 server. I know how to do the setup on my local machine, and I know how to do it on a server (virtual or nonvirtual) running windows. I ...
2
votes
1answer
201 views
Zip Multiple Text Files from Multiple Directories into One ZIP File in One Command in Bash
I have an account on AWS and I use S3 for storing data. I have commands that will enable me to zip data files like so:
data.zip s3_dir/level-1/level-2/*/*/data.txt
But there are, say, 50 or more ...
2
votes
2answers
522 views
What desktop app can sync Amazon S3 with an FTP folder?
What I'm trying to do is migrate large files off my web site to S3.
0
votes
1answer
361 views
Mac OS X automatic backup: launchd + s3cmd = «Error: Can't find a config file»
I want to setup automatic backup on schedule from my mac to amazone s3. I'm using for this purpose launchd + s3cmd.
s3cmd is working fine in terminal.app. But launchd can't run s3cmd. I see in ...
3
votes
1answer
824 views
Use personal Amazon S3 account to backup Gmail using Ubuntu
As question, I have found online that backupify offer shifting from their S3 to user's personal S3, I have a backupify account but I can't find this options, besides, I don't prefer having my email ...
1
vote
1answer
823 views
Using a script that uses Duplicity + S3 excluding large files
I'm trying to write an backup script that will exclude files over a certain size.
If i run the script duplicity gives an error. However if I copy and paste the same command generated by the script ...
