Super User is a question and answer site for computer enthusiasts and power users. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

What I'm trying to do is migrate large files off my web site to S3.

share|improve this question
up vote 1 down vote accepted

Which OS?

I think SuperFlexible (multi-platform, free trial) can, but I am not entirely sure. If not, I cannot see why you cannot use your local storage as an intermediate point. You'd have to be running the client software on the FTP server machine anyway, wouldn't you?

share|improve this answer
It's working in the background right now and it's a dream. Thanks! SuperFlexibile is grabbing 35GB of files from my web site and transferring them to S3. – Andrew Warner Apr 18 '11 at 18:12
I didn't want to use my computer as an intermediate point because I didn't want to risk losing some files or wasting time. I wanted it to happen no data risk. – Andrew Warner Apr 18 '11 at 18:13

Panic's Transmit app can do it on the Mac.

You need to transfer files. Maybe to an FTP or SFTP server, or the cloud via Amazon S3, or using WebDAV. You maintain a website, do backups, or upload photos.

You need Transmit, a Mac OS X FTP client.

share|improve this answer
I needed a pc program because I was on a rackspace cloud server, but I've been using Transmit lately and you're 100% right. It syncs beautifully. I only wish it worked with rackpsace cloud drives, but it's great for s3! – Andrew Warner Jun 13 '11 at 4:32

You can also use CloudBerry Explorer hat allows to move data from SFTP/FTP to Amazon S3

share|improve this answer

You can alternatively try minio client aka 'mc'. Its written in Golang, available for Windows, Mac & Linux.

mc implements the following commands

  ls        List files and folders.
  mb        Make a bucket or folder.
  cat       Display contents of a file.
  pipe      Write contents of stdin to one or more targets. When no target is specified, it writes to stdout.
  share     Generate URL for sharing.
  cp        Copy one or more objects to a target.
  mirror    Mirror folders recursively from a single source to many destinations.
  diff      Compute differences between two folders.
  rm        Remove file or bucket [WARNING: Use with care].
  access    Manage bucket access permissions.
  session   Manage saved sessions of cp and mirror operations.
  config    Manage configuration file.
  update    Check for a new software update.
  version   Print version.

mc mirror command can sync your local directory to S3 bucket.

$ mc mirror localDir s3/RemoteBucket

Hope it helps.

share|improve this answer

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .