Take the 2-minute tour ×
Super User is a question and answer site for computer enthusiasts and power users. It's 100% free, no registration required.

I'm looking for software that's designed to select/query data from a database (SQL or NoSQL), and export it into files (CSV, XML).

Ideal characteristics:

  • Manage very large datasets (petabytes), exporting large files (gigabytes)
  • Ability to manage/schedule exports
  • Scales across multiple databases + output servers (enterprise-y)
  • Simple to setup new exports (eg no coding required, but scripting support OK)
  • Something big, beefy and expensive OK

A BI (business intelligence) solution seems to fit the bill at first glance, but most are optimized for 1 - 3 page PDF reports or to power a web frontend. In my case, I'm looking for something that is optimized for large datasets.

share|improve this question
    
Import/export is a DBMS-specific task that most DBs support. I don't think anyone would take the time to write an application solely for exporting CSV data from a bunch of different database types. I'm guessing the closest thing you'd come to that is an ODBC library or database administration tool like MySQL Workbench or Navicat Premium that includes saving to CSV files. Some enterpriced data modelers (e.g. Erwin Data Modeler) also come with extensive DB management/versioning/syncing capabilities. But I don't know what you need in terms of scalability. –  Lèse majesté Apr 22 '12 at 5:22
1  
Personally, I'd just use a shell/php/python/ruby (or maybe capistrano recipe) script + whatever CSV export command your DBMS has. –  Lèse majesté Apr 22 '12 at 5:29
    
Generally, for an enterprise tool, you'll want the import/export tool to be separate from the scheduling/batch tool. This is because the security involved to access the DB is very often different from the security involved to access the file system or other running systems. –  surfasb Apr 22 '12 at 20:30

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.