So I have this uge csv file with more than 100 million records and I want to work on. I don't want to just edit it.
What I need is to use some kind of excel / basic database transformations (group by, extract some caracters, add a new column based on combined info, etc.).
What is the best way to do this ? Import into a database ? (such as Oracle, quite sure Access cannot manage such big file) Are other tools usable ? At work I used to have a software called Amadea (http://www.isoft.fr/html/prod_amadea_en.htm) that did some data transformations like this. Don't know of any other (free) tools that does this the same way.
Thanks!