There is the midnight-commander which uses a ncurses library, to show some sort of windows in text style. Some people are annoyed from the style, but those, who aren't, are often impressed by its usefulness.
Working with the mouse isn't so much the idea of it, but for moving files: You normally have two windows, and select one for the source dir, one for the target dir - mark a bunch of files and make F6-> move, or F5->copy, F8->delete of the marked files.
You mark the files with ins or you hit + and get a small dialog, where you can specify some globbing, like *.pdf to select all pdf-files.
There are many settings, to make it suitable for your needs, preferences, how to act and what to display, and a lot of shortcuts.
And it is very fast. Open /usr/bin in mc (midnight-commander) and it is instantly there, showing you the content. Try this with any other filemanager: waiting... waiting ... waiting - at least for the first time, until the data is in the cache. For a second time, Thunar, Nautilus and all those things are pretty fast, but for the first time, with 1000 files, it takes half a minute to show the first one (parallel computation seems to be really hard).