I would like to be able to (double) click a file from the ls output and open it with the associated program. Anyone knows a way to do this?
Mouse-console interaction is possible with GPM and links shows how it works.
The only think I could think of is if you write some sort of program using GPM and a simple programming language that can implement GPM. Then if you use this, you could replace the ls file in your binary folder (probably either /bin or /usr/bin) with this program (in compiled form).
This is up to your terminal to handle.
Easy would be to let fully specified paths open with the WM default application.
Harder would be to let relative links understand their directory context (perhaps reading