So the question is how am I supposed to uninstall or remove the files that has been installed after running the
make instal? (Specially when I stop it in the middle of the process by a "Ctrl+C" or something)
if the process was already copying compiled objects to other locations in your OS, you should try
See an annotated example of a makefile here, under 'A Simple Makefile' http://www.cs.utah.edu/dept/old/texinfo/make/make.html
If that answer is not sufficient, I recommend you post the makefile as part of your question.