If you do stty -a, you'll notice that Ctrl-D is bound to eof (end of file) for the terminal driver. You would have to unbind it using stty before the Bash binding would have any affect. I wouldn't recommend that you do that. It would be better to choose another keystroke. I use Alt-Shift-D for a similar purpose.