Meh, this question is one year old, I'll give it a try nevertheless.
Slightly off topic, because I don't know how to do it in acroread, but you might want to try Apvlv:
"Apvlv is a PDF/DJVU/UMD Viewer Under Linux/WIN32 and its behaviour [is] like Vim."
If you're willing to leave acroread, this pdf-reader will give you lots of vim-love.
Apvlv is based on libpoppler (same back-end as evince and now also xpdf), so you might encounter the same display issues that you mentioned. But it certainly fires up more quickly than acroread, which is the slowest in the industry! Good luck.
Disclaimer: I once wrote a piece of documentation for this project.