Yeah, it definitely slows you down when it comes to the sheer number of pages you can get through in a given amount of time. But it speeds up your idea development and creativity, at least in my experience :)

Also, although it might sound like a chore to take notes while reading, I actually find it very pleasurable. It's like the difference between fast food and slow food. The latter gives you a satisfaction the first doesn't :)