Yes, It is possible to download the Bootcamp drivers outside of the Bootcamp tool:
Updated:
timothy-sutton's answer will make your life so much easier, go there first
For Windows 7 through 10, Apple have published a table of 'which download you need for which model' at https://support.apple.com/kb/HT5634. Win 7 download might work for Vista.
For WinXP, see robmathers' answer.
The hard way which follows here, taken from http://www.cafe-encounter.net/p682/download-bootcamp-drivers is your fallback if you want or need to work it from scratch.
source: http://www.cafe-encounter.net/p824/bootcamp-drivers-direct-download-of-bootcampesd-pkg . The page was aimed at people struggling with BootCamp, but either way, it gets you to the BootCamp.pkg file, which contains the drivers.
You still need open the OS X installer pkg file to get the the contents out, and to open a DMG file. If you are already in Windows, 7-zip will open it: http://www.cafe-encounter.net/p860/opening-a-bootcamp-driver-download-on-windows-7-or-8-with-7-zip
Apple just released the Bootcamp 6 for Windows 10.
Check in this article if your Model qualifies and how to do it.
You can install the original Bootcamp drivers - Download and install Windows support software on your Mac - Apple Support - and test.