Will an Ipod Touch let me download any file, that I can later transfer to another computer?

I currently live in the country without access to anything but dial-up (I've exhausted my options on alternatives, from mobile broadband to satellite). I am considering purchasing an iPod Touch for it's Wi-Fi capabilities for when I go to restaurants and stuff. I would like to know if the iPod is capable of downloading files that it is not capable of playing or understanding what to do with. For instance am I able to download an .exe file off a website to the iPod Touch's hard drive, even though the iPod Touch wouldn't know how to install it or what to do with it, so that I could transfer it to my home PC at a later time. The same thing for any file type (.bin, .rar, .mkv) that is direct download via HTTP. If so, this would be a major convenience over carrying a netbook or laptop everywhere. If so, does anybody happen to know what folder it is saved to?