So I have a custom build that I have to create for a specific project.
Details:
Host OS: Vista 64-bit Enterprise, only able to launch 2 VM's in VMPlayer. Hard drive partitioned, 40gb, 260gb.
VM 1 - XP Pro locked down so IE 7 is the only application that launches and the VM shuts down when it is closed (or crashes). 10gb virtual disk on c: partition.
VM 2- (for now) XP Pro, will be a full production and fully accessible OS (may do Vista at some point). runs on physical disk in 260gb partition.
Yes, I know there are other ways to do this but they want free. Not counting my time.
So Host OS and VM 1 are set up and everything is working as it should. Now we run into the snag. Trying to install XP to the physical disk from VMWare 6.5 you get and error that "operation on file "\\.\physicaldrive0" failed", So reading the documentation to make sure I've met all the requirements I find I forgot to remove the drive letter from that partition. Fine, done. Same error on the next attempt.
So I try full disk instead of a partition, thinking maybe it will let me select the second partition that way, no go, same error.
I beat Google up, down, left and right, and all I find are people having the same issue and a bunch of people doing it with Ubuntu as the host os. VMWare is just as helpful.
So I figured it out and for the next poor fool who tries this here is what you do. It is so simple it is not even funny. Ready for this?
Create the partition as a second primary partition (which I had done previously).
Now don't format it. (Simple right, heaven forbid they mention this in the VMWare docs)
Create your VM using the custom option, select "Use physical disk" on the "Select a Disk" config page, select your desired disk PhysicalDrive0 in my case, select "Use individual partitions", then select the desired partition, showed as FAT16 in VMware but it is actually RAW.
Now proceed on through as you normally would when creating a Virtual Machine.
Hope some one else finds this useful so my half a day wasted wasn't totally fruitless.