MSFN Forum: FAT16 vs FAT32 vs NTFS speed on USB stick - MSFN Forum

Jump to content



  • 2 Pages +
  • 1
  • 2
  • You cannot start a new topic
  • You cannot reply to this topic

FAT16 vs FAT32 vs NTFS speed on USB stick

#21 User is offline   cdob 

  • Friend of MSFN
  • PipPipPipPipPip
  • Group: Members
  • Posts: 757
  • Joined: 29-September 05

Posted 30 January 2009 - 01:25 PM

Windows 2000 and XP use different cache behaviour.
I guess that's the main difference. I don't have a full explanation.

Uwe describes some XP USB behaviour.
http://www.uwe-siebe...usbstick_e.html

A average USB stick at default settings:
FAT, FAT32: no write cache
NTFS: with write cache

A USB stick is often marked removable.
As knwon a factory tool can flip this setting, e.g. Lexar BootIT.
Or a filter driver can flip this setting. Cfadisk.sys can be integrated at textmode.
http://www.msfn.org/board/index.php?s=&...st&p=818429

Policy 'Optimize for quick removal' is stored in registry.
That's a hardware related setting:
[HKLM\SYSTEM\CurrentControlSet\Enum\USBSTOR\#specific HardwareID#\Device Parameters\Classpnp]
"UserRemovalPolicy"=dword:00000002
Setting can be integrated at migrate.inf or setupreg.hiv.

I wonder:
Does write cache enable a read cache too?

Given a USB stick and write cache active:
What's text mode copy time for FAT, FAT32 and NTFS?


View Postjaclaz, on Jan 30 2009, 04:44 AM, said:

Just for the record, MS released exFAT drivers for XP SP2 or SP3:

Well, how to build a bootable exFAT USB stick at XP?
Do you update mbrbatch.cmd and mkimg.cmd?

format /FS:exFAT creates 32kb cluster at a 2gb USB stick.
At first glance cache behaviour is not changed. Writing small files is slow, no write cache by default.


#22 User is offline   jaclaz 

  • The Finder
  • Group: Developers
  • Posts: 9,108
  • Joined: 23-July 04
  • OS:none specified
  • Country: Country Flag

Posted 30 January 2009 - 01:35 PM

View Postcdob, on Jan 30 2009, 08:25 PM, said:

Well, how to build a bootable exFAT USB stick at XP?
Do you update mbrbatch.cmd and mkimg.cmd?


I have no idea, don't even know if it will EVER be bootable.

I mean, exFAT support needs to be integrated in NTLDR/SETUPLDR.BIN, otherwise there is no way for intial stages of booting, maybe it is possible to "enhance" current "advanced" method "Fake Signature"/"XP Kansas City Shuffle" to support using a "normal filesystem" kicker image and switch during the shuffle the filesystem?

But anyway we'll need to wait for exFAT32 support in grub4dos....

About updating the batches, as soon as I find some time to do that, I hope I will be able to :), though if the above speculation is true there would be not much of a point, would it? :unsure:

jaclaz

#23 User is offline   ilko_t 

  • MSFN Expert
  • Group: Super Moderator
  • Posts: 1,458
  • Joined: 06-December 06
  • OS:none specified
  • Country: Country Flag

Posted 30 January 2009 - 02:15 PM

View Postcdob, on Jan 30 2009, 12:25 PM, said:

I wonder:
Does write cache enable a read cache too?
Maybe it's still all about the write cache? Setup attempts to delete the compressed files while expanding them to target directory. USB devices are write protected, but maybe those attempts for deletion are still speeded up by the enabled write-cache triggered by using NTFS:
http://www.uwe-siebe...usbstick_e.html

Quote

Obviously Windows XP doesn't enable a write cache for USB drives that appear as 'Removable'. The settings 'Optimize for quick removal' or 'Optimize for performance' doesn't seem to make any difference then, except that the latter enables the user to format 'Removable' USB drives with NTFS. But with NTFS Windows XP enables a write cache, writing small files becomes lightning fast.
Seems using NTFS triggers use of write cache even on removable drives.

Removing write-protection gives no speed difference in the tests above, write cache still matters.

Could this be the explanation?

A quick test using this approach (no deleted files during Text mode), may reveal if that's the case:
http://www.msfn.org/...howtopic=119742

I'll have no test rig around for some weeks, any taker?

This post has been edited by ilko_t: 30 January 2009 - 02:16 PM


#24 User is offline   cdob 

  • Friend of MSFN
  • PipPipPipPipPip
  • Group: Members
  • Posts: 757
  • Joined: 29-September 05

Posted 30 January 2009 - 04:51 PM

View Postjaclaz, on Jan 30 2009, 01:35 PM, said:

I mean, exFAT support needs to be integrated in NTLDR/SETUPLDR.BIN, otherwise there is no way for intial stages of booting
Yes, that's true.

View Postjaclaz, on Jan 30 2009, 01:35 PM, said:

maybe it is possible to "enhance" current "advanced" method "Fake Signature"/"XP Kansas City Shuffle" to support using a "normal filesystem" kicker image and switch during the shuffle the filesystem?
Yes, that's possible. I'm chainbooting exFAT at XP already. Did worked at first trial.
BTW: chainboot works at Windows 2000 and XP64 too, should work at all ntldr or setupldr.bin. Most likely at bootmgr too.

View Postjaclaz, on Jan 30 2009, 01:35 PM, said:

But anyway we'll need to wait for exFAT32 support in grub4dos....
Yes, current grub4dos at MBR: dosn't find grldr at exFAT.

@ilko_t
Yes, write cache maybe the main difference.

As for SetupSourceDevice harddisk:
I dislike this because BIOS may change harddisk number. That's not a universal solution.
Maybe use new grub4dos write: boot grub4dos, write txtsetup.sif, set SetupSourceDevice harddisk

#25 User is offline   ilko_t 

  • MSFN Expert
  • Group: Super Moderator
  • Posts: 1,458
  • Joined: 06-December 06
  • OS:none specified
  • Country: Country Flag

Posted 31 January 2009 - 02:06 AM

View Postcdob, on Jan 30 2009, 03:51 PM, said:

@ilko_t
Yes, write cache maybe the main difference.

As for SetupSourceDevice harddisk:
I dislike this because BIOS may change harddisk number. That's not a universal solution.
Maybe use new grub4dos write: boot grub4dos, write txtsetup.sif, set SetupSourceDevice harddisk
Yep, not universal, but should do the trick just to reveal if the write cache makes the difference, since there are no write attempts when using it.

As for the grub4dos write- I doubt, grub4dos uses BIOS disk numbering, boot disk is hd0. At partition screen the same disk is harddisk1, internal one is harddisk0, even though it's not the first in BIOS boot order.
The only semi-logical explanation I found was that disks numbering is in alphabetical order, as per driver name. I.e. disks on ATAPI.SYS get the first numbers, then on DISK.SYS, then SIL3112.SYS for example. Drive letter assignment still depends on BIOS numbering, fixed/removable is taken into account.
Compare:
http://www.msfn.org/board/index.php?showto...st&p=705697
http://www.msfn.org/board/index.php?showto...st&p=647581
Posted Image

USB disks are at DISK.SYS. I tried to rename it to _isk.sys and amend txtsetup.sif accordingly. This failed, disk.sys is hardcoded and used in other drivers, I did not go further.

Thanks for your input, as always you trigger a little brainstorm.

#26 User is offline   BigDaddy 

  • Senior Member
  • PipPipPipPip
  • Group: Members
  • Posts: 532
  • Joined: 04-November 03

Posted 31 January 2009 - 04:30 AM

http://www.uwe-siebe...usbstick_e.html
this is what I have been looking for. So I can finally map my network share as D:.

#27 User is offline   jaclaz 

  • The Finder
  • Group: Developers
  • Posts: 9,108
  • Joined: 23-July 04
  • OS:none specified
  • Country: Country Flag

Posted 31 January 2009 - 07:14 AM

View Postilko_t, on Jan 31 2009, 09:06 AM, said:

USB disks are at DISK.SYS. I tried to rename it to _isk.sys and amend txtsetup.sif accordingly. This failed, disk.sys is hardcoded and used in other drivers, I did not go further.


Probably also setup.hiv and .inf files need to be amended...:unsure:

You can try renaming other drivers, i.e. ATAPI.SYS->ZTAPI.SYS, just for the sake of checking? :blink:

I don't think it will work, as an ATA/IDE drive will be both under ATAPI.SYS and DISK.SYS.....:(

jaclaz

#28 User is offline   coords 

  • Group: Members
  • Posts: 5
  • Joined: 23-June 05

Posted 12 February 2009 - 06:02 AM

Just thought that I'd mention that M$ has now made exFAT32 available for WinXP. It can be downloaded here -> http://support.microsoft.com/kb/955704

#29 User is offline   BigDaddy 

  • Senior Member
  • PipPipPipPip
  • Group: Members
  • Posts: 532
  • Joined: 04-November 03

Posted 12 February 2009 - 10:57 AM

as long as this update will not be automatically delivered through WU the majority of WinXP users will not have support for exFAT and thus my USB drive becomes much less portable if exFAT is used.

This post has been edited by BigDaddy: 12 February 2009 - 10:57 AM


#30 User is offline   pointertovoid 

  • Advanced Member
  • PipPipPip
  • Group: Members
  • Posts: 355
  • Joined: 16-January 09

Posted 19 February 2009 - 07:43 AM

The answer to the speed issue on Usb sticks between W2k, Xp, Fat, Ntfs seems well explained here:
http://www.uwe-siebe...usbstick_e.html under "Cache or not"

[EDIT: oops, sorry, already mentioned in a post above]

The whole site is very interesting:
http://www.uwe-sieber.de/english.html

This post has been edited by pointertovoid: 19 February 2009 - 07:44 AM


#31 User is offline   jaclaz 

  • The Finder
  • Group: Developers
  • Posts: 9,108
  • Joined: 23-July 04
  • OS:none specified
  • Country: Country Flag

Posted 18 March 2009 - 01:31 AM

Just for the record, a comparison test with different filesystems on different sticks:
http://www.testfreaks.com/blog/information...-ntfs-vs-exfat/

Is it possible that Vista has re-added some speed to FAT32? :unsure:

jaclaz

Share this topic:


  • 2 Pages +
  • 1
  • 2
  • You cannot start a new topic
  • You cannot reply to this topic

1 User(s) are reading this topic
0 members, 1 guests, 0 anonymous users



All trademarks mentioned on this page are the property of their respective owners
Copyright © 2001 - 2011 msfn.org
Privacy Policy