IPB

Google Frontpage Forums Unattended CD/DVD Guide
 
Reply to this topicStart new topic
> Info about optimized ISO, some info for the newbie to cd images
prathapml
post Jan 24 2004, 12:55 PM
Post #1


Follow the rules please :-)
Group Icon

Group: Patrons
Posts: 7648
Joined: 14-November 03
From: Bangalore, India
Member No.: 9470
Country Flag


Seen one of those 1.5 GB CDs recently ?
Amazed ? Don't be. Those who do such things make "optimized" CD images (or ISO files). This article explains how they do it.


Basically, this is how an "optimized" ISO image of a CD works:

1. Any CD (or ISO image) has something called a TOC (the Table of Contents of the files on the CD).

2. All files are written to the CD and a corresponding entry to that file is made in the TOC (which tells your CD drive where to find that file).

3. Normally for any file or folder, there's one entry in the TOC. The exact file if put in another folder will acquire another entry in the TOC in addition to being written in the CD's "contents" area.

4. Look at the graphic in the attachment below. In it, assume the similar geometrical shapes to be identical files. Now, if the black circle was a file 100 MB in size, writing it to a CD in 3 separate places would cost you 300 MB. And, if each saffron square was 25 MB, 2 squares would have amounted to 50 MB. Let's say the irregular yellow shape is 200 MB. In total, this CD (of those shapes as files) would total up to 550 MB.

5. Somebody then got a brainwave and said, what if I just wrote the file once, and told the cd drive (through the TOC) that the same file is in X number of positions.
So now, the 550 MB CD above becomes just 325 MB (how ? each file is written just once, and additional occurrences of the same file is re-directed to point to the same location.

6. Thus, we see that the software making the ISO sees that there are repetitions of the same file many times in many folders, and encodes the file itself only once, but makes hard-link entries to that file in the TOC.

7. The result is that the user sees that there are 35,000 files occupying 6 GB (for example) on a CD, but due to optimization, only the 4,000 unique files are really written, the rest are all "virtual" links contained in the TOC of the CD, so the CD is actually just 630 MB (just for example, of course).



Please post any questions you have about this matter, or links to other places where "optimization" of a CD image is very useful (so that people can see where and how such ISO images are used).

Here are some links to good guides that make use of optimized cd images.
1. Making an MS-Office 2003 Pro Edition AIO (all-in-one) CD.
http://www.msfn.org/board/redirect.php?url=http%3A%2F%2Fwww.MSFN.org%2Fboard%2Findex.php%3F%26act%3DST%26f%3D70%26t%3D13943

Go here for a poll on the best CD-optimization tool.
Attached File(s)
Attached File  example1.GIF ( 2.35K ) Number of downloads: 20
 
Go to the top of the page
 
+Quote Post
Jono
post Jan 24 2004, 01:13 PM
Post #2


Member
**

Group: Members
Posts: 289
Joined: 27-September 03
Member No.: 7447
OS: none
Country Flag


old news cdimage has been being used by people on this board for over 6 months
Go to the top of the page
 
+Quote Post
prathapml
post Jan 24 2004, 01:27 PM
Post #3


Follow the rules please :-)
Group Icon

Group: Patrons
Posts: 7648
Joined: 14-November 03
From: Bangalore, India
Member No.: 9470
Country Flag


I kno....
I have also mentioned that that post would be a good starting point for newbies to understand optimized ISO9660 cd images.

You may have known it since a long time, but not everyone. And I bet not everyone uses UltraISO or knows it can be used to optimize CDs (it's easier to use than cdimage.exe and does lots more).
Go to the top of the page
 
+Quote Post
XtremeMaC
post Jan 24 2004, 05:00 PM
Post #4


MSFN SuperB
**********

Group: Members
Posts: 5542
Joined: 13-October 03
From: in front of the computer
Member No.: 8053
OS: Vista Ultimate x86
Country Flag


btw I cannot see the image??
Go to the top of the page
 
+Quote Post
prathapml
post Jan 24 2004, 11:32 PM
Post #5


Follow the rules please :-)
Group Icon

Group: Patrons
Posts: 7648
Joined: 14-November 03
From: Bangalore, India
Member No.: 9470
Country Flag


huh ???????
Image attachement added.
Go to the top of the page
 
+Quote Post
XtremeMaC
post Jan 25 2004, 01:00 AM
Post #6


MSFN SuperB
**********

Group: Members
Posts: 5542
Joined: 13-October 03
From: in front of the computer
Member No.: 8053
OS: Vista Ultimate x86
Country Flag


aa yea u added it after jan 24!!!!!!!!!!!!!!!!!!!!!!!!
Go to the top of the page
 
+Quote Post
LotusAstra
post Jan 25 2004, 09:37 AM
Post #7


Newbie


Group: Members
Posts: 18
Joined: 31-December 03
Member No.: 11764



The idea behind cdimage now seems so obvious (since i found out how to use it here about a month ago) that i'm quite surprised that the same technique isn't used more widely in other compression/burning programs, or even a standard feature of the file system on the hard drive... am i asking too much? biggrin.gif

'tis a cool program... unless there is some easier way, maybe i should start using cdimage for burning my incremental backups too, it would save me worrying about duplicate files and i could just burn the folders as they are...
Go to the top of the page
 
+Quote Post
prathapml
post Jan 25 2004, 09:59 AM
Post #8


Follow the rules please :-)
Group Icon

Group: Patrons
Posts: 7648
Joined: 14-November 03
From: Bangalore, India
Member No.: 9470
Country Flag


@LotusAstra :
Just something to note - as far as cdimage or UltraISO is concerned, 2 files are duplicate files only if their byte-size and time-stamp is the same.
So if your incremental backups contain files that are exactly the same size, and same contents, but different modification dates (can happen when simply printing one of those duplicate files in Word and Word resets the last modification date while exiting), those files won't be treated as identical/duplicate files.

This is exactly the reason that when making a winXP AIO CD, you can cut down the ISO file size by 74 MB when having the same drivers.cab in both, XP home and pro I386 folders (because, the XP home drivers.cab has a modification date later than Pro - but their contents are *exactly* the same - don't ask me how or why, I don't know). The other files in both the I386 folders are mostly of the same file-size and time-stamp.
Go to the top of the page
 
+Quote Post
Stealth870
post Jan 26 2004, 02:08 PM
Post #9


Junior
*

Group: Members
Posts: 52
Joined: 13-November 03
Member No.: 9424



Where on earth can I find CDImage??
Go to the top of the page
 
+Quote Post
mendipjohn
post Jan 26 2004, 02:12 PM
Post #10


Member
**

Group: Members
Posts: 144
Joined: 3-January 04
From: Somerset
Member No.: 11865
Country Flag


Here you go.

Note: you will have to modify the batch file - i changed the paths for my installation.
Attached File(s)
Attached File  CDImage_Pro.zip ( 49.94K ) Number of downloads: 652
 
Go to the top of the page
 
+Quote Post
LotusAstra
post Jan 26 2004, 02:33 PM
Post #11


Newbie


Group: Members
Posts: 18
Joined: 31-December 03
Member No.: 11764



appreciated mate, i did think that's how it worked, thx for the comfirmation... for my lazy backup methods it could be a useful tool for archiving some of my old stuff that i would otherwise delete... But anyway, i haven't tried it to much extent yet, so i'm not sure how useful it would be in the real world, long file names seem to cause concern too...

...i mainly mentioned it to see what other people thought, if anyone else used it for that, or if anyone strongly recommended that i don't use it for what i want smile.gif

Sorry, don't mean to drag your thread in another direction, just pondering any other uses for cdimage whistling.gif
Go to the top of the page
 
+Quote Post
prathapml
post Jan 26 2004, 02:58 PM
Post #12


Follow the rules please :-)
Group Icon

Group: Patrons
Posts: 7648
Joined: 14-November 03
From: Bangalore, India
Member No.: 9470
Country Flag


@Stealth870 -
....... LOL ........
Here on earth, as you saw.


@LotusAstra -
QUOTE
long file names seem to cause concern too...
Not really, look at the output of "cdimage.exe /?"
QUOTE
...i mainly mentioned it to see what other people thought, if anyone else used it for that, or if anyone strongly recommended that i don't use it for what i want
personally, I don't have ideas of using it for archival/backing-up anytime soon, but I don't see (any reason as to) why you can't/shouldn't use it for that purpose. It's a stable little program and gives very few reasons to frown (although, difficult to use until you know all the switches).


:clap clap:
ok class, as we were saying........
:gets back on topic:
Go to the top of the page
 
+Quote Post
LotusAstra
post Jan 26 2004, 04:17 PM
Post #13


Newbie


Group: Members
Posts: 18
Joined: 31-December 03
Member No.: 11764



OK, cool, took a look at that /? switch and very interesting... i'll keep what u say in mind and see what i can do in a bit... thx thumbup.gif
Go to the top of the page
 
+Quote Post
Vash-Kun
post Aug 16 2004, 06:07 PM
Post #14


Junior
*

Group: Members
Posts: 57
Joined: 3-July 04
Member No.: 23921



pardon my ignorance, but is this the same cdimage referenced in the guide, or is this a completely different application?
Go to the top of the page
 
+Quote Post
prathapml
post Aug 16 2004, 11:21 PM
Post #15


Follow the rules please :-)
Group Icon

Group: Patrons
Posts: 7648
Joined: 14-November 03
From: Bangalore, India
Member No.: 9470
Country Flag


The cdimage.exe referenced here is the same one referenced in the guide.
But wherever it says "CD-image" there you know that it refers to your ------.iso which you created.
Go to the top of the page
 
+Quote Post
Angelico_Payne
post Feb 4 2006, 04:13 AM
Post #16


Member
**

Group: Members
Posts: 151
Joined: 15-January 06
From: Federation
Member No.: 85326
OS: Vista Ultimate x86
Country Flag


So it would be prudent to backup data in an optimizied iso, and then compress it with an arhiver (like .rar or .7z or ** i heard there's even some with higer compression rate)?
Go to the top of the page
 
+Quote Post
teotwawki
post Feb 14 2006, 04:38 AM
Post #17





Group: Members
Posts: 5
Joined: 14-February 06
Member No.: 87947
Country Flag


QUOTE (LotusAstra @ Jan 25 2004, 03:37 PM) *
The idea behind cdimage now seems so obvious (since i found out how to use it here about a month ago) that i'm quite surprised that the same technique isn't used more widely in other compression/burning programs, or even a standard feature of the file system on the hard drive... am i asking too much? biggrin.gif


It's not really an "optimized CD" it's just a normal ISO standard CD which accurately reflects a disc filesystem with hard-links. Hard-linking is a standard feature of most file systems outside the Windows world. In fact, MS needed it to get their POSIX compliance, but their implementation is the "shortcut" which isn't even on a par with "symbolic links" as the underlying os/fs should make their use transparent to applications, where as Windows doesn't.

As Windows doesn't do hard-linking, it seems that some burning software can do the linking on-the-fly while it creates the ISO. However I read further in this thread that at least one of them only compares file size & date stamp. I wasn't aware of them when I created one of these CDs so I wrote a short script to do all the linking based on POSIX 1003.2 CRC checksums which is much safer.
Go to the top of the page
 
+Quote Post
Icttrack
post Dec 23 2007, 03:57 AM
Post #18





Group: Members
Posts: 5
Joined: 23-December 07
Member No.: 167816
OS: XP Pro x86
Country Flag


so that the reduction of size depends on the number of identical files. I wonder in original xp cd how many identical files it has. i had an integrated xp cd image but after applying some methods listed in forum, my image was still too big to write on cd. i had to buy a larger-capacity cd and thought of overburning it.
Go to the top of the page
 
+Quote Post
puntoMX
post Dec 23 2007, 01:59 PM
Post #19


MSFN Junkie
Group Icon

Group: Super Moderator
Posts: 3504
Joined: 28-June 04
From: Mexico
Member No.: 23618
OS: Vista Ultimate x64
Country Flag


The XP installation CD doesn’t have so much double files, especially when most files are packet in the CAB files. Did you try to use nLite?
Go to the top of the page
 
+Quote Post
Smiley357