keeleysam / instadmg Goto Github PK

What steps will reproduce the problem?
1. svn checkout http://instadmg.googlecode.com/svn/trunk instadmg
2. Mount Snow Leopard DVD
3. sudo ./instadmg/AddOns/InstaUp2Date/importDisk.py --automatic --legacy
4. sudo ./instadmg/AddOns/InstaUp2Date/instaUp2Date.py 10.6_vanilla --process

What is the expected output? What do you see instead?
I expected to "Collect a fully patched,“10.6.2 Vanilla.dmg”, in 
./instadmg/OutputFiles!" as suggested in "InstaDMG Guide 1.6b2"

Instead, I received an error message: "TypeError: cheksumFileObject() got an 
unexpected keyword argument 'reportProgress'"


What version of InstaDMG are you running? What revision number (this should
be the second line of your package log)?

Checked out revision 318.

What OS are you running on (booted from)?
Mac OSX 10.6.4

What OS are you installing?
Mac OSX 10.6.4

Please provide any additional information below.

To work around the problem I changed a line in instaUp2Date.py 

    checksum.cheksumFileObject(hashGenerator, readFile, fileName, expectedLength, copyToPath=targetFilePath, reportProgress=True, tabsToPrefix=1)

to 

    checksum.cheksumFileObject(hashGenerator, readFile, fileName, expectedLength, copyToPath=targetFilePath)

In fact, it complains about both reportProgress and tabsToPrefix.  When I 
removed reportProgress, it then failed on tabsToPrefix, so both must be removed.

I'll attach a copy of my terminal session so you can see exactly what I did.

What steps will reproduce the problem?
1. use isntadmg 1.4b4
2. ppc with leopard
3.

What is the expected output? What do you see instead?
dmg in output file folder.  no disc image with errors in log file

What version of the product are you using? On what operating system?
isntadmg 1.4b4.  leopard on ppc powermac g5

Please provide any additional information below.
I have tried this a couple of times and have gotten the same results.  I have 
attached the log files.

What steps will reproduce the problem?
1. Run instadmg.bash.
2. after it finishes, run it again on the same day (not too close to 
midnight...)
3.

What is the expected output? What do you see instead?
instadmg will try to create the second ASR output .DMG with the same name. 
haven't actually run 
this yet, so I don't know if it will overwrite the first .DMG or error out.

What version of the product are you using? On what operating system?
1.4b3, any

Please provide any additional information below.
This may not be an expected sequence of events, but it certainly could happen.

What steps will reproduce the problem?
1. I use instadmg_1.5rc1 on a Leopard 10.5.8 Host and used to link all the 
.dmg's and the pkg's from somewhere else
2. Using a linked createUser.pkg (Version 1.0.3) in CustomPKG/02/ I get the 
following errors in the logfile:

        installer[98680]: _installNextPackage of 1 
        installer[98680]: Failed to locate package at path (null) 
        installer[98680]: Install failed: Das Installationsprogramm konnte die für die Installation erforderliche Software nicht finden. Überprüfen Sie das Medium von dem 
Sie installieren möchten oder Ihre Internetverbindung und versuchen Sie es 
erneut oder wenden Sie sich an den Hersteller der Software. 
        installer: Package name is createUser 
        installer: Installing at base path /private/tmp/mount_folder.psphYo/mount_point.Plgq05 
        installer: Installation vorbereiten ..... 
        installer: The install failed (Das Installationsprogramm konnte die für die Installation erforderliche Software nicht finden. Überprüfen Sie das Medium von dem Sie 
installieren möchten oder Ihre Internetverbindung und versuchen Sie es erneut 
oder wenden Sie sich an den Hersteller der Software.) 
        Removing the copied folder: /private/tmp/mount_folder.psphYo/mount_point.Plgq05/private/tmp/package.xIyAXb
    Folder 02 done (15:49:27)


3. Coping the createUser.pkg direct to CustomPKG/02/ the installation works 
fine:

My 10.5.8 InstaDMG installatio works fine, all .dmg's and the pkg's are 
symbolic links ...
... it seems quite strange, that only createUser.pkg don't work as symbolic 
link.


I will try the same thing with the current developer version of createUser


Best regards
Ulli

What steps will reproduce the problem?
1. seutup instadmg rev 163 with 10.5 installer dvd on a non root volume like 
/Volumes/Leopard
2. run instadmg with the -t option directing the temp files to 
/Volumes/Leopard/tmp
3. Restore the result image to a mac

What is the expected output? What do you see instead?
The system will fail to boot giving error about not finding platform support 
files. The Image is 
unbootable. 

What version of the product are you using? On what operating system?
rev 163 svn os x 10.5.5 

Please provide any additional information below.
I have tested this a number of times and the -t option is the culprit. However 
I have not tested 
the -t option redirecting to a dir on the boot volume. 

What steps will reproduce the problem?

1. run 1.4b4 instadmg.bash

What is the expected output? What do you see instead?

A usable Tiger disk image.  A completely unusable Tiger disk image

What version of the product are you using? On what operating system?

1.4b4 on Tiger 10.4.11

Please provide any additional information below.

I'll attach logs.  What else would you guys like to see?

I have my test/build environments intact and I'm willing to test with Tiger/PPC 
specific revisions 
to instadmg.bash.

I'm also using InstaUp2Date, works fine on both PPC and x86 under Tiger (using 
MacPython for 
required libraries, etc.)

What steps will reproduce the problem?
1. 10.5.6 9G55 base install image
2. Add Java 2 update, Safari 3.2.1 and QuickTime 7.6
3. Add the iWork09.mpkg to the build

What is the expected output?

That the iWork 09' apps launch and function normally

What do you see instead?

The iWork 09' apps fail to launch.  Upon launching a dialog is put up that 
reads "Files that iWork 
needs are missing.  To restore missing files, use the iWork Installer to 
reinstall iWork".  After 
dismissing the dialog the app quits.

What version of the product are you using? On what operating system?

Product version: iWork 09'
OS version: 10.5.6 Build: 9G55

What steps will reproduce the problem?
Feature request, n/a

What is the expected output? What do you see instead?
The output should allow the administrator running instaUp2Date.py to specify 
the name for the 
output InstaDMG disk image when using the --process option. An output filename 
specified at 
the command line in this manner should override the disk image filename 
specified in the 
selected catalog file. This would allow the administrator to create the 
filename dynamically, such 
as the following (assuming the use of a separate naming script called 
“namegen”):

$ sudo ./instaUp2Date.py 10.5_vanilla.catalog --output-file `namegen -t vanilla 
-u -x dmg` --
process

Or a more static example:

$ sudo ./instaUp2Date.py 10.6_vanilla.catalog --output-file macosx-workstation-
snowleopard-10.6.3-10D573-i386-`mktemp -u XXXX`-`date +%Y%m%d`.dmg --process

The ability to dynamically name the output disk image could allow for richer, 
non-overlapping 
names for InstaDMG images created with InstaUp2Date.


What version of InstaDMG are you running? What revision number (this should
be the second line of your package log)?

InstaDMG 1.6b2 (sv revision: 261)
with InstaUp2Date.py

What OS are you running on (booted from)?

Mac OS X 10.6.3

What OS are you installing?

Mac OS X 10.6.3
Mac OS X 10.5.8
Mac OS X 10.4.11

Please provide any additional information below.

What steps will reproduce the problem?
1. reading instadmg.bash

What is the expected output? 
comment for SERVER_INSTALL should say:
 # Are we installing Mac OS X server. This defaults to 0 for no.

What do you see instead?
 # Are we installing Mac OS X . This defaults to 0 for no.
Note the space instead of the word server before the period in the first 
sentence.

What version of the product are you using? On what operating system?
instadmg 1.4b3 on any OS

Please provide any additional information below.

 I'm assuming that at some point even trivial stuff like this will be while...

It would be ideal to provide the resulting .dmg file name and the volume name 
as arguments to the 
instadmg script. 

What is the expected output? What do you see instead?

dmg based files work just fine it seems (at least http created dmg files or 
cached dmg files) but 
pkg / mpkg files fail.  

What version of InstaDMG are you running? What revision number (this should
be the second line of your package log)?
rev295

What OS are you running on (booted from)?
10.6.3

What OS are you installing?
10.6.3

Please provide any additional information below.

What steps will reproduce the problem?
1. Load latest Apple Updates: specifically the iTunes 9.0.1 update
2. use 1.5rc1 to build in chroot

What is the expected output? What do you see instead?
The AppleMobileDeviceSupport.pkg portion of the new iTunes installer does not 
complete the postinstall script which installs the 
"_usbmuxd" user. This results in the finished system's console being flooded 
with the following errors:

Sep 28 13:45:55 myhost com.apple.launchd[1] (com.apple.usbmuxd[449]): 
getpwnam("_usbmuxd") failed
Sep 28 13:45:55 myhost com.apple.launchd[1] (com.apple.usbmuxd[449]): Exited 
with exit code: 1
Sep 28 13:45:55 myhost com.apple.launchd[1] (com.apple.usbmuxd): Throttling 
respawn: Will start in 10 seconds

What version of the product are you using? On what operating system?
1.5rc1 + 10.5.8 to perform the builds in chroot env.
Building 10.5.8 with a 10.5.6 retail disk.

Please provide any additional information below.
It looks as thought the postinstall script for this portion of the package 
fails. Found some further info on the AFP548 site (other users 
with the same problem).
http://www.afp548.com/forum/print.php?id=25053
There was speculation that the command which supplies a password to the user 
("*") is actually globbing the working directory 
instead.

What steps will reproduce the problem?
1. Create an image using InstaUp2Date. My catalog has 43 packages that are
installed
2. Mount the generated image with hdituil attach image.dmg -mountrandom
/tmp -readonly -nobrowse -noautoopen -owners on
3. Look in the mounted image's /tmp. See some root owned directory trees
that seem to be remnants from installers - here's an example tree dump

[jpb@logrus:/home/jpb/jpb-ops/ops/mac/instadmg]$ sudo du -a
/tmp/dmg.zSk7kU/private/tmp/
Password:
8   /tmp/dmg.zSk7kU/private/tmp//emacs.vev7u8/etc/DOC
4184    /tmp/dmg.zSk7kU/private/tmp//emacs.vev7u8/etc/DOC-22.1.1
8   /tmp/dmg.zSk7kU/private/tmp//emacs.vev7u8/etc/GNU
4200    /tmp/dmg.zSk7kU/private/tmp//emacs.vev7u8/etc
0   /tmp/dmg.zSk7kU/private/tmp//emacs.vev7u8/lib-src
8   /tmp/dmg.zSk7kU/private/tmp//emacs.vev7u8/src/buildobj.lst
25536   /tmp/dmg.zSk7kU/private/tmp//emacs.vev7u8/src/emacs
5000    /tmp/dmg.zSk7kU/private/tmp//emacs.vev7u8/src/temacs
30544   /tmp/dmg.zSk7kU/private/tmp//emacs.vev7u8/src
34744   /tmp/dmg.zSk7kU/private/tmp//emacs.vev7u8
8   /tmp/dmg.zSk7kU/private/tmp//runChrooted.ct1Lqz/buildKeychains
80  /tmp/dmg.zSk7kU/private/tmp//runChrooted.ct1Lqz/ipv6PrefsUpdate
8   /tmp/dmg.zSk7kU/private/tmp//runChrooted.ct1Lqz/startSSH
96  /tmp/dmg.zSk7kU/private/tmp//runChrooted.ct1Lqz
8   /tmp/dmg.zSk7kU/private/tmp//scripts.GbxA/__Installer_Script_Springboard__
8   /tmp/dmg.zSk7kU/private/tmp//scripts.GbxA/postinstall
8
/tmp/dmg.zSk7kU/private/tmp//scripts.GbxA/postinstall_actions/configurePostfix
8   /tmp/dmg.zSk7kU/private/tmp//scripts.GbxA/postinstall_actions
8   /tmp/dmg.zSk7kU/private/tmp//scripts.GbxA/preinstall
0   /tmp/dmg.zSk7kU/private/tmp//scripts.GbxA/preinstall_actions
0   /tmp/dmg.zSk7kU/private/tmp//scripts.GbxA/Tools
32  /tmp/dmg.zSk7kU/private/tmp//scripts.GbxA
8   /tmp/dmg.zSk7kU/private/tmp//scripts.igTk/__Installer_Script_Springboard__
8   /tmp/dmg.zSk7kU/private/tmp//scripts.igTk/postinstall
0   /tmp/dmg.zSk7kU/private/tmp//scripts.igTk/postinstall_actions
8   /tmp/dmg.zSk7kU/private/tmp//scripts.igTk/preinstall
8
/tmp/dmg.zSk7kU/private/tmp//scripts.igTk/preinstall_actions/disableReportCrash
8   /tmp/dmg.zSk7kU/private/tmp//scripts.igTk/preinstall_actions
8   /tmp/dmg.zSk7kU/private/tmp//scripts.igTk/removeOldSyncClient
0   /tmp/dmg.zSk7kU/private/tmp//scripts.igTk/Tools
40  /tmp/dmg.zSk7kU/private/tmp//scripts.igTk
8   /tmp/dmg.zSk7kU/private/tmp//scripts.RuzM/__Installer_Script_Springboard__
8   /tmp/dmg.zSk7kU/private/tmp//scripts.RuzM/preinstall
0   /tmp/dmg.zSk7kU/private/tmp//scripts.RuzM/Tools
16  /tmp/dmg.zSk7kU/private/tmp//scripts.RuzM
8   /tmp/dmg.zSk7kU/private/tmp//scripts.z3DN/__Installer_Script_Springboard__
8   /tmp/dmg.zSk7kU/private/tmp//scripts.z3DN/postinstall
8
/tmp/dmg.zSk7kU/private/tmp//scripts.z3DN/postinstall_actions/servicesfix_post
8   /tmp/dmg.zSk7kU/private/tmp//scripts.z3DN/postinstall_actions
8   /tmp/dmg.zSk7kU/private/tmp//scripts.z3DN/preinstall
8   /tmp/dmg.zSk7kU/private/tmp//scripts.z3DN/preinstall_actions/servicesfix_pre
8   /tmp/dmg.zSk7kU/private/tmp//scripts.z3DN/preinstall_actions
152 /tmp/dmg.zSk7kU/private/tmp//scripts.z3DN/Tools/PlistBuddy
152 /tmp/dmg.zSk7kU/private/tmp//scripts.z3DN/Tools
192 /tmp/dmg.zSk7kU/private/tmp//scripts.z3DN
35120   /tmp/dmg.zSk7kU/private/tmp/
[jpb@logrus:/home/jpb/jpb-ops/ops/mac/instadmg]$

What is the expected output? What do you see instead?
I expected to find nothing there. I wouldn't have noticed it except that my
unit test puked on /tmp when checking for directories that should be empty.


What version of the product are you using? On what operating system?
1.4b4 on 10.5.6.

Please provide any additional information below.

Fix by adding

/bin/rm -vRf "$CURRENT_IMAGE_MOUNT/private/tmp/*" | (while read INPUT; do
log "$INPUT " detail; done)

at the end of the clean_up_image() function

What steps will reproduce the problem?
1. build tiger image on PPC hardware
2. killall iTunesHelper
3. attempt to unmount built image fails

What is the expected output? What do you see instead?

Expect image to unmount.  Finder states disk is in use.

What version of the product are you using? On what operating system?

1.4b1, Tiger 10.4.11

Please provide any additional information below.

FYI: from what I can tell, the following are the new updates for the 
vanilla.catalog:


    iTunes81    http://appldnld.apple.com.edgesuite.net/content.info.apple.com/iTunes8/061-
5641.20090311.Cfe4r/iTunes81.dmg    sha1:6c9ee64741158c9f45417b965b38b01ea3b51af1

    FrontRowUpdate2.1.7 
http://supportdownload.apple.com/download.info.apple.com/Apple_Support_Area/Appl
e_Software
_Updates/Mac_OS_X/downloads/061-5989.20090311.Foy67/FrontRowUpdate2.1.7.dmg 
sha1:f25aaf2dd305c264ea3cca76b374fca1e7157303

Sorry, will fill in the rest tomorrow.....
What steps will reproduce the problem?
1.
2.
3.

What is the expected output? What do you see instead?
Checksumming Safari4.0.4SnowLeopard.dmg (30022787 bytes) in chunks of 5242880 
bytes: 0%  
17%  34%  52%  69%  87%  100%
File:   Safari 4.0.4 for SnowLeopard 
    Status:             Verified 
    Source:             Downloaded from Archive 
    Archive:
        Type:           dmg
        Location:       
http://appldnld.apple.com.edgesuite.net/content.info.apple.com/Safari4/061-
7514.20091116.VgrPf/Safari4.0.4SnowLeopard.dmg
        Checksum:       fb1755e32e9019e929474ef97ba4da219dee8b8f
        Checksum Type:      sha1
        Checksum Correct:   True 
    Package
        File Name:      Safari4.0.4SnowLeopard.dmg 
        Type:           dmg 
        Location:       
http://appldnld.apple.com.edgesuite.net/content.info.apple.com/Safari4/061-
7514.20091116.VgrPf/Safari4.0.4SnowLeopard.dmg 
        Checksum:       fb1755e32e9019e929474ef97ba4da219dee8b8f 
        Checksum Type:      sha1 
        Checksum Correct:   None 
        Cache Location:     Caches/InstaUp2DateCache/Safari4.0.4SnowLeopard.dmg
Traceback (most recent call last):
  File "./instadmg/AddOns/InstaUp2Date/instaUp2Date.py", line 882, in <module>
    main()
  File "./instadmg/AddOns/InstaUp2Date/instaUp2Date.py", line 872, in main
    thisController.parseFile(inputFilePath, topLevel=True)
  File "./instadmg/AddOns/InstaUp2Date/instaUp2Date.py", line 234, in parseFile
    raise Exception('Error in config file: %s line number: %i\n%s' % (fileLocation, lineNumber, line)) # 
TODO: improve error handling
Exception: Error in config file: 
AddOns/InstaUp2Date/CatalogFiles/10.6_vanilla.catalog line 
number: 19
    Digital Camera Raw Compatibility Update 3.0 
http://support.apple.com/downloads/DL1001/en_US/RAWCameraUpdate3.dmsha1:99f04352
59
94dc91204204150a865f52e6707204


What version of InstaDMG are you running? What revision number (this should
be the second line of your package log)?


What OS are you running on (booted from)?


What OS are you installing?


Please provide any additional information below.

What steps will reproduce the problem?
1. Setup a clean build train with instadmg v211
2.add itunes 8.2.1 .pkg
3.restore result image and view console errors

What is the expected output? What do you see instead?
we expect the post install script to run properly. The postinstall script fails 
to create the _usbmux user. 

What version of the product are you using? On what operating system?
building on 10.5.8 and building 10.5.8 images.

See this discussion for details.
http://www.afp548.com/forum/viewtopic.php?showtopic=25053

What steps will reproduce the problem?

Run InstaDMG with InstallerChoices.xml in BaseOS folder (documentation needs to 
be updated 
on that location change)


What is the expected output? What do you see instead?

In the log, the InstallerChoices.xml is found, but then is declared either 
missing or malformed. 
Turns out that while the existence check is looking in the BaseOS folder, the 
arg passed to 
installer is ./InstallerChoices.xml vs ./BaseOS/InstallerChoices.xml


What version of the product are you using? On what operating system?

InstaDMG 1.42b, Mac OS 10.5.4


Please provide any additional information below.

Confirmed that changing ./InstallerChoices.xml to ./BaseOS/InstallerChoices.xml 
does not log 
the missing or malformed InstallerChoices.xml

What steps will reproduce the problem?
1.
2.
3.

What do you see instead?

Looking for iTunes801.dmg in cache folder
Did not find iTunes801.dmg in archive
Downloading
http://appldnld.apple.com.edgesuite.net/content.info.apple.com/iTunes8/061-5553.
20081002.kjy65/iTunes801.dmg
Traceback (most recent call last):
  File "/Volumes/Data
1/InstaDMG_1.4b4/AddOns/InstaUp2Date/instaUp2Date.py", line 930, in <module>
    main()
  File "/Volumes/Data
1/InstaDMG_1.4b4/AddOns/InstaUp2Date/instaUp2Date.py", line 921, in main
    thisController.parseFile(inputFilePath, topLevel=True)
  File "/Volumes/Data
1/InstaDMG_1.4b4/AddOns/InstaUp2Date/instaUp2Date.py", line 221, in parseFile
    thisPackage = installerPackage( simpleLineMatch.group("prettyName"),
simpleLineMatch.group("archiveLocation"),
simpleLineMatch.group("archiveChecksum"),
simpleLineMatch.group("packageLocation"),
simpleLineMatch.group("packageChecksum") )
  File "/Volumes/Data
1/InstaDMG_1.4b4/AddOns/InstaUp2Date/instaUp2Date.py", line 546, in __init__
    if self.retrieveFromArchive():
  File "/Volumes/Data
1/InstaDMG_1.4b4/AddOns/InstaUp2Date/instaUp2Date.py", line 813, in
retrieveFromArchive
    if REMOTEFILE != None:
UnboundLocalError: local variable 'REMOTEFILE' referenced before assignment


What version of the product are you using? On what operating system?
instadmg1.4b4

Please provide any additional information below.
Using svn version of vanilla.catalog.  instaup2date choked when trying to
download itunes8.0.1 update (which doesn't seem to exist on Apple's site
anymore?).

What steps will reproduce the problem?
1. Run instaUp2Date with multiple catalogs using the "-a" option
2. e.g. instaUp2Date.py -a 10.6_vanilla -a mysubcatalog1 mymaincatalog


What version of InstaDMG are you running? What revision number (this should
be the second line of your package log)?
r320


What OS are you running on (booted from)?
10.6.4

What OS are you installing?
10.6.4

Please provide any additional information below.
It looks like one reference was missed during a code rearrangement, line 664 
reads

                                addOnCatalogFiles.append(instaUpToDate.getCatalogFullPath(thisCatalogFile, self.catalogFolders))

But should read

                                addOnCatalogFiles.append(instaUpToDate.getCatalogFullPath(thisCatalogFile, options.catalogFolders))

What steps will reproduce the problem?
1. Run instaUp2Date.py

What is the expected output? What do you see instead?
Expected:
Script runs and checksums catalog file entries.

Actual:
  File "./instaUp2Date.py", line 829
    except Exception as e:
                                     ^
SyntaxError: invalid syntax

What steps will reproduce the problem?
1. Create image with InstaDMG1.4b3 (BaseOS = 10.5.0 Retail DVD; BaseUpdate = 
10.5.4 
Combo,Quicktime75_Leopard, 
AirPortUtility_Leopard,iTunes7.7,JavaForMacOSX10.5Update,MobileMe,HewlettPackard
PrinterDriv
ers; Several Custom Packages as well.
2. Image machine with NetRestore using compiled ASR image.
3. Boot imaged machine

What is the expected output? What do you see instead?
Expected output would be machine boots without any problems or errors.  Output 
that is seen is, 
machine kernel panics upon boot.

What version of the product are you using? On what operating system?
Using 1.4b3 on Mac OS 10.5.4

Please provide any additional information below.
Kernel Panic error:
Unable to find driver for this platform \"ACPI"\.\N"@/SourceCache/xnu/xnu-
1228.5.20/iokit/Kernel/IOPlatformExpert.cpp:1407
.
.
.
Mac OS version:
Not yet set
.
.
Rebuilding image with exact same settings with InstaDMG 1.4b2 results in a 
working computer.

What steps will reproduce the problem?
1.
2.
3.

What is the expected output? What do you see instead?


What version of InstaDMG are you running? What revision number (this should
be the second line of your package log)?


What OS are you running on (booted from)?


What OS are you installing?


Please provide any additional information below.

Both of these now have Safari 5

[deleted issue]

What steps will reproduce the problem?
1. Used iLife '09 metapackage, bundled as a folder with an InstallerChoices.xml 
inside of a DMG, 
with previous version of instaUp2Date(270)
2. Successfully had the installation choices applied when passed to instaDMG 
3. used same DMG as part of different catalog file with InstaUp2Date 296

What is the expected output? What do you see instead?
expected:
Installing iLife '09.mpkg from 
../../Caches/InstaUp2DateCache/iLife-iPhotoOnly.dmg (01) with 
XML Choices file: InstallerChoices.xml
instead:
Installing iLife '09.mpkg from 05 iLife-iPhotoOnly

What steps will reproduce the problem?
1. Used iLife '09 metapackage, bundled as a folder with an InstallerChoices.xml 
inside of a DMG, 
with previous version of instaUp2Date(270)
2. Successfully had the installation choices applied when passed to instaDMG 
3. used same DMG as part of different catalog file with InstaUp2Date 296

What is the expected output? What do you see instead?
expected:
Installing iLife '09.mpkg from 
../../Caches/InstaUp2DateCache/iLife-iPhotoOnly.dmg (01) with 
XML Choices file: InstallerChoices.xml
instead:
Installing iLife '09.mpkg from 05 iLife-iPhotoOnly

Working to round down number of symptoms, will follow up

What steps will reproduce the problem?
1. Just run instadmg.

What is the expected output? What do you see instead?

Nothing ejects. Logfile just shows the diskutil help file.

It's not critical, but now you need to remember to eject it by hand and this 
will get in the way of 
automation.

I think I may have found out what is going on. The last 6 items in my catalog 
are MS Office, then the 5 updates. I have an installerchoices xml file for ms 
office. It appears in instadmg.bash (line 670) that the CHOICES_FILE variable 
is not cleared 
for each loop. I think the CHOICES_FILE variable needs to be cleared before the 
first if statement, or an else CHOICES_FILE='' need to be added in the first if 
statement.

I may be way off here, and if I am, I apologize. The code changes below do seem 
to solve the issue I am having.

I think I may have found out what is going on. The last 6 items in my catalog 
are MS Office, then the 5 updates. I have an installerchoices xml fil for ms 
office. It appears in instadmg.bash (line 670) that the CHOICES_FILE variable 
is not cleared for 
each loop. I think the CHOICES_FILE variable needs to be cleared before the 
first if statement, or and else CHOICES_FILE='' need to be added in the first 
if statement.

I may be way off here, and if I am, I apologize.

    for UPDATE_PKG in $(/usr/bin/find -L "$TARGET" -maxdepth 1 -iname '*pkg' | /usr/bin/awk 'tolower() ~ /\.(m)?pkg/ && !/\/\._/'); do
        if [ -e "$TARGET/InstallerChoices.xml" ]; then
            CHOICES_FILE="InstallerChoices.xml"
        # TODO: better handle multiple pkg's and InstallerChoice files named for the file they should handle
I added---> else
I added--->     CHOICES_FILE="" 
        fi

        if [ $OS_REV_MAJOR -le 4 ]; then
            CHOICES_FILE="" # 10.4 can not use them
        fi          

        TARGET_FILE_NAME=`/usr/bin/basename "$UPDATE_PKG"`
        INSTALLER_NUMBER_TEXT=""
        if [ "$ORIGINAL_TARGET" == "$TARGET" ]; then
            CONTAINER_PATH="$TARGET"
        else
            # probably a dmg installer
            CONTAINER_PATH=`/usr/bin/readlink "$ORIGINAL_TARGET"`
            INSTALLER_NUMBER_TEXT=`/usr/bin/basename "$ORIGINAL_TARGET"`
            INSTALLER_NUMBER_TEXT=" ($INSTALLER_NUMBER_TEXT)"
        fi

        if [ "$CHOICES_FILE" != "" ]; then
            log "Installing $TARGET_FILE_NAME from ${CONTAINER_PATH}${INSTALLER_NUMBER_TEXT} with XML Choices file: $CHOICES_FILE" information
            /usr/sbin/installer -verbose -applyChoiceChangesXML "$TARGET/$CHOICES_FILE" -pkg "$UPDATE_PKG" -target "$CURRENT_IMAGE_MOUNT" | (while read INPUT; do log "$INPUT " detail; done)
        else
            log "Installing $TARGET_FILE_NAME from ${CONTAINER_PATH}${INSTALLER_NUMBER_TEXT}" information
            /usr/sbin/installer -verbose -pkg "$UPDATE_PKG" -target "$CURRENT_IMAGE_MOUNT" | (while read INPUT; do log "$INPUT " detail; done)

What steps will reproduce the problem?
1. Run InstaUp2Date.py. Script will fail to find any file referenced in a
Catalog file to checksum it.


What is the expected output? What do you see instead?
Expected: Files should be checksummed and script should continue.

Output:
Looking for Mac OS X 10.6.3 v1.1 Combo Update
Traceback (most recent call last):
  File "./instaUp2Date.py", line 659, in <module>
    main()
  File "./instaUp2Date.py", line 642, in main
    thisController.parseFile(catalogFilePath)
  File "./instaUp2Date.py", line 200, in parseFile
    self.parseFile(
self.getCatalogFullPath(includeLineMatch.group("location")) )
  File "./instaUp2Date.py", line 224, in parseFile
    additionalCacheFolders = userSuppliedPKGFolderPath
  File "./instaUp2Date.py", line 406, in __init__
    cacheFilePath = self.checkCacheForItem(None, checksumType,
checksumValue, cacheFolders)
  File "./instaUp2Date.py", line 545, in checkCacheForItem
    if checksumValue == checksum.checksum(os.path.join(thisCacheFolder,
thisItemName), checksumType, tabsToPrefix=1)['checksum']:
  File "/Applications/instadmg/AddOns/InstaUp2Date/checksum.py", line 207,
in checksum
    readFile = open(thisTarget['sourceUrl'].path)
IOError: [Errno 2] No such file or directory:
'/../Caches/InstaUp2DateCache/MacOSXUpdCombo10.6.3v1.1
sha1-39d16279373906041a066f409b5f667e2bca77e2.dmg'

What version of InstaDMG are you running? What revision number (this should
be the second line of your package log)?
r281

What OS are you running on (booted from)?
10.6.3

What OS are you installing?
10.6

Please provide any additional information below.

Looks like bug is related to the path to the file that should be
checksummed. .dmg is appended to the sha1 checksum in error output:

 IOError: [Errno 2] No such file or directory:
'/../Caches/InstaUp2DateCache/MacOSXUpdCombo10.6.3v1.1
sha1-39d16279373906041a066f409b5f667e2bca77e2.dmg'

The updates checked in a bit ago for r272 included some changes to the
createUser.pkg.  Most are good, but one reverted to using the -array
command-line option instead of the updated (in r259) -array-add option when
dealing with adding the newly created user to the HiddenUsersList.  This
bug was reported in issue31 and fixed in r259.

What steps will reproduce the problem?
1. ./instadmg.bash -l ~/Desktop

What is the expected output?
Log files on the desktop.

What do you see instead?
Log files in ./Logs

What version of the product are you using? On what operating system?
svn 212, Mac OS X Server 10.5.8

Please provide any additional information below.
Quick and dirty patch attached below.

I know this may fall under the category of - well, duh!?

But I'm building 4-6 different types of images and syncing my external HDDs 
back against a RAID'd, 
networked, backed-up filesystem.

I always remove the BaseOS image from the BaseOS folder when I sync back to my 
imaging 
repository.

Because image building is a time consuming process,  it would just be nice to 
see an error or exit 
telling the operator  - hey dummy, you don't have an image file in the BaseOS 
folder.

Maybe I'm nuts.

What steps will reproduce the problem?
1. Using the vanilla.catalog, run InstaUp2Date
2. look in the CustomPKG folder
3.

What is the expected output? What do you see instead?
I expect to see two digit number, like 01, 02, 03, but I only see one digit 
numbers. The 
BaseUpdates are two digit, but not the CustomPKGs


What version of the product are you using? On what operating system?
InstaUp2Date version 0.4b (svn revision: 177)
Mac OS X 10.5.6


Please provide any additional information below.
nothing more to add. Ideally the customPKG number should be two digits, I would 
actually like 
three digits.

Thanks,

Allan

What steps will reproduce the problem?
1.
2.
3.

What is the expected output? What do you see instead?


What version of InstaDMG are you running? What revision number (this should
be the second line of your package log)?


What OS are you running on (booted from)?


What OS are you installing?


Please provide any additional information below.

Adds new safari for Leopard and Snow Leopard.  Adds Magic trackpad update for 
Snow Leopard.

What steps will reproduce the problem?
1. Download most current version of InstaDMG (1.6b2)
2.  Used 10.6 base image
3.  Dropped 10.6.2 combo package into build train
4.  Load Facter/Puppet packages from 
https://sites.google.com/a/explanatorygap.net/puppet/ (facter 1.5.7 and 
puppet 25.4) into build train.
5.  Loaded 3 more packages - an ARD metapackage to enable ARD with all 
users and create a specific ARD user, a Packagemaker package to install 
our puppet-calling script in /usr/bin, and another package to install and 
load a launchdaemon to call the puppet script in /usr/bin.
6.  Baked the image and deployed out to clients.  
7.  When clients loaded the image, the folder /usr/lib/ruby/site_ruby was a 
folder, and not a symlink to "../../../../../../../../../../Library/Ruby/Site" 
- 
which caused puppet and facter to fail.

What is the expected output? What do you see instead?
/usr/lib/ruby/site_ruby needs to symlink to the folder named above, and 
packages need to be installed respecting the symlinks.  I tried a regular 
Snow Leopard client with 10.6.2 installed, and then tried installing all of 
the above packages one by one - none of them screw up the symlink


What version of InstaDMG are you running? What revision number (this 
should
be the second line of your package log)?
1.6b2 revision 261

What OS are you running on (booted from)?
Created the DMG from a 10.6.2 machine

What OS are you installing?
DMG uses 10.6 and the 10.6.2 combo updater.


Please provide any additional information below.
This actually worked fine in 10.5 with InstaDMG 1.5 Revision 202.  I may 
try playing with that again (though I don't believe that revision likes 10.6).  
Feel free to email me for any clarification - [email protected] or Twitter - 
glarizza

What steps will reproduce the problem?
1. Instead placing full base disk image, put symlink in place to disk image
2. Run instadmg.bash

Get this:
###### Unable to find primary installer disk ######
line 464: MODIFIED_INSTALLD_PLIST_FOLDER: unbound variable

What is the expected output? What do you see instead?
Would be nice if I didn't have to create duplicates of my disk images...if I 
could use sylinks or aliases to files/disk images/packages...


What version of InstaDMG are you running? What revision number (this should
be the second line of your package log)?
InstaDMG version 1.6b2 (svn revision: 261)


What OS are you running on (booted from)?
10.6.4

What OS are you installing?
10.6.3 retail disk

Please provide any additional information below.

What steps will reproduce the problem?
1. Download InstaDMG 1.4b4.
2. Copy Mac OS X 10.5 installer DVD image into the InstallerFiles/BaseOS folder.
3. Run the InstaDMG script:
$ sudo ./instadmg.bash

What is the expected output? What do you see instead?

I expected the script to proceed. Instead, I got the following output, which 
persists whether I ran 
the script as ./instadmg.bash or specified it with an absolute path.

$ sudo ./instadmg.bash 
14:35:14 ######InstaDMG build initiated######
14:35:14 ######Mounting Mac OS X installer image######
    Mounting a support disk from ./InstallerFiles/BaseOS/./InstallerFiles/BaseOS/macosx-
workstation-leopard-9A581-install.dmg
    ERROR: the main install disk was not sucessfully mounted!

In trying to trace through the script to see where the problem lies, I thought 
it would be useful to 
supply the relevant output of `hdiutil info`:

$ hdiutil info
framework       : 195
driver          : 10.5v194
images          : 2
================================================
image-path      : 
/Users/useracct/Downloads/InstaDMG_1.4b4/InstallerFiles/BaseOS/macosx-
workstation-leopard-9A581-install.dmg
image-alias     : 
/Users/useracct/Downloads/InstaDMG_1.4b4/InstallerFiles/BaseOS/macosx-
workstation-leopard-9A581-install.dmg
shadow-path     : <none>
icon-path       : 
/System/Library/PrivateFrameworks/DiskImages.framework/Resources/CDiskImage.icns
image-type      : UDIF read-only compressed (zlib)
system-image    : false
blockcount      : 15734768
blocksize       : 512
writeable       : false
autodiskmount   : TRUE
removable       : TRUE
image-encrypted : false
mounting user   : root
mounting mode   : <unknown>
process ID      : 21571
/dev/disk1  Apple_partition_scheme  
/dev/disk1s1    Apple_partition_map 
/dev/disk1s2    Apple_Driver_ATAPI  
/dev/disk1s3    Apple_HFS   /Volumes/Mac OS X Install DVD

What version of the product are you using? On what operating system?

I am using InstaDMG 1.4b4 (downloaded on Oct 01, 2008) on Mac OS X Leopard 
v10.5.5 on a 
Mac Pro.

Please provide any additional information below.

InstaDMG 1.3b works as expected, but v1.4b4 does not.

instadmg.bash needs a preflight handler to verify that the build root is 
properly setup. Nothing 
fancy, just checking for pkg depth and such. This will save people time as they 
won't commit a full 
run only to find out at the end that they had a pkg in the wrong place.

What steps will reproduce the problem?
1. Edit a catalog file with an editor set to use spaces instead of tabs.
2. Add a line with tabs in it.
3. Run InstaUp2Date.py with the --process flag.

What is the expected output? What do you see instead?
I expect to see the build complete ;). I see a very generic Python `raise 
Exception()` function.

What version of InstaDMG are you running? What revision number (this should
be the second line of your package log)?
I am running from InstaDMG SVN revision 300

What OS are you running on (booted from)?
OS X 10.6.3 (Client)

What OS are you installing?
Install Disk image is OS X 10.6.2, using combo updater to get to 10.6.3.

Please provide any additional information below.
InstaUp2Date was failing every time it hit a line that I entered myself in the 
catalog file. I noticed off-hand that the lines I didn't enter were using tabs 
(not spaces), whereas I've got all my editors to use spaces instead of tabs. 
Starting with a clean catalog file and my editor set to use tabs (not spaces) 
seems to fix it. Not a big deal, just a pain because a lot of what I do relies 
on the reverse setting. Fix tested with Vim and SubEthaEdit.

What steps will reproduce the problem?
1. Use `svn` to update to revision 324. 
2. try to use instaUp2Date.py to update a catalog with pkg's in 
instadmg/InstallerFiles/InstaUp2DatePackages/
3. get errors similar to :

Looking for ClearRegistration
Traceback (most recent call last):
  File "./instadmg/AddOns/InstaUp2Date/instaUp2Date.py", line 799, in <module>
    main()
  File "./instadmg/AddOns/InstaUp2Date/instaUp2Date.py", line 782, in main
    thisController.parseFile(catalogFilePath)
  File "./instadmg/AddOns/InstaUp2Date/instaUp2Date.py", line 252, in parseFile
    checksumString = packageLineMatch.group("fileChecksum"),
  File "./instadmg/AddOns/InstaUp2Date/instaUp2Date.py", line 518, in __init__
    cacheFilePath = self.findItem(filePath, checksumType, checksumValue, cacheFolders)
NameError: global name 'checksumType' is not defined

What is the expected output? What do you see instead?


What version of InstaDMG are you running? What revision number (this should
be the second line of your package log)?
Checked out revision 324.

What OS are you running on (booted from)?
10.6.4

What OS are you installing?
10.6.4

Please provide any additional information below.

Hi,

I'm trying to build DMG's of OS X 10.5 and 10.6 images. I'm using the newest 
Build 236.

With OS X 10.5 Leopard Server I had no problems to integrate the updates, 
specially the 10.5.8 ServerCombo.

With OS X 10.6 Snow Leopard Server can't integrate the BaseUpdates.

See the debug log:

07:28:03 ###### Beginning Update Installs from ./InstallerFiles/BaseUpdates 
######
    Working on folder 01 (07:28:03)
        Copying folder ./InstallerFiles/BaseUpdates/01 into the target at /private/tmp/package.qn7EK0
        Installing MacOSXServerUpdCombo10.6.2.pkg from ./InstallerFiles/BaseUpdates/01 (01) inside a chroot jail
        installer[15481]: Package Authoring Warning: Package reference does not include required hash for package id auto. 
        installer[15481]: Package Authoring Warning: Package reference does not include required hash for package id auto2. 
        installer: Error trying to locate volume at / 
        Removing the copied folder: /private/tmp/mount_folder.kkrcAz/mount_point.ETdwXg/private/tmp/package.qn7EK0
    Folder 01 done (07:29:07)
    Working on folder 02 (07:29:07)
        Copying folder ./InstallerFiles/BaseUpdates/02 into the target at /private/tmp/package.P8Glm3
        Installing iTunes.mpkg from ./InstallerFiles/BaseUpdates/02 (02) inside a chroot jail
        installer: Error trying to locate volume at / 
        Removing the copied folder: /private/tmp/mount_folder.kkrcAz/mount_point.ETdwXg/private/tmp/package.P8Glm3
    Folder 02 done (07:29:28)
    Working on folder 03 (07:29:28)
        Copying folder ./InstallerFiles/BaseUpdates/03 into the target at /private/tmp/package.souIiL
        cp: ./InstallerFiles/BaseUpdates/03//RemoteDesktopClient.pkg/Contents/Resources/RemoteDesktopClient.sizes: No such file or directory 
        Installing RemoteDesktopClient.pkg from ./InstallerFiles/BaseUpdates/03 (03) inside a chroot jail
        installer: Error trying to locate volume at / 
        Removing the copied folder: /private/tmp/mount_folder.kkrcAz/mount_point.ETdwXg/private/tmp/package.souIiL
    Folder 03 done (07:29:29)
07:29:29 ###### Beginning Update Installs from ./InstallerFiles/CustomPKG ######


Ulli

What steps will reproduce the problem?
1. Add an iTunes updater to your BaseOS updates folder. 
2. Run instadmg.

What is the expected output? What do you see instead?
The iTunes Helper app is started on the dmg you installed to. This prevents the 
ejection from 
working on the ASR image.

We need to scan the process list on the Mac to find anything that is rooted on 
the ASR image and 
kill it. I would prefer to do this before the ASR takes place.

What steps will reproduce the problem?
1. Run instadmg.bash

What is the expected output? What do you see instead?

Custom packages install in the correct order. Custom packages do not
install in the correct order.

What version of the product are you using? On what operating system?
InstaDMG 1.5r210 on Leopard 10.5.7

Please provide any additional information below.
The "install_packages_from_folder()" function in instadmg.bash attempts to
sort the packages using ls piped to awk, where awk is simply using the
[[:digit:]] pattern anchored at the beginning and end of the folder name
string. This causes folders named with a 3 digit number to be sorted after
folder names with a 4 digit number. (i.e., 1000,1100,1900,100) If the
output of ls were to be piped to sort -n, this issue goes away. I have
attached the 1.5r210 instadmg.bash script with my change.

instadmg.bash needs to detect what the target OS is. This will let us abort 
cleanly if someone tries 
to install Leopard from Tiger.

Package name is createUser 
         Installing at base path /private/tmp/InstaDMG_temp_folder.Xs6ujN/mount_point.s5hwK1 
        PHASE:Preparing for installation… 
         -[IFDInstallController(Private) _buildInstallPlan]: location = file://localhost 
         -[IFDInstallController(Private) _buildInstallPlan]: file://localhost/Users/jeremym/Projects/Qivliq/Imaging/AutoImage/InstaDMG/./InstallerFiles/CustomPKG/01/createUser.pkg 
         Will use PK session 
         Starting installation: 
        PHASE:Preparing the disk… 
         Configuring volume "InstaDMG" 
         Preparing disk for local booted install. 
         Free space on "InstaDMG": 24.6 GB (24602951680 bytes). 
         Create temporary directory "/var/folders/zz/zzzivhrRnAmviuee+++++++++++/-Tmp-//Install.63378BNIkTr" 
         IFPKInstallElement (1 packages) 
        PHASE:Preparing createUser… 
        PHASE:Waiting for other installations to complete… 
         PackageKit: ----- Begin install ----- 
         PackageKit: request=PKInstallRequest <1 packages, destination=/tmp/InstaDMG_temp_folder.Xs6ujN/mount_point.s5hwK1> 
         PackageKit: packages=( 
            "PKJaguarPackage <file://localhost/Users/jeremym/Projects/Qivliq/Imaging/AutoImage/InstaDMG/./InstallerFiles/CustomPKG/01/createUser.pkg>" 
        ) 
        PHASE:Configuring the installation… 
        STATUS: 
         PackageKit: Extracting /Users/jeremym/Projects/Qivliq/Imaging/AutoImage/InstaDMG/InstallerFiles/CustomPKG/01/createUser.pkg/Contents/Archive.pax.gz (destination=/private/tmp/InstaDMG_temp_folder.Xs6ujN/mount_point.s5hwK1/.PKInstallSandbox-tmp/Root, uid=0) 
         PackageKit: Shoving /private/tmp/InstaDMG_temp_folder.Xs6ujN/mount_point.s5hwK1/.PKInstallSandbox-tmp/Root (0 items) to /tmp/InstaDMG_temp_folder.Xs6ujN/mount_point.s5hwK1 
         PackageKit: Executing script "./postflight" in /Users/jeremym/Projects/Qivliq/Imaging/AutoImage/InstaDMG/InstallerFiles/CustomPKG/01/createUser.pkg/Contents/Resources 
         ./postflight: OS 10.6.4 not supported 
         PackageKit: Install Failed: PKG: post-flight scripts for "edu.uc.daap.createuser.pkg" 
        Error Domain=PKInstallErrorDomain Code=112 UserInfo=0x100542ea0 "An error occurred while running scripts from the package “createUser.pkg”." { 
            NSFilePath = "./postflight"; 
            NSLocalizedDescription = "An error occurred while running scripts from the package U201ccreateUser.pkgU201d."; 
            NSURL = "file://localhost/Users/jeremym/Projects/Qivliq/Imaging/AutoImage/InstaDMG/./InstallerFiles/CustomPKG/01/createUser.pkg"; 
            PKInstallPackageIdentifier = "edu.uc.daap.createuser.pkg"; 
        } 
         install:didFailWithError:Error Domain=PKInstallErrorDomain Code=112 UserInfo=0x100542ea0 "An error occurred while running scripts from the package “createUser.pkg”." 
        %97.750000 
         Install failed: The Installer encountered an error that caused the installation to fail. Contact the software manufacturer for assistance. 
         The install failed (The Installer encountered an error that caused the installation to fail. Contact the software manufacturer for assistance.) 
    Folder 01 done (20:36:28)

What steps will reproduce the problem?
1. Try to use sv as a language
2. Do the instadmg script
3. Boot the "Swedish" system

What is the expected output? What do you see instead?
Swedish system, seeing english instead.

What version of InstaDMG are you running? What revision number (this should
be the second line of your package log)?
Latest

What OS are you running on (booted from)?
10.6.3, swedish

What OS are you installing?
10.6.3

Please provide any additional information below.

The defaults write that updates HiddenUsersList should use -array-add
instead of -array, so that the created user is added to the list of hidden
accounts, instead of overwriting the preference.

It would cut down build times significantly if it was possible to cache the
base image after certain packages have been applied. Specifically, I'd like
to apply 10.5.8 before the base os is cached, as it takes up half of the
build time by itself. When experimenting with a bunch of CustomPKGs, it'd
be useful to apply all system updates before caching, and so on.

With rev 266 the path for the -o flag is not completely escaped everywhere, so 
it bleeds through if 
there are spaces.

What steps will reproduce the problem?
1. run 10.6_vanilla.catalog
2.
3.

What is the expected output? What do you see instead?
you get this error:
Exception: Got status code: 404 while trying to connect to remote url: 
http://support.apple.com/downloads/DL972/en_US/JavaForMacOSX10.6Update1.dmg

Reason being java for mac os x update 2 came out today and they are saying it 
supersedes the previous java update so they pulled the old one:
http://support.apple.com/kb/HT4141


What version of InstaDMG are you running? What revision number (this should
be the second line of your package log)?
InstaDMG version 1.6b2 (svn revision: 295)

What OS are you running on (booted from)?
10.6.3

What OS are you installing?
10.6.3

Please provide any additional information below.

I have attached an updated version of the catalog file.

Documentation does not mention that files in CustomPKG should be soft
links.  Found out the hard way :-)