open-power / op-build Goto Github PK

Buildroot overlay for Open Power

License: GNU General Public License v2.0

Shell 21.77% Makefile 60.40% Perl 17.83%

firmware openpower makefile

op-build's Introduction

OpenPOWER Firmware Build Environment

The OpenPOWER firmware build process uses Buildroot to create a toolchain and build the various components of the PNOR firmware, including Hostboot, Skiboot, OCC, Petitboot etc.

Documentation

https://open-power.github.io/op-build/

See the doc/ directory for documentation source. Contributions are VERY welcome!

Development

Issues, Milestones, pull requests and code hosting is on GitHub: https://github.com/open-power/op-build

See CONTRIBUTING.md for howto contribute code.

Mailing list: [email protected]
Info/Subscribe: https://lists.ozlabs.org/listinfo/openpower-firmware
Archives: https://lists.ozlabs.org/pipermail/openpower-firmware/

Building an image

To build an image for a Blackbird system:

git clone --recursive https://github.com/open-power/op-build.git
cd op-build
./op-build blackbird_defconfig && ./op-build

There are also default configurations for other platforms in openpower/configs/. Current POWER9 platforms include Witherspoon, Boston (p9dsu), Romulus, and Zaius.

Buildroot/op-build supports both native and cross-compilation - it will automatically download and build an appropriate toolchain as part of the build process, so you don't need to worry about setting up a cross-compiler. Cross-compiling from a x86-64 host is officially supported.

The machine your building on will need Python 2.7, GCC 8.4 (or later), and a handful of other packages (see below).

Dependencies for 64-bit Ubuntu/Debian systems

Install Ubuntu 22.04 or Debian 12 (x86_64 or ppc64le).

Enable Universe (Ubuntu only):

 sudo apt-get install software-properties-common
 sudo add-apt-repository universe

Install the packages necessary for the build:

 sudo apt-get install cscope universal-ctags libz-dev libexpat-dev \
   python2 python-is-python3 language-pack-en texinfo gawk cpio xxd \
   build-essential g++ git bison flex unzip \
   libssl-dev libxml-simple-perl libxml-sax-perl libxml-parser-perl libxml2-dev libxml2-utils xsltproc \
   wget bc rsync

Dependencies for 64-bit Fedora systems

Install Fedora 33 (x86_64 or ppc64le).

Install the packages necessary for the build:

 sudo dnf install gcc-c++ flex bison git ctags cscope expat-devel patch \
   zlib-devel zlib-static texinfo "perl(bigint)" "perl(XML::Simple)" \
   "perl(YAML)" "perl(XML::SAX)" "perl(Fatal)" "perl(Thread::Queue)" \
   "perl(Env)" "perl(XML::LibXML)" "perl(Digest::SHA1)" "perl(ExtUtils::MakeMaker)" \
   "perl(FindBin)" "perl(English)" "perl(Time::localtime)" "perl(open)" \
   libxml2-devel which wget unzip tar cpio python bzip2 bc findutils ncurses-devel \
   openssl-devel make libxslt vim-common lzo-devel python2 rsync hostname

op-build's People

Contributors

Stargazers

Watchers

Forkers

brs332 causten gdhh shenki jk-ozlabs genie-wang tseredynski dcrowell77 mabaiocchi wilbryan apopple scprek ploetzma jamesshie fatsweetfish wghoffa stewartsmith gaeaworld tomshu austinwrx mikey cvswen pragupta sharkcz geissonator bwmashak brihh fspbld anoo1 yadlapati cjcain guillesilva nkskjames whs1787 rjknight jazurin joeyang4 bilicon vindog bogatseng fmkassem csmart sammj johnhihi johnchchen dougmill-ibm cyrilbur-ibm marktsai0316 op-jenkins vaibhav92 shilpasri mamatha4 menglimarkham tangjian7656 kennethwilke spinler sannerd hegdevasant oohal tonychangtw219 deadbeefh hellerda jian-fang dgilbert999 ruscur pridhiviraj aalugore mingfengwuye haochenprophet bofferdn sgupta2m openpower-system arthurheymans ajdlinux op-next rlippert mpe alvintpwang ryanwyluo robin903230 wak-google mengzeliao maddy-kerneldev drajarshi shakeebbk svaidy tk-wfischer agangidi53 fbarrat rajadas2 sameerveer konglay guilhermepiccoli e-liner sjitindarsingh charleshofer ilyasmirnov91 jhunsber gtmills jahunsbe

op-build's Issues

skiboot for op-build v1.7

Tracker for skiboot for op-build v1.7

Building on Palmetto: Ubuntu Packages

During packages installation: gcc-multilib package is not available, and the g++-multilib package could not be found. (I don't know if these are required for native compilation or not.)

$ sudo apt-get install gcc-multilib g++-multilib
Reading package lists... Done
Building dependency tree
Reading state information... Done
Package gcc-multilib is not available, but is referred to by another package.
This may mean that the package is missing, has been obsoleted, or
is only available from another source

E: Package 'gcc-multilib' has no installation candidate
E: Unable to locate package g++-multilib
E: Couldn't find any package by regex 'g++-multilib'
$

EDIT: Ubuntu 14.04 on a Tyan Palmetto, default configuration.

MRW processing can be incorrect for MSBSWAP on two socket systems.

Include Hostboot change Ib5656de1eb076b956315c31e957e66c17aa3bfc1 into op-build.

Include hostboot change Iaa4802e72e355acd03cb88e58c40d1069dd76ef5

Palmetto slower after firmware update

The Palmetto I built and upgrade to firmware 1.0 is running about 30% slower after the update. (The blackscholes benchmark that took 256s with factory firmware now takes 378s with firmware 1.0 for example.) I suspect the CPU is downclocking itself, but I'm not sure how to prevent that. Are there settings that I should tweak before building the firmware?

Include Hostboot fix for I631dc758e03316a28d13f6d19032c1a76e3cffc1

Include hostboot change Id251307aa76259d8a290a92d9e9f3418b181bc3e

Build fails on Fedora 22

Machine: Linux gemini 4.0.7-300.fc22.x86_64 #1 SMP Mon Jun 29 22:15:06 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux

Seems to be an issue between ncurses and gcc: http://lists.gnu.org/archive/html/bug-ncurses/2014-07/msg00020.html

GCC version: gcc (GCC) 5.1.1 20150618 (Red Hat 5.1.1-4)

Error:
In file included from ../ncurses/curses.priv.h:283:0,
from ../ncurses/lib_gen.c:19:
_25759.c:835:15: error: expected ‘)’ before ‘int’
../include/curses.h:1594:56: note: in definition of macro ‘mouse_trafo’
#define mouse_trafo(y,x,to_screen) wmouse_trafo(stdscr,y,x,to_screen)
^
/usr/bin/gcc -DHAVE_CONFIG_H -I../ncurses -I. -I/home/ijenkins/dev/op-build/output/host/usr/include -D_GNU_SOURCE -DNDEBUG -I. -I../include -I/home/ijenkins/dev/op-build/output/host/usr/include/ncurses -O2 -I/home/ijenkins/dev/op-build/output/host/usr/include --param max-inline-insns-single=1200 -fPIC -c ../ncurses/./base/lib_inchstr.c -o ../obj_s/lib_inchstr.o
Makefile:795: recipe for target '../obj_s/lib_gen.o' failed
make[2]: *** [../obj_s/lib_gen.o] Error 1
make[2]: *** Waiting for unfinished jobs....
make[2]: Leaving directory '/home/ijenkins/dev/op-build/output/build/host-ncurses-5.9/ncurses'
Makefile:307: recipe for target '../lib/libncurses.so' failed
make[1]: *** [../lib/libncurses.so] Error 2
make[1]: *** Waiting for unfinished jobs....
make[1]: Leaving directory '/home/ijenkins/dev/op-build/output/build/host-ncurses-5.9/progs'
package/pkg-generic.mk:177: recipe for target '/home/ijenkins/dev/op-build/output/build/host-ncurses-5.9/.stamp_built' failed
make: *** [/home/ijenkins/dev/op-build/output/build/host-ncurses-5.9/.stamp_built] Error 2
make: Leaving directory '/home/ijenkins/dev/op-build/buildroot'

skiboot for op-build v1.5

Issue to track skiboot for op-build 1.5

openpower_mambo_defconfig build broken in master-next

Building on ppc64el, Ubuntu Utopic, building maste-next:
9fc43d1 was successful
6078138 failed with:

linux dc97a6e626eaf22c9bd4baec3954fa5501ce1c63 Downloading
Doing full clone
Cloning into bare repository 'linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63'...
linux dc97a6e626eaf22c9bd4baec3954fa5501ce1c63 Extracting
gzip -d -c /home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/dl/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63.tar.gz | tar --strip-components=1 -C /home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63 -xf -
linux dc97a6e626eaf22c9bd4baec3954fa5501ce1c63 Patching
for p in ; do if echo $p | grep -q -E "^ftp://|^http://" ; then support/scripts/apply-patches.sh /home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63 /home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/dl basename $p ; elif test -d $p ; then support/scripts/apply-patches.sh /home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63 $p linux-*.patch ; else support/scripts/apply-patches.sh /home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63 dirname $p basename $p ; fi done
linux dc97a6e626eaf22c9bd4baec3954fa5501ce1c63 Configuring
/usr/bin/install -m 0644 "/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/openpower/configs/linux/skiroot_defconfig" /home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63/arch/powerpc/configs/buildroot_defconfig
PATH="/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/host/bin:/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/host/sbin:/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/host/usr/bin:/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/host/usr/sbin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games" /usr/bin/make -j1 HOSTCC="/usr/bin/gcc" HOSTCFLAGS="" ARCH=powerpc INSTALL_MOD_PATH=/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/target CROSS_COMPILE=" /home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/host/usr/bin/powerpc64-buildroot-linux-gnu-" DEPMOD=/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/host/sbin/depmod -C /home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63 buildroot_defconfig
make[1]: Entering directory '/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63'
HOSTCC scripts/basic/fixdep
HOSTCC scripts/kconfig/conf.o
SHIPPED scripts/kconfig/zconf.tab.c
SHIPPED scripts/kconfig/zconf.lex.c
SHIPPED scripts/kconfig/zconf.hash.c
HOSTCC scripts/kconfig/zconf.tab.o
HOSTLD scripts/kconfig/conf

configuration written to .config

make[1]: Leaving directory '/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63'
rm /home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63/arch/powerpc/configs/buildroot_defconfig
/bin/sed -i -e "/<CONFIG_BLK_DEV_INITRD\>/d" /home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63/.config
echo "CONFIG_BLK_DEV_INITRD=y" >> /home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63/.config

As the kernel gets compiled before root filesystems are

built, we create a fake cpio file. It'll be

replaced later by the real cpio archive, and the kernel will be

rebuilt using the linux26-rebuild-with-initramfs target.

touch /home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/images/rootfs.cpio
/bin/sed -i -e "/<CONFIG_INITRAMFS_SOURCE\>/d" /home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63/.config
echo "CONFIG_INITRAMFS_SOURCE="/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/images/rootfs.cpio"" >> /home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63/.config
/bin/sed -i -e "/<CONFIG_INITRAMFS_ROOT_UID\>/d" /home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63/.config
echo "CONFIG_INITRAMFS_ROOT_UID=0" >> /home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63/.config
/bin/sed -i -e "/<CONFIG_INITRAMFS_ROOT_GID\>/d" /home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63/.config
echo "CONFIG_INITRAMFS_ROOT_GID=0" >> /home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63/.config
/bin/sed -i -e "/<CONFIG_DEVTMPFS\>/d" /home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63/.config
echo "CONFIG_DEVTMPFS=y" >> /home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63/.config
/bin/sed -i -e "/<CONFIG_DEVTMPFS_MOUNT\>/d" /home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63/.config
echo "CONFIG_DEVTMPFS_MOUNT=y" >> /home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63/.config
/bin/sed -i -e "/<CONFIG_INOTIFY_USER\>/d" /home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63/.config
echo "CONFIG_INOTIFY_USER=y" >> /home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63/.config
yes '' | PATH="/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/host/bin:/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/host/sbin:/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/host/usr/bin:/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/host/usr/sbin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games" /usr/bin/make -j1 HOSTCC="/usr/bin/gcc" HOSTCFLAGS="" ARCH=powerpc INSTALL_MOD_PATH=/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/target CROSS_COMPILE=" /home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/host/usr/bin/powerpc64-buildroot-linux-gnu-" DEPMOD=/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/host/sbin/depmod -C /home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63 oldconfig
make[1]: Entering directory '/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63'
scripts/kconfig/conf --oldconfig Kconfig

configuration written to .config

make[1]: Leaving directory '/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63'
yes: standard output: Broken pipe
yes: write error
linux dc97a6e626eaf22c9bd4baec3954fa5501ce1c63 Building
PATH="/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/host/bin:/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/host/sbin:/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/host/usr/bin:/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/host/usr/sbin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games" /usr/bin/make -j41 HOSTCC="/usr/bin/gcc" HOSTCFLAGS="" ARCH=powerpc INSTALL_MOD_PATH=/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/target CROSS_COMPILE=" /home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/host/usr/bin/powerpc64-buildroot-linux-gnu-" DEPMOD=/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/host/sbin/depmod -C /home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63 zImage.epapr
make[1]: Entering directory '/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63'
scripts/kconfig/conf --silentoldconfig Kconfig
CHK include/config/kernel.release
WRAP arch/powerpc/include/generated/asm/clkdev.h
WRAP arch/powerpc/include/generated/asm/hash.h
WRAP arch/powerpc/include/generated/asm/irq_work.h
CHK include/generated/uapi/linux/version.h
UPD include/generated/uapi/linux/version.h
UPD include/config/kernel.release
HOSTCC scripts/basic/bin2c
WRAP arch/powerpc/include/generated/asm/mcs_spinlock.h
CHK include/generated/utsrelease.h
UPD include/generated/utsrelease.h
WRAP arch/powerpc/include/generated/asm/rwsem.h
WRAP arch/powerpc/include/generated/asm/preempt.h
WRAP arch/powerpc/include/generated/asm/scatterlist.h
WRAP arch/powerpc/include/generated/asm/vtime.h
WRAP arch/powerpc/include/generated/asm/trace_clock.h
HOSTCC scripts/pnmtologo
HOSTCC scripts/kallsyms
HOSTCC scripts/conmakehash
CC scripts/mod/empty.o
SHIPPED scripts/dtc/dtc-parser.tab.h
SHIPPED scripts/dtc/dtc-lexer.lex.c
SHIPPED scripts/dtc/dtc-parser.tab.c
HOSTCC scripts/mod/mk_elfconfig
HOSTCC scripts/dtc/dtc.o
HOSTCC scripts/dtc/checks.o
HOSTCC scripts/dtc/data.o
HOSTCC scripts/dtc/fstree.o
HOSTCC scripts/dtc/flattree.o
HOSTCC scripts/dtc/util.o
HOSTCC scripts/dtc/livetree.o
HOSTCC scripts/dtc/treesource.o
CC scripts/mod/devicetable-offsets.s
HOSTCC scripts/dtc/srcpos.o
HOSTCC scripts/dtc/dtc-parser.tab.o
GEN scripts/mod/devicetable-offsets.h
MKELF scripts/mod/elfconfig.h
HOSTCC scripts/mod/file2alias.o
HOSTCC scripts/mod/sumversion.o
HOSTCC scripts/mod/modpost.o
HOSTCC scripts/dtc/dtc-lexer.lex.o
HOSTLD scripts/dtc/dtc
HOSTLD scripts/mod/modpost
CC kernel/bounds.s
GEN include/generated/bounds.h
CC arch/powerpc/kernel/asm-offsets.s
GEN include/generated/asm-offsets.h
CALL scripts/checksyscalls.sh
CC init/main.o
CHK include/generated/compile.h
CC init/do_mounts.o
CC init/do_mounts_rd.o
CC init/do_mounts_initrd.o
CC init/do_mounts_md.o
CC init/initramfs.o
CC init/init_task.o
HOSTCC usr/gen_init_cpio
CC arch/powerpc/kernel/cputable.o
CC arch/powerpc/kernel/ptrace.o
CC arch/powerpc/kernel/syscalls.o
CC arch/powerpc/kernel/irq.o
CC arch/powerpc/kernel/align.o
CC arch/powerpc/kernel/signal_32.o
CC arch/powerpc/kernel/vdso.o
CC arch/powerpc/kernel/pmc.o
CC arch/powerpc/kernel/process.o
CPP arch/powerpc/kernel/systbl_chk.i
CC arch/powerpc/kernel/idle.o
CC arch/powerpc/kernel/signal.o
CC arch/powerpc/kernel/sysfs.o
CC arch/powerpc/kernel/prom.o
CC arch/powerpc/kernel/cacheinfo.o
CC arch/powerpc/mm/fault.o
CC arch/powerpc/kernel/traps.o
CC arch/powerpc/kernel/time.o
CC arch/powerpc/mm/mem.o
CC arch/powerpc/kernel/setup-common.o
CC arch/powerpc/kernel/udbg.o
CC arch/powerpc/mm/pgtable.o
CC arch/powerpc/mm/gup.o
CC arch/powerpc/kernel/io.o
CC arch/powerpc/mm/mmap.o
AS arch/powerpc/kernel/misc.o
CC arch/powerpc/mm/pgtable_64.o
AS arch/powerpc/kernel/misc_64.o
CC arch/powerpc/kernel/dma.o
CC arch/powerpc/mm/init_64.o
AS arch/powerpc/lib/string.o
UPD include/generated/compile.h
CC init/version.o
GEN usr/initramfs_data.cpio.gz
LDS arch/powerpc/kernel/vdso32/vdso32.lds
AS usr/initramfs_data.o
CC arch/powerpc/kernel/setup_64.o
CC arch/powerpc/mm/hash_utils_64.o
VDSO32A arch/powerpc/kernel/vdso32/sigtramp.o
LD usr/built-in.o
/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/host/usr/bin/powerpc64-buildroot-linux-gnu-ld: unrecognised emulation mode: elf64lppc
Supported emulations: elf64ppc elf32ppclinux elf32ppc elf32ppcsim
LDS arch/powerpc/kernel/vdso64/vdso64.lds
scripts/Makefile.build:336: recipe for target 'usr/built-in.o' failed
make[2]: *** [usr/built-in.o] Error 1
Makefile:929: recipe for target 'usr' failed
make[1]: *** [usr] Error 2
make[1]: *** Waiting for unfinished jobs....
AS arch/powerpc/mm/slb_low.o
CC arch/powerpc/lib/alloc.o
CC arch/powerpc/mm/slb.o
VDSO64A arch/powerpc/kernel/vdso64/sigtramp.o
VDSO32A arch/powerpc/kernel/vdso32/gettimeofday.o
AS arch/powerpc/lib/crtsavres.o
CC arch/powerpc/lib/devres.o
VDSO64A arch/powerpc/kernel/vdso64/gettimeofday.o
AS arch/powerpc/lib/copypage_64.o
CC arch/powerpc/mm/hash_native_64.o
AS arch/powerpc/mm/hash_low_64.o
VDSO32A arch/powerpc/kernel/vdso32/datapage.o
AS arch/powerpc/lib/copyuser_64.o
VDSO64A arch/powerpc/kernel/vdso64/datapage.o
VDSO32A arch/powerpc/kernel/vdso32/cacheflush.o
VDSO32A arch/powerpc/kernel/vdso32/note.o
VDSO64A arch/powerpc/kernel/vdso64/cacheflush.o
VDSO64A arch/powerpc/kernel/vdso64/note.o
VDSO32A arch/powerpc/kernel/vdso32/getcpu.o
CC arch/powerpc/lib/usercopy_64.o
AS arch/powerpc/lib/mem_64.o
CC arch/powerpc/kernel/sys_ppc32.o
CC arch/powerpc/kernel/signal_64.o
VDSO64A arch/powerpc/kernel/vdso64/getcpu.o
CC arch/powerpc/mm/tlb_hash64.o
VDSO32L arch/powerpc/kernel/vdso32/vdso32.so.dbg
CC arch/powerpc/mm/mmu_context_hash64.o
AS arch/powerpc/lib/hweight_64.o
AS arch/powerpc/lib/copyuser_power7.o
/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/host/usr/lib/gcc/powerpc64-buildroot-linux-gnu/4.8.3/../../../../powerpc64-buildroot-linux-gnu/bin/ld: unrecognised emulation mode: elf32lppclinux
Supported emulations: elf64ppc elf32ppclinux elf32ppc elf32ppcsim
collect2: error: ld returned 1 exit status
arch/powerpc/kernel/vdso32/Makefile:33: recipe for target 'arch/powerpc/kernel/vdso32/vdso32.so.dbg' failed
make[3]: *** [arch/powerpc/kernel/vdso32/vdso32.so.dbg] Error 1
scripts/Makefile.build:404: recipe for target 'arch/powerpc/kernel/vdso32' failed
make[2]: *** [arch/powerpc/kernel/vdso32] Error 2
make[2]: *** Waiting for unfinished jobs....
CC arch/powerpc/mm/numa.o
AS arch/powerpc/lib/string_64.o
VDSO64L arch/powerpc/kernel/vdso64/vdso64.so.dbg
CC arch/powerpc/mm/slice.o
/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/host/usr/lib/gcc/powerpc64-buildroot-linux-gnu/4.8.3/../../../../powerpc64-buildroot-linux-gnu/bin/ld: unrecognised emulation mode: elf64lppc
Supported emulations: elf64ppc elf32ppclinux elf32ppc elf32ppcsim
collect2: error: ld returned 1 exit status
arch/powerpc/kernel/vdso64/Makefile:26: recipe for target 'arch/powerpc/kernel/vdso64/vdso64.so.dbg' failed
make[3]: *** [arch/powerpc/kernel/vdso64/vdso64.so.dbg] Error 1
scripts/Makefile.build:404: recipe for target 'arch/powerpc/kernel/vdso64' failed
make[2]: *** [arch/powerpc/kernel/vdso64] Error 2
CC arch/powerpc/mm/hugetlbpage.o
AS arch/powerpc/lib/memcpy_power7.o
AS arch/powerpc/lib/copypage_power7.o
AS arch/powerpc/lib/memcpy_64.o
CC arch/powerpc/lib/sstep.o
AS arch/powerpc/lib/ldstfp.o
CC arch/powerpc/lib/locks.o
CC arch/powerpc/lib/vmx-helper.o
CC arch/powerpc/lib/code-patching.o
CC arch/powerpc/lib/feature-fixups.o
CC arch/powerpc/lib/xor_vmx.o
LD init/mounts.o
/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/host/usr/bin/powerpc64-buildroot-linux-gnu-ld: unrecognised emulation mode: elf64lppc
Supported emulations: elf64ppc elf32ppclinux elf32ppc elf32ppcsim
scripts/Makefile.build:390: recipe for target 'init/mounts.o' failed
make[2]: *** [init/mounts.o] Error 1
Makefile:929: recipe for target 'init' failed
make[1]: *** [init] Error 2
Makefile:929: recipe for target 'arch/powerpc/kernel' failed
make[1]: *** [arch/powerpc/kernel] Error 2
LD arch/powerpc/mm/built-in.o
/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/host/usr/bin/powerpc64-buildroot-linux-gnu-ld: unrecognised emulation mode: elf64lppc
Supported emulations: elf64ppc elf32ppclinux elf32ppc elf32ppcsim
scripts/Makefile.build:336: recipe for target 'arch/powerpc/mm/built-in.o' failed
make[2]: *** [arch/powerpc/mm/built-in.o] Error 1
Makefile:929: recipe for target 'arch/powerpc/mm' failed
make[1]: *** [arch/powerpc/mm] Error 2
LD arch/powerpc/lib/built-in.o
/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/host/usr/bin/powerpc64-buildroot-linux-gnu-ld: unrecognised emulation mode: elf64lppc
Supported emulations: elf64ppc elf32ppclinux elf32ppc elf32ppcsim
scripts/Makefile.build:336: recipe for target 'arch/powerpc/lib/built-in.o' failed
make[2]: *** [arch/powerpc/lib/built-in.o] Error 1
Makefile:929: recipe for target 'arch/powerpc/lib' failed
make[1]: *** [arch/powerpc/lib] Error 2
make[1]: Leaving directory '/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63'
package/pkg-generic.mk:177: recipe for target '/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63/.stamp_built' failed
make: *** [/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/output/build/linux-dc97a6e626eaf22c9bd4baec3954fa5501ce1c63/.stamp_built] Error 2
make: Leaving directory '/home/jenkins/workspace/op-build-master-next/defconfig/openpower_mambo/label_exp/utopic/buildroot'
Build step 'Execute shell' marked build as failure
Archiving artifacts
Finished: FAILURE

skiboot for op-build v1.4

placeholder for skiboot update for op-build 1.4

missing make and unzip packages in readme

missing make and unzip on build instructions for ubuntu 14.04 instructions

Building on 64-bit Ubuntu/Debian systems

Install the packages necessary for the build:

sudo apt-get install cscope ctags libz-dev libexpat-dev libc6-dev-i386 gcc g++ git bison flex gcc-multilib g++-multilib libxml-simple-perl libxml-sax-perl make unzip

Rebuild TOD topology

From discussion around Message-ID: [email protected], we need some functionality to rebuild TOD topology on OpenPower machines.

Not a high priority item, this issue is open to track it though.

Include open-power/skiboot@b9e798a

Include open-power/skiboot@b9e798a

Support custom kernel patches and defconfig.

With #79 , I added a subdirectory open-power/custom that allows a user to place additional packages, new configs, and patches for existing patches. This commit sets the BR2_GLOBAL_PATCH_DIR to enable patch locations.

Please expand this for the kernel to support:

Kernel patches via BR2_LINUX_KERNEL_PATCH
Custom kernel configs via BR2_LINUX_KERNEL_USE_CUSTOM_CONFIG

As part of this work it might make sense to move the openpower_defconfig from the custom kernel repository and into op-build as a starting default.

This feature (and #79) were opened as a result of conversations with one of the OpenPower partners designing their own system and seeing how they were currently modifying op-build and buildroot content.

Include open-power/hostboot#18

Include open-power/hostboot#18 into release.

Ubuntu 14.04 LE: op-build fails with kmod --enable-static not supported

Opening this issue since #101 was closed.

Other teams have a requirement to run on 14.04 and they're unable to cleanly build op-build on Power systems. README specifies that 14.04 is supported.
Copying error msg from 101:

$ op-build palmetto_defconfig && op-build
...
...

host-kmod 17 Configuring
...
...
checking whether to build static libraries... yes
checking whether to enable maintainer-specific portions of Makefiles... yes
configure: error: --enable-static is not supported by kmod
make: *** [/home/clarity/op-build/output/build/host-kmod-17/.stamp_configured] Error 1
make: Leaving directory `/home/clarity/op-build/buildroot'
$

Current workaround is to comment out line 12321 on file op-build/output/build/host-kmod-17/configure:

if test "x$enable_static" = "xyes"; then :

as_fn_error $? "--enable-static is not supported by kmod" "$LINENO" 5

Building on Palmetto: kmod, --enable-static

kmod throws an error while configuring that '--enable-static" is not supported.

$ op-build palmetto_defconfig && op-build
...
...

host-kmod 17 Configuring
...
...
checking whether to build static libraries... yes
checking whether to enable maintainer-specific portions of Makefiles... yes
configure: error: --enable-static is not supported by kmod
make: *** [/home/clarity/op-build/output/build/host-kmod-17/.stamp_configured] Error 1
make: Leaving directory `/home/clarity/op-build/buildroot'
$

EDIT: Ubuntu 14.04 on a Tyan Palmetto, default configuration. Close if this is related to gcc-multilib or g++-multilib.

"fatal" error on build

Receive "fatal: No names found, cannot describe anything." from stderr on executing:

$ op-build hostboot-rebuild openpower-pnor-rebuild

Does not prevent rebuild. Low priority.

output/host/usr/powerpc64-buildroot-linux-gnu/sysroot/ is not cleared out before building.

output/host/usr/powerpc64-buildroot-linux-gnu/sysroot/hostboot_build_images and openpower_mrw_scratch is used to hold the MRW processing files, and output/host/usr/powerpc64-buildroot-linux-gnu/sysroot/openpower_pnor_scratch is where the actual processing is done.

The problem being encountered is that after doing a build once these files are populated. If subsequent builds change these files, they are not being updated and as such, the proper changes are not being seen.

We can't just blast away both directories, so we need to investigate which files are populated in there via hostboot, xml, mrw and pnor builds, and then when a user does a -rebuild- command, it should remove those files.

Ubuntu 14.04 fails compile on Power server 'libfakeroot.so' not found

if [ ! -e /home/causten/gitrepos/op-build/output/target/init ]; then /usr/bin/install -m 0755 fs/cpio/ init /home/causten/gitrepos/op-build/output/target/init; fi
rm -f /home/causten/gitrepos/op-build/output/build/_fakeroot.fs
rm -f /home/causten/gitrepos/op-build/output/target/THIS_IS_NOT_YOUR_ROOT_FILESYSTEM
rm -f /home/causten/gitrepos/op-build/output/build/_users_table.txt
echo "chown -h -R 0:0 /home/causten/gitrepos/op-build/output/target" >> /home/causten/gitrepos/op-buil d/output/build/_fakeroot.fs
cat system/device_table.txt > /home/causten/gitrepos/op-build/output/build/device_table.txt
printf '/bin/busybox f 4755 0 0 - - - - -\n/usr/share/udhcpc/default.script f 755 0 0 - - - - -\n /dev/console c 622 0 0 5 1 - - -\n' >> /home/causten/gitrepos/op-build/output/build/ device_table.txt
echo "/home/causten/gitrepos/op-build/output/host/usr/bin/makedevs -d /home/causten/gitrepos/op-build/ output/build/_device_table.txt /home/causten/gitrepos/op-build/output/target" >> /home/causten/gitrepo s/op-build/output/build/_fakeroot.fs
printf '' >> /home/causten/gitrepos/op-build/output/build/_users_table.txt
PATH="/home/causten/gitrepos/op-build/output/host/bin:/home/causten/gitrepos/op-build/output/host/sbin :/home/causten/gitrepos/op-build/output/host/usr/bin:/home/causten/gitrepos/op-build/output/host/usr/s bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games" /home/ca usten/gitrepos/op-build/buildroot/support/scripts/mkusers /home/causten/gitrepos/op-build/output/build /_users_table.txt /home/causten/gitrepos/op-build/output/target >> /home/causten/gitrepos/op-build/out put/build/_fakeroot.fs
echo " cd /home/causten/gitrepos/op-build/output/target && find . | cpio --quiet -o -H newc > /home/c austen/gitrepos/op-build/output/images/rootfs.cpio" >> /home/causten/gitrepos/op-build/output/build/_f akeroot.fs
chmod a+x /home/causten/gitrepos/op-build/output/build/fakeroot.fs
PATH="/home/causten/gitrepos/op-build/output/host/bin:/home/causten/gitrepos/op-build/output/host/sbin :/home/causten/gitrepos/op-build/output/host/usr/bin:/home/causten/gitrepos/op-build/output/host/usr/s bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games" /home/ca usten/gitrepos/op-build/output/host/usr/bin/fakeroot -- /home/causten/gitrepos/op-build/output/build/ fakeroot.fs
fakeroot: preload library libfakeroot.so' not found, aborting. make: *** [/home/causten/gitrepos/op-build/output/images/rootfs.cpio] Error 1 make: Leaving directory/home/causten/gitrepos/op-build/buildroot'

Use separate partitions for skiboot and skiroot

I'd like to propose switching to the flash layout on habanero and palmetto to use separate partitions for skiboot and skiboot (aka the petitboot Linux + rootfs image).

This makes it easier for development, as it allows flashing of skiboot independently. In theory it will also speed booting, as we can load skiroot while skiboot is performing other hardware initialisation, although I have not implemented this yet.

The current skiboot build is 768KB on my machine, so I've given skiboot 1MB and the rest (15MB on palmetto, 21.5MB on habanero) is left for skiroot. The new partition is called SKIROOT.

The changes to do this are in the skiroot branches under my account:

I've done test builds for habanero and palmetto, and successfully booted it on a plametto. You can reproduce my build check out my branch of op-build and run the following:

op-build P8_PORE_BINUTILS_VERSION=dcf4f87c0d9e8c8092ace0eb696189ee1056da30 \
 SKIBOOT_SITE=https://github.com/shenki/skiboot \
 SKIBOOT_SITE_METHOD=git \
 OPENPOWER_PNOR_SITE=https://github.com/shenki/pnor \
 OPENPOWER_PNOR_SITE_METHOD=git \
 OPENPOWER_PNOR_VERSION=49c2ccc6aaf36bb1eccd512391612136baa1a629 \ 
 SKIBOOT_VERSION=9701378341152718600048a13f829f3fc2224614

Please review my patches, and if we're happy with these changes I'll create PRs for pnor and submit the patch to skiboot, and then create a PR for op-build change along with rolling the dependences.

Broken build

As of 95e650d the build errors out with hostboot_build_images//HABANERO_HB.targeting.bin': No such file or directory in the openpower-pnor build step.

PATH="/var/local/jenkins/build/workspace/openpower-habanero/output/host/bin:/var/local/jenkins/build/workspace/openpower-habanero/output/host/sbin:/var/local/jenkins/build/workspace/openpower-habanero/output/host/usr/bin:/var/local/jenkins/build/workspace/openpower-habanero/output/host/usr/sbin:/usr/local/bin:/usr/bin:/bin:/usr/games" /var/local/jenkins/build/workspace/openpower-habanero/output/build/openpower-pnor-94389f62eabecf00ef129b4184bf4ba2bc9cd193/update_image.pl -op_target_dir /var/local/jenkins/build/workspace/openpower-habanero/output/host/usr/powerpc64-buildroot-linux-gnu/sysroot/hostboot_build_images/ -hb_image_dir /var/local/jenkins/build/workspace/openpower-habanero/output/host/usr/powerpc64-buildroot-linux-gnu/sysroot/hostboot_build_images/ -scratch_dir /var/local/jenkins/build/workspace/openpower-habanero/output/host/usr/powerpc64-buildroot-linux-gnu/sysroot/openpower_pnor_scratch/ -hb_binary_dir /var/local/jenkins/build/workspace/openpower-habanero/output/host/usr/powerpc64-buildroot-linux-gnu/sysroot/hostboot_binaries/ -targeting_binary_filename "HABANERO_HB.targeting.bin.ecc" -targeting_binary_source "HABANERO_HB.targeting.bin" -sbe_binary_filename "venice_sbe.img.ecc" -sbec_binary_filename "centaur_sbec_pad.img.ecc" -occ_binary_filename /var/local/jenkins/build/workspace/openpower-habanero/output/host/usr/powerpc64-buildroot-linux-gnu/sysroot/occ/"occ.bin"
dd if=/var/local/jenkins/build/workspace/openpower-habanero/output/host/usr/powerpc64-buildroot-linux-gnu/sysroot/hostboot_build_images//HABANERO_HB.targeting.bin of=/var/local/jenkins/build/workspace/openpower-habanero/output/host/usr/powerpc64-buildroot-linux-gnu/sysroot/openpower_pnor_scratch//HABANERO_HB.targeting.bin ibs=4k conv=sync
dd: failed to open '/var/local/jenkins/build/workspace/openpower-habanero/output/host/usr/powerpc64-buildroot-linux-gnu/sysroot/hostboot_build_images//HABANERO_HB.targeting.bin': No such file or directory
Error running command: dd if=/var/local/jenkins/build/workspace/openpower-habanero/output/host/usr/powerpc64-buildroot-linux-gnu/sysroot/hostboot_build_images//HABANERO_HB.targeting.bin of=/var/local/jenkins/build/workspace/openpower-habanero/output/host/usr/powerpc64-buildroot-linux-gnu/sysroot/openpower_pnor_scratch//HABANERO_HB.targeting.bin ibs=4k conv=sync. Nonzero return code of (256) returned.
package/pkg-generic.mk:214: recipe for target '/var/local/jenkins/build/workspace/openpower-habanero/output/build/openpower-pnor-94389f62eabecf00ef129b4184bf4ba2bc9cd193/.stamp_images_installed' failed
make: *** [/var/local/jenkins/build/workspace/openpower-habanero/output/build/openpower-pnor-94389f62eabecf00ef129b4184bf4ba2bc9cd193/.stamp_images_installed] Error 1

Include hostboot change I378e0763c5ca8c13830d0e6c057b24e6beb5dc8c

Add a patch to op-build once mba_def.initfile is merged

Add a patch in op-build to revert 135a1d27792e65131d16447182631d372bdc8336

Include open-power/habanero-xml@a98bf45

Include open-power/habanero-xml@a98bf45

Internal Compiler error in built gcc when building on Ubuntu Vivid ppc64el

(this is mostly to track the bug as I attempt to track it down)

With 79f79c4 (current op-build master), running a clean build inside a ubuntu vivid docker container (created using debootstrap) on a Ubuntu Vivid VM (powerkvm host) we end up with a compiler that cannot even preprocess things with a newline in them.

root@ed439acd7847:/home/jenkins/op-build# /home/jenkins/op-build/output/host/usr/bin/powerpc64-buildroot-linux-gnu-cpp /tmp/a.c
#1 "/tmp/a.c"
#1 ""
#1 ""
#1 "/tmp/a.c"
/tmp/a.c:1:0: internal compiler error: Aborted
/* confdefs.h /
^
Please submit a full bug report,
with preprocessed source if appropriate.
See http://bugs.buildroot.net/ for instructions.
root@ed439acd7847:/home/jenkins/op-build# cat /tmp/a.c
/ confdefs.h */

Not quite sure why this is as it's certainly nothing I've seen before...

firestone_defconfig doesn't build in master-next

As of fe9ad08 (refs/remotes/origin/master-next) at least, firestone_defconfig fails to build:

cp -f ../../../obj/genfiles/p8.npu.scom.if ../../../img/p8.npu.scom.if
DEP fsidd.C
MAKE attn CODE
CXX vfsrp.C
DEP mbox_dma_buffer.C
DEP attrsync.C
MAKE fapi CODE
DEP mdiasm.C
MAKE hwp CODE
In file included from ../../../src/include/usr/hwpf/fapi/fapiReturnCode.H:76:0,
from ../../../src/include/usr/hwpf/fapi/fapiUtil.H:63,
from ecmdDataBufferBase.C:41:
../../../obj/genfiles/fapiHwpErrorInfo.H:20634:5: error: redefinition of 'REG_FFDC_TEST_X_EX_REGISTERS'
REG_FFDC_TEST_X_EX_REGISTERS = 0xb225f1ca,
^
../../../obj/genfiles/fapiHwpErrorInfo.H:20215:5: error: 'REG_FFDC_TEST_X_EX_REGISTERS' previously defined here
REG_FFDC_TEST_X_EX_REGISTERS = 0xb225f1ca,
^
../../../obj/genfiles/fapiHwpErrorInfo.H:20639:5: error: redefinition of 'RC_MSS_MAINT_PUT_MARK_STORE_BAD_INPUT_RANK'
RC_MSS_MAINT_PUT_MARK_STORE_BAD_INPUT_RANK = 0xff72b733,
^
../../../obj/genfiles/fapiHwpErrorInfo.H:20575:5: error: 'RC_MSS_MAINT_PUT_MARK_STORE_BAD_INPUT_RANK' previously defined here
RC_MSS_MAINT_PUT_MARK_STORE_BAD_INPUT_RANK = 0xff72b733,
^

Large files in rootfs.

/etc/eudev/hwdb has large text files that are suspected to be unused.
/usr/locale/locale-archive is quite large considering only English is supported.

Can these files be reduced or removed?

VPD parser issue affecting double-drop configs (1.2 candidate)

Requesting commit for this issue:
https://github.com/open-power/tyan-openpower/issues/59

To be pulled in to v1.2
Already in hostboot @
open-power/hostboot@b134869
Commit = b13486920ba90ada1975271a6dd3e61cd8b96a66

Include hostboot change Ib49fe67e9c6631b2b7ea0005e692c9aea6d84057

Tracker issue for op-build v1.1 release issues.

This is the tracking issue for any features and bugs we need to get into v1.1. Tentative release is early in the week of 2015-03-30.

Unable to compile in new skiboot and generate new pnor file

I was told I needed this update to SKIBOOT_VERSION = c34c4ef8c660e3e439365c8f5c06143ff00bc6bc

I updated op-build/buildroot/firmware/skiboot/skiboot.mk and then re-did the "op-build palmetto_defconfig && op-build". There was some activity but my .pnor was not updated.

We tried removing the .pnor file from the previous build and a bunch of other files but had no luck in forcing the image to get regenerated.

Include hostboot change I245cd9947d5b7a05ff9a8f92ff18c658b1fe09d6

skiboot for op-build v1.6

Tracker for skiboot for op-build 1.6

Add nvram and ppc64_cpu to default config

I think it would be useful to have the powerpc-utils tools in the Petitboot environment. Can we please add nvram and ppc64_cpu?

Unable to build master-next

Attempting to build garrison_defconfig, I get:

linux d0ff068a9962ba96d4e6ddfba2a4e9fd8bc9a763 Building
PATH="/home/nacc/op-build/output/host/bin:/home/nacc/op-build/output/host/sbin:/home/nacc/op-build/output/host/usr/bin:/home/nacc/op-build/output/host/usr/sbin:/home/nacc/bin:/home/nacc/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games" /usr/bin/make -j9 HOSTCC="/usr/bin/gcc" HOSTCFLAGS="" ARCH=powerpc INSTALL_MOD_PATH=/home/nacc/op-build/output/target CROSS_COMPILE=" /home/nacc/op-build/output/host/usr/bin/powerpc64-buildroot-linux-gnu-" DEPMOD=/home/nacc/op-build/output/host/sbin/depmod -C /home/nacc/op-build/output/build/linux-d0ff068a9962ba96d4e6ddfba2a4e9fd8bc9a763 zImage.epapr
make[1]: Entering directory '/home/nacc/op-build/output/build/linux-d0ff068a9962ba96d4e6ddfba2a4e9fd8bc9a763'
scripts/kconfig/conf --silentoldconfig Kconfig
CHK include/config/kernel.release
WRAP arch/powerpc/include/generated/asm/clkdev.h
WRAP arch/powerpc/include/generated/asm/hash.h
WRAP arch/powerpc/include/generated/asm/irq_work.h
WRAP arch/powerpc/include/generated/asm/mcs_spinlock.h
WRAP arch/powerpc/include/generated/asm/preempt.h
WRAP arch/powerpc/include/generated/asm/scatterlist.h
WRAP arch/powerpc/include/generated/asm/rwsem.h
WRAP arch/powerpc/include/generated/asm/trace_clock.h
WRAP arch/powerpc/include/generated/asm/vtime.h
CHK include/generated/uapi/linux/version.h
UPD include/generated/uapi/linux/version.h
UPD include/config/kernel.release
HOSTCC scripts/basic/bin2c
CHK include/generated/utsrelease.h
UPD include/generated/utsrelease.h
CC kernel/bounds.s
HOSTCC scripts/kallsyms
HOSTCC scripts/pnmtologo
HOSTCC scripts/conmakehash
SHIPPED scripts/dtc/dtc-lexer.lex.c
CC scripts/mod/devicetable-offsets.s
HOSTCC scripts/dtc/checks.o
CC scripts/mod/empty.o
HOSTCC scripts/dtc/data.o
HOSTCC scripts/mod/mk_elfconfig
SHIPPED scripts/dtc/dtc-parser.tab.h
SHIPPED scripts/dtc/dtc-parser.tab.c
GEN scripts/mod/devicetable-offsets.h
GEN include/generated/bounds.h
HOSTCC scripts/dtc/dtc.o
HOSTCC scripts/dtc/flattree.o
CC arch/powerpc/kernel/asm-offsets.s
HOSTCC scripts/dtc/fstree.o
HOSTCC scripts/dtc/livetree.o
MKELF scripts/mod/elfconfig.h
HOSTCC scripts/dtc/srcpos.o
HOSTCC scripts/mod/file2alias.o
HOSTCC scripts/mod/modpost.o
HOSTCC scripts/dtc/treesource.o
HOSTCC scripts/dtc/util.o
HOSTCC scripts/dtc/dtc-lexer.lex.o
HOSTCC scripts/mod/sumversion.o
HOSTCC scripts/dtc/dtc-parser.tab.o
GEN include/generated/asm-offsets.h
CALL scripts/checksyscalls.sh
HOSTLD scripts/dtc/dtc
HOSTLD scripts/mod/modpost
CC init/main.o
CHK include/generated/compile.h
CC init/do_mounts.o
CC init/do_mounts_md.o
CC init/do_mounts_initrd.o
CC init/initramfs.o
CC init/do_mounts_rd.o
HOSTCC usr/gen_init_cpio
CC arch/powerpc/kernel/cputable.o
UPD include/generated/compile.h
CC init/init_task.o
GEN usr/initramfs_data.cpio.gz
CC arch/powerpc/kernel/ptrace.o
CC init/version.o
CC arch/powerpc/kernel/syscalls.o
AS usr/initramfs_data.o
CC arch/powerpc/mm/fault.o
CC arch/powerpc/mm/mem.o
CC arch/powerpc/kernel/irq.o
LD usr/built-in.o
/home/nacc/op-build/output/host/usr/bin/powerpc64-buildroot-linux-gnu-ld: unrecognised emulation mode: elf64lppc
Supported emulations: elf64ppc elf32ppclinux elf32ppc elf32ppcsim
scripts/Makefile.build:336: recipe for target 'usr/built-in.o' failed
make[2]: *** [usr/built-in.o] Error 1
Makefile:929: recipe for target 'usr' failed
make[1]: *** [usr] Error 2
make[1]: *** Waiting for unfinished jobs....
CC arch/powerpc/mm/pgtable.o
CC arch/powerpc/kernel/align.o
CC arch/powerpc/mm/gup.o
LD init/mounts.o
/home/nacc/op-build/output/host/usr/bin/powerpc64-buildroot-linux-gnu-ld: unrecognised emulation mode: elf64lppc
Supported emulations: elf64ppc elf32ppclinux elf32ppc elf32ppcsim
scripts/Makefile.build:390: recipe for target 'init/mounts.o' failed
make[2]: *** [init/mounts.o] Error 1
Makefile:929: recipe for target 'init' failed
make[1]: *** [init] Error 2
CC arch/powerpc/mm/mmap.o
CC arch/powerpc/kernel/signal_32.o
CC arch/powerpc/mm/init_64.o
CC arch/powerpc/kernel/pmc.o
CC arch/powerpc/mm/pgtable_64.o
CC arch/powerpc/mm/hash_utils_64.o
CC arch/powerpc/kernel/vdso.o
CC arch/powerpc/kernel/process.o
AS arch/powerpc/mm/slb_low.o
CPP arch/powerpc/kernel/systbl_chk.i
CC arch/powerpc/kernel/idle.o
CC arch/powerpc/mm/slb.o
CC arch/powerpc/kernel/signal.o
CC arch/powerpc/mm/hash_native_64.o
CC arch/powerpc/kernel/sysfs.o
AS arch/powerpc/mm/hash_low_64.o
CC arch/powerpc/kernel/cacheinfo.o
CC arch/powerpc/kernel/time.o
CC arch/powerpc/mm/tlb_hash64.o
CC arch/powerpc/kernel/prom.o
CC arch/powerpc/mm/mmu_context_hash64.o
CC arch/powerpc/mm/numa.o
CC arch/powerpc/kernel/traps.o
CC arch/powerpc/mm/slice.o
CC arch/powerpc/kernel/setup-common.o
CC arch/powerpc/mm/hugetlbpage.o
CC arch/powerpc/kernel/udbg.o
AS arch/powerpc/kernel/misc.o
CC arch/powerpc/kernel/io.o
CC arch/powerpc/kernel/dma.o
AS arch/powerpc/kernel/misc_64.o
CC arch/powerpc/kernel/setup_64.o
CC arch/powerpc/kernel/sys_ppc32.o
LDS arch/powerpc/kernel/vdso64/vdso64.lds
VDSO64A arch/powerpc/kernel/vdso64/sigtramp.o
LD arch/powerpc/mm/built-in.o
VDSO64A arch/powerpc/kernel/vdso64/gettimeofday.o
VDSO64A arch/powerpc/kernel/vdso64/datapage.o
LDS arch/powerpc/kernel/vdso32/vdso32.lds
/home/nacc/op-build/output/host/usr/bin/powerpc64-buildroot-linux-gnu-ld: unrecognised emulation mode: elf64lppc
Supported emulations: elf64ppc elf32ppclinux elf32ppc elf32ppcsim
scripts/Makefile.build:336: recipe for target 'arch/powerpc/mm/built-in.o' failed
make[2]: *** [arch/powerpc/mm/built-in.o] Error 1
Makefile:929: recipe for target 'arch/powerpc/mm' failed
make[1]: *** [arch/powerpc/mm] Error 2
VDSO64A arch/powerpc/kernel/vdso64/cacheflush.o
CC arch/powerpc/kernel/signal_64.o
VDSO32A arch/powerpc/kernel/vdso32/sigtramp.o
CC arch/powerpc/kernel/ptrace32.o
VDSO32A arch/powerpc/kernel/vdso32/gettimeofday.o
VDSO64A arch/powerpc/kernel/vdso64/note.o
VDSO32A arch/powerpc/kernel/vdso32/datapage.o
VDSO64A arch/powerpc/kernel/vdso64/getcpu.o
CC arch/powerpc/kernel/paca.o
VDSO32A arch/powerpc/kernel/vdso32/cacheflush.o
CC arch/powerpc/kernel/nvram_64.o
VDSO64L arch/powerpc/kernel/vdso64/vdso64.so.dbg
VDSO32A arch/powerpc/kernel/vdso32/note.o
/home/nacc/op-build/output/host/usr/lib/gcc/powerpc64-buildroot-linux-gnu/4.8.3/../../../../powerpc64-buildroot-linux-gnu/bin/ld: unrecognised emulation mode: elf64lppc
Supported emulations: elf64ppc elf32ppclinux elf32ppc elf32ppcsim
collect2: error: ld returned 1 exit status
arch/powerpc/kernel/vdso64/Makefile:26: recipe for target 'arch/powerpc/kernel/vdso64/vdso64.so.dbg' failed
make[3]: *** [arch/powerpc/kernel/vdso64/vdso64.so.dbg] Error 1
scripts/Makefile.build:404: recipe for target 'arch/powerpc/kernel/vdso64' failed
make[2]: *** [arch/powerpc/kernel/vdso64] Error 2
make[2]: *** Waiting for unfinished jobs....
VDSO32A arch/powerpc/kernel/vdso32/getcpu.o
VDSO32L arch/powerpc/kernel/vdso32/vdso32.so.dbg
/home/nacc/op-build/output/host/usr/lib/gcc/powerpc64-buildroot-linux-gnu/4.8.3/../../../../powerpc64-buildroot-linux-gnu/bin/ld: unrecognised emulation mode: elf32lppclinux
Supported emulations: elf64ppc elf32ppclinux elf32ppc elf32ppcsim
collect2: error: ld returned 1 exit status
arch/powerpc/kernel/vdso32/Makefile:33: recipe for target 'arch/powerpc/kernel/vdso32/vdso32.so.dbg' failed
make[3]: *** [arch/powerpc/kernel/vdso32/vdso32.so.dbg] Error 1
scripts/Makefile.build:404: recipe for target 'arch/powerpc/kernel/vdso32' failed
make[2]: *** [arch/powerpc/kernel/vdso32] Error 2
Makefile:929: recipe for target 'arch/powerpc/kernel' failed
make[1]: *** [arch/powerpc/kernel] Error 2
make[1]: Leaving directory '/home/nacc/op-build/output/build/linux-d0ff068a9962ba96d4e6ddfba2a4e9fd8bc9a763'
package/pkg-generic.mk:177: recipe for target '/home/nacc/op-build/output/build/linux-d0ff068a9962ba96d4e6ddfba2a4e9fd8bc9a763/.stamp_built' failed
make: *** [/home/nacc/op-build/output/build/linux-d0ff068a9962ba96d4e6ddfba2a4e9fd8bc9a763/.stamp_built] Error 2
make: Leaving directory '/home/nacc/op-build/buildroot'

I've tried op-build clean, because it seems like the toolchain isn't getting rebuilt to support LE?

This is on an Ubuntu 15.04 x86_64 installation...

Include hostboot change Ie967d81917e9b942d5cb516856075ebdb5029487

Tracker issue for op-build v1.2 release.

attributeOverride is put into the wrong location.

attributeOverride ends up in output/host/usr/powerpc64-buildroot-linux-gnu/sysroot/hostboot_build_images/attributeOverride. We probably should put it under output/host/usr/bin since it is considered a 'host' tool once we've built it.

skiboot for op-build v1.3

Placeholder for skiboot update for op-build 1.3

Package download from github fails.

When running an op-build, the package downloads from github all fail. It appears that the URL format for github changed. We are working with the upstream buildroot team to come up with a solution.

Include hostboot change Ia4f6440551b4bb6d4a849d24290c19667f3a6c6b

Palmetto machines would error on boot due to older VPD format. Need to get a final version of this commit in so that we do not fail to boot on those systems.

Include hostboot change If8f08d1602b4437aa0e72e6d2e8d99ca615a2c77

Include open-power/hostboot@2114a66

Include open-power/hostboot@2114a66 into release.

Add ppc64_cpu to petitboot's rootfs.

Can we get the utility added to the rootfs that contains petitboot? It is useful to have the utility prior to installing a distro.

op-build is not compiling - Unable to checkout '49cbaa7e123e46f9f63e69883e29769b4dd0bc4a' in submodule path 'buildroot'

[andrewg@gfw169 op_0303-op-build]$ git clone --recursive [email protected]:open-power/op-build.git
Cloning into op-build...

remote: Counting objects: 844, done.
remote: Total 844 (delta 0), reused 0 (delta 0), pack-reused 843
Receiving objects: 100% (844/844), 270.07 KiB | 161 KiB/s, done.
Resolving deltas: 100% (481/481), done.
Submodule 'buildroot' (https://github.com/open-power/buildroot) registered for path 'buildroot'
Cloning into buildroot...
remote: Counting objects: 134955, done.
remote: Compressing objects: 100% (5/5), done.
remote: Total 134955 (delta 0), reused 0 (delta 0), pack-reused 134950
Receiving objects: 100% (134955/134955), 35.95 MiB | 494 KiB/s, done.
Resolving deltas: 100% (92439/92439), done.
fatal: reference is not a tree: 49cbaa7e123e46f9f63e69883e29769b4dd0bc4a
Unable to checkout '49cbaa7e123e46f9f63e69883e29769b4dd0bc4a' in submodule path 'buildroot'
[andrewg@gfw169 op_0303-op-build]$ cd op-build
[andrewg@gfw169 op-build]$ . op-build-env
[andrewg@gfw169 op-build]$ op-build palmetto_defconfig && op-build
make: Entering directory /esw/san2/andrewg/op_0303-op-build/op-build/buildroot' make: *** No rule to make targetpalmetto_defconfig'. Stop.

zlib fails to compile because sourceforge is down

Error:
--2015-07-17 10:33:13-- http://downloads.sourceforge.net/project/libpng/zlib/1.2.8/zlib-1.2.8.tar.xz
Resolving downloads.sourceforge.net (downloads.sourceforge.net)... 54.240.188.66, 54.230.70.184, 54.230.70.69, ...
Connecting to downloads.sourceforge.net (downloads.sourceforge.net)|54.240.188.66|:80... connected.
HTTP request sent, awaiting response... 302 Moved Temporarily
Location: http://downloads.sourceforge.net/#!/project/libpng/zlib/1.2.8/zlib-1.2.8.tar.xz [following]
--2015-07-17 10:33:13-- http://downloads.sourceforge.net/
Reusing existing connection to downloads.sourceforge.net:80.
HTTP request sent, awaiting response... 200 OK
Length: 639 [text/html]
Saving to: ‘/home/ijenkins/dev/op-build/dl/zlib-1.2.8.tar.xz.tmp’

100%[============================================================>] 639 --.-K/s in 0s

2015-07-17 10:33:13 (48.2 MB/s) - ‘/home/ijenkins/dev/op-build/dl/zlib-1.2.8.tar.xz.tmp’ saved [639/639]

zlib 1.2.8 Extracting
xzcat /home/ijenkins/dev/op-build/dl/zlib-1.2.8.tar.xz | tar --strip-components=1 -C /home/ijenkins/dev/op-build/output/build/zlib-1.2.8 -xf -
xzcat: /home/ijenkins/dev/op-build/dl/zlib-1.2.8.tar.xz: File format not recognized
tar: This does not look like a tar archive
tar: Exiting with failure status due to previous errors
make: *** [/home/ijenkins/dev/op-build/output/build/zlib-1.2.8/.stamp_extracted] Error 2
make: Leaving directory `/home/ijenkins/dev/op-build/buildroot'

If you look at the zlib file:
ijenkins@ares:~/dev/op-build$ cat /home/ijenkins/dev/op-build/dl/zlib-1.2.8.tar.xz

<title>SourceForge</title>
<!-- <script src="/js/jquery.com/jquery-1.11.0.min.js"></script> -->
<script src="//code.jquery.com/jquery-1.11.0.min.js"></script>
<script src="//sourceforge.net/js/mirrors.js"></script>
<script src="/js/sf.js"></script>
<script>
var DR_loc = DR_parse_hash_url();
if (DR_loc) {
    DR_sf_main(DR_loc);
} else {
    window.location.href = 'http://sourceforge.net/home.html';
}
</script>
</head><body>
<noscript>
We're sorry -- the Sourceforge site is currently in Disaster Recovery mode, and currently requires
the use of javascript to function.  Please check back later.
</noscript>
</body></html>

Maybe change the op-build to pull zlib from http://zlib.net/ instead of Sourceforge?

Update Firestone package.

https://github.com/open-power/op-build/commit/9ec3164e342b9ec9bfd2b98416085ffe7b60dbf3 broke garisson

As of 9ec3164 garisson_defconfig no longer builds. It did before this was merged

merge in any system specific attributes, hostboot attributes

creating the targeting binary

/home/jenkins/workspace/op-build-master-next/defconfig/garrison/label_exp/utopic/output/host/usr/powerpc64le-buildroot-linux-gnu/sysroot/hostboot_build_images/xmltohb.pl --hb-xml-file=/home/jenkins/workspace/op-build-master-next/defconfig/garrison/label_exp/utopic/output/host/usr/powerpc64le-buildroot-linux-gnu/sysroot/hostboot_build_images/temporary_hb.hb.xml --fapi-attributes-xml-file=/home/jenkins/workspace/op-build-master-next/defconfig/garrison/label_exp/utopic/output/host/usr/powerpc64le-buildroot-linux-gnu/sysroot/hostboot_build_images/fapiattrs.xml --src-output-dir=none --img-output-dir=/home/jenkins/workspace/op-build-master-next/defconfig/garrison/label_exp/utopic/output/host/usr/powerpc64le-buildroot-linux-gnu/sysroot/hostboot_build_images/ --vmm-consts-file=/home/jenkins/workspace/op-build-master-next/defconfig/garrison/label_exp/utopic/output/host/usr/powerpc64le-buildroot-linux-gnu/sysroot/hostboot_build_images/vmmconst.h --noshort-enums --bios-xml-file=/home/jenkins/workspace/op-build-master-next/defconfig/garrison/label_exp/utopic/output/host/usr/powerpc64le-buildroot-linux-gnu/sysroot/openpower_mrw_scratch/"GARRISON_bios.xml" --bios-schema-file=/home/jenkins/workspace/op-build-master-next/defconfig/garrison/label_exp/utopic/output/host/usr/powerpc64le-buildroot-linux-gnu/sysroot/hostboot_build_images/bios.xsd --bios-output-file=/home/jenkins/workspace/op-build-master-next/defconfig/garrison/label_exp/utopic/output/host/usr/powerpc64le-buildroot-linux-gnu/sysroot/hostboot_build_images/"garrison"_bios_metadata.xml
[FATAL!] Target instance "sys0" cannot override attribute "MSS_INTERLEAVE_ENABLE" unless the attribute has already been defined in the target type inheritance chain.
1: main::generateTargetingImage(5295)
2: (369)
package/pkg-generic.mk:177: recipe for target '/home/jenkins/workspace/op-build-master-next/defconfig/garrison/label_exp/utopic/output/build/garrison-xml-4410e63e97a388e156082d5bcb0325c0bbf670ad/.stamp_built' failed
make: *** [/home/jenkins/workspace/op-build-master-next/defconfig/garrison/label_exp/utopic/output/build/garrison-xml-4410e63e97a388e156082d5bcb0325c0bbf670ad/.stamp_built] Error 1
make: Leaving directory '/home/jenkins/workspace/op-build-master-next/defconfig/garrison/label_exp/utopic/buildroot'
Build step 'Execute shell' marked build as failure
Archiving artifacts
Finished: FAILURE