When we build packages, we want to know if something is wrong.
For now, only use it in the upgrade path, not sure how to
to distinguish if a user or the build system is running the
package build.