06:28 bdrewery 

Avoid running git and finding PORTSDIR/.git.

Reported by:	xmj

 

19:32 bdrewery 

- Update to 3.0-2584-g2c19d562

    - jail -x: Support 'native-xtools-install'

 

23:11 bdrewery 

Update to 3.0-2583-g7913a064

      - jail -x: Tell where native-xtools is being built
      - XDEV: Support the fixed native-xtools build target in FreeBSD head
        that builds from the Jail rather than the host system's /usr/src. [1]
      - Add XDEV_SRC_JAIL, if set will use the jail's source for xdev.  This
        should only be used in special cases and will effectively default to
        on for head and soon for stable/11.
      - Record flavor for port build results.
      - jail -c: Fix EMULATOR being unset if ran via poudriered
      - Assert EMULATOR is not empty on use
      - .poudriere.ports.queued: Store flavor for dependencies
      - jail -x: Respect MAKEOBJDIRPREFIX [2]
      - jail -c: Disallow using a colon (:) in jail name.

PR:	216083 [1]
PR:	215541 [2]

 

21:29 bdrewery 

Update to 3.0-2571-gf38f4778

    - image: Speed up tar creation by using 'xz -T 0'
    - FLAVORS: Default listed ports to main flavor only, @all to build all,
      bulk -a does all.
    - testport: Disallow testing @all
    - Support loading hooks from
POUDRIERED/hooks.d/plugins/<plugin-name>/<hook>.sh
    - Support a plugin make.conf at
POUDRIERED/hooks/plugins/<plugin-name>/make.conf
    - bulk -n: Fix 'Ports to build' list to only show what needs to be built.
    - Implement some new hooks for perf profiling
    - run_hook: Pass along logdir as LOG
    - gather_port_vars_ports: Show more information for debug SKIP message
    - gather_port_vars_port: Add verbose output about which flavors will be
expanded
    - bulk -n: Show log information at the end
    - Rename .poudriere.deps% to .poudriere.pkg_deps% based on its proper name
    - Store all_pkgs as .poudriere.all_pkgs%
    - QEMU: Allow overriding QEMU_{MAX_EXECUTION_TIME/NOHANG_TIME}

 

16:26 bdrewery 

- Update to 3.0-2548-g4bed266f

  - Fix FLAVORS assertion in compute_deps to properly show flavor
  - Add FLAVOR to a few job status outputs
  - Show origin for a FLAVOR assertion
  - Check for and error if
    'security.bsd.hardlink_check_uid' or 'security.bsd.hardlink_check_uid'
    are not set to '0' with BUILD_AS_NON_ROOT=yes to avoid staging errors

 

19:02 bdrewery 

Update to 3.0-2537-gf08534e1

     - testport + FLAVORS: Fix incorrectly calling the default flavor for
       dependencies duplicates
     - FLAVORS: Fix non-listed ports being deleted with -C and showing in
       queued list

 

21:48 bdrewery 

Update to 3.0-2535-gffbb8f83

      - Update to ptsort 1.20170904
      - Fix more issues with internal list parsing
      - testport: Fix time elapsed not showing in HTML listing.
      - HTML: Be backwards compatible with data without elapsed for built/failed
      - HTML: Fix queued ports list containing items not actually being built.
      - testport: Add some specific tests for broken port or missing PREFIX.
      - FLAVORS: Tweak exception to hint about unprovided FLAVORS.
      - jail: Add -C (for clean) option in order to clean poudriere data when
        deleting a jail
      - image: Fix tar image type

 

16:47 bdrewery 

Update to 3.0-2513-gaf851838

      -image: Update the firmware description in manpage
      - image: Clean up some grammar for image type
      - image: firmware: -s is required
      - image: For firmware, build an image that is actually the size we say it
               should be.
      - Detect invalid dependency lines
      - Fix kern.randompid / parallel pid reuse resulting in 100% CPU.
      - testport: Properly use BUILD_PARALLEL_JOBS (not PREPARE) for
        dependency building.
      - options: Honor the -p option
      - Add <tree>-<jailname> CUSTOMISATION support
      - options: if no jail is passed, the local host architecture is taken
      - options: Add arch -a option

 

15:32 bdrewery 

Update to 3.0-2483-gb25e919d

      image: Convert firmware to be like nanobsd with split partitions
      image: Use the same image for the second partition as a sort of backup
      image: Add /etc/save_cfg to the image
      bulk logs: Reduce execs by using port_var_fetch for -V lookups
      sh: Add mkfifo(1) builtin from FreeBSD head r314436
      sh: Add unlink(2) builtin and use for simple file removals
      Revert "Do not create a FS when '-m none'"
      Partially revert "Do not delete a ports tree created with method=none."
      ports -cF: Allow importing existing tree with -F
      ports -c: Don't destroy filesystem on error with -f none.
      ports: Add new method -m null for managing system ports trees.
      ports -d: Fixup various deletion cases.
      ports -cF: Allow specifying -m override with -F
      Link a jail/latest-done when done building.
      Don't show arrow when there's a timestamp.

 

17:11 bdrewery 

Update to 3.0-2457-g286a1577

   - jail -cu -m ftp: Fix jail and mounts lingering on failure.
   - QEMU: Clarify what is needed if qemu is missing

 

19:36 bdrewery 

Update to 3.0-2455-g5e3f50f8

   - jail -c -m ftp: Install QEMU before running freebsd-update if needed.
   - jail -m src: Support -x without -b
   - jail -m tar: Support -x
   - jail -m ftp/url/...: Support -x.
   - bulk: Handle jail -x hardlinking during startup now.
   - jail -x: Only build native-xtools if emulation will be required
   - ports -u: Fix portsnap msg having timestamp for 'done'
   - Fix inverted check which always failed for nested jails IPv4/IPv6
     addresses

 

00:44 bdrewery 

Update to 3.0-2440-gf6f4014f

  - jail -x: Add back a default for NXBDESTDIR for older base branches
  - testport/bulk -i: Fix not installing main package in jail.
  - bulk: Store build name in PACKAGES/.buildname
  - jail -cu -m ftp: Fix freebsd-update not being properly ran.
  - HTML: Don't show NaN:NaN:NaN for duration on older builds.
  - HTML Remaining: Hide table if there's no [more] data.
  - HTML Remaining: Hide find warnings from racing with clean.sh.
  - pkgclean: Remove packages from .building directory if it exists.
  - jail -u -m ftp: Don't run freebsd-update on unsupported branches.

 

17:18 bdrewery 

Update to 3.0-2421-gad5f2f92

  - Fix IGNORE support

 

17:12 bdrewery 

Update to 3.0-2420-g8e8894ba

  [Changes staged for 3.1.20]
   - jail -c: Do not create a filesystem with *-m none*
   - ports -c: Don't try removing a filesystem that was not created
   - pwait: Fix *kern.randompid* hangs
   - queue: Fix for sending commands to poudriered [not well supported]
   - jail -u: Don't run freebsd-update update for PRERELEASE, STABLE or CURRENT
     jails.
   - jail -c: Don't allow creating a jail when its mountpoint already exists
   - jail -c -m ftp: Avoid bad number comparison with '12-CURRENT'
   - XDEV: Attempt to link /usr/bin/makewhatis
   - sh: Update from FreeBSD head r319826
   - sh: Enable nofork for: clock, dirempty, realpath, rename, rmdir, mkdir,
     and mktemp
   - jail -u: Only run freebsd-install if needed
   - bulk CHECK_CHANGED_DEPS: Only run `ldconfig -r` once for the entire build
     rather than for every package.
   - poudriere: Allow _MAKEOBJDIRPREFIX_ from command environment.
   - poudriere: Force umask 022 and allow override with UMASK in poudriere.conf
   - Default RESOLV_CONF to host's /etc/resolv.conf
   - jail -k: Don't force having a portstree for cleanup
   - Fix MNAMELEN check consistency (2 different length paths were being used
     for calculations)
   - bulk -n: Fix .building directory sticking around on early exit.
   - Jails: Don't use allow.socket_af, allow.raw_sockets in the no-networking
     jail.
   - Nested jails:
     - Don't force allow.socket_af, allow.raw_sockets, allow.chflags,
       and allow.sysvipc
     - Check for and error if the follow flags are not enabled:
       - enforce_statfs=1, allow.mount, allow.mount.devfs, allow.mount.nullfs,
         and allow.mount.tmpfs
       - children.max is not properly exposed in a nested jail and so is not
         checked.
     - Fix trying to add loopback address in nested jail when there is none.
  [Changes staged for 3.2]
   - image:
     - Add to manpage
     - Require -t
     - Document new embedded type
   - HTML
     - Show remaining ports if HTML_TRACK_REMAINING is set to yes.
     - Show original queued ports
     - Show PKGNAME in builder/job table
     - Store and link dependency graph from 'Logs' dropdown.
     - Show time elapsed for built/failed ports.
   - Support src-env.conf
   - jail -m git: Support file://
   - Limited DEPENDS_ARGS support for py3 slave ports.
     - Export PACKAGE_BUILDING_FLAVORS to disable some seatbelt logic in ports.
     - This allows leaving the default Python version at 2 and having
       a port like net/tiny-network-utilities properly build with a default of
       3 and have its dependencies properly queued and built without using
       py3-* slave ports.
     - This support is disabled unless the default is set to 2.
     - Currently allows building "virtual" non-existent ports like
       textproc/py3-hexdump or textproc/py34-hexdump and having it build
       the expected version.  Note this support is disabled once FLAVORS
       is committed to Ports so expect it to change soon without any kind of
       MOVED entries.
   - FLAVORS support [experimental, needs documentation, syntax may change]
     - Queued origin like 'devel/libtrue' will build all available FLAVORS.
     - Queued origin like 'devel/libtrue@TRUTH' will only build the TRUTH
flavor.
     - Queued origin like 'devel/libtrue@-' will only build the first FLAVOR.
     - FLAVORS support requires ports advertises PORTS_FEATURES+=FLAVORS.
     - No support is currently committed in ports.
   - logclean:
     - Don't try building JSON when no files are found
     - Add -B to specify buildname
     - Document -z and -j
     - Don't run anything if there is no log directory
     - Recreate latest-per-pkg links at the end; avoid deleting all logdirs.
     - Stop trying to use /usr/local/bin/gawk
   - bulk:
     - -a: Speedup listed_ports after the first iteration
     - -n: No need to markfs prepkg
     - -C: When using -a this will now behave like the more optimal -c
     - startup: Fix some errors not being captured properly
     - -C: Delete packages found using xargs
     - -n: Optimize 'ports to build' output generation
     - Add some basic automated tests for FLAVORS dependency calculations
     - CHECK_CHANGED_DEPS: Some optimizations
     - Detect packages stuck in queue at startup
     - Validate ports have proper CATEGORIES set during build.
     - Warn on bad PKGNAME dependencies and make fatal with
       BAD_PKGNAME_DEPS_ARE_FATAL=yes
     - Add pkgrepo:sign hook right before calling pkg-repo.
     - Add a few more status / messages during startup
   - Align SIGINFO job status when there is no origin.
   - Show pkgname in a few more places for disambiguation.
   - Fix FORCE_COLORS/-A to actually work
   - Fix colors when using | timestamp.
   - Remove some leftover pkg_install support code for delete_pkg
   - poudriere: Allow FETCH_BIND_ADDRESS
   - poudriere: Fix populating git version in a worktree
   - Allow forcing mount hashing with FORCE_MOUNT_HASH
   - ports -u: Reduce redundancy in updating messages.
   - jail -cu: Show method rather than 'svn' or 'git'
   - Allow overriding git with GIT_CMD
   - zfs_getfs: Don't echo blank values from cache_call
   - Add support for file:/// URLs with git

 

17:21 bdrewery 

Update to 3.0-2145-gdc462a9d

  - pkgclean: -a now again keeps all known ports and -A removes all packages
  - pkgclean: No need to boost priorities, and fix overwriting
PACKAGES/.jailversion

 

15:54 bdrewery 

Update to 3.0-2143-gaae9d351

    - testport -v: Show dependencies like bulk does
    - ATOMIC_PACKAGE_REPOSITORY: Fix .jailversion not being symlinked
    - Show Poudriere's PKGENV/PORT_FLAGS in build log separately from
environment.
    - pkgclean: Fix zfs_getfs cache error on exit

 

16:22 bdrewery 

Update to 3.0-2123-ga663c9c4

    - jail -c (ftp): Fix 'mount: /compat: No such file or directory' warning
    - Fix order of jail/builder stop hooks on early exit.
    - jail -c -m svn/git: Store VCS revision separately from __FreeBSD_version.
    - jail -c -m svn/git/src: Use __FreeBSD_version rather than VCS for
      forced package rebuilds.
    - jail -c -m null/tar/src: Don't require a -v version since it can be
      determined automatically
    - jail -c -m src: Fix MAKE_JOBS not being used for installation
    - Update sh from FreeBSD head @ r318502
    - Store PACKAGE_BUILDING/FORCE_PACKAGE in make.conf to fix
      bulk/testport -i usage.
    - image: Use mdconfig for rawdisk

 

16:12 bdrewery 

Update to 3.0-2123-ga663c9c4.

  - Fixes build on GCC platforms by using -std=gnu99 for sh.

 

16:10 bdrewery 

Update to 3.0-2122-g47f45a0c

    - Raise 'package' phase timeout to 2 hours
    - image: Use makefs(2) to generate ufs2 disks
    - image: makefs use -s for size
    - HTML json top: Remove disconnected code
    - HTML json jail: Fix 'latest' not populating always.
    - pkgclean: Exit 0 if no packages are left to cleanup.
    - pkgclean: Fix -a to work properly
    - err: Don't show 'Error' if exiting 0
    - bulk/pkgclean: Don't allow specifying '' as a package
    - pkgclean -a: Remove pkg repository as well
    - pkgclean -a: Add a note about manually removing the PACKAGES directory
    - Don't fail if 'ulimit -a' fails somehow
    - LOCAL_MTREE_EXCLUDES: Add missing leading '.'
    - Update sh from FreeBSD head @ r317912
    - jail: Add -D option to keep git history
    - jail: Document -D option for jail creation

 

18:41 bdrewery 

Update to 3.0-2102-g58315dbf.

    - Fix ZFS rollback handling to create needed file for checking for race
      after a rollback.
    - pkg/dist/logclean: Make size calculation account for compressed ZFS
      datasets.

 

03:11 bdrewery 

Update to 3.0-2100-g2613baeb.

    - Add a 'logclean' command that cleans build logs older than N days, or
      builds over a certain count, by filter.
    - Store temp and lock files in $(mktemp -dt poudriere), and remove on exit.
    - Change SHASH_VAR_PATH out of umounting MASTERMNT on exit
    - USE_TMPFS=yes: extend to data as well as wrkdirs
    - JSON jail: Ignore broken builds rather than corrupting the data
    - HTML JSON: Fix not writing on exit, and writing to /.data.json[.mini]
    - blacklist: Fix loading of JAIL-SETNAME-blacklist
    - Don't bother statting or creating pkg cache dirs when deleting them at
startup.
    - pkgclean: Clean cache files as well
    - poudriere.8: Fix reference to native-xtools and document use of /usr/src
    - jail -d: Fix not cleaning up jail's temporary mountpoint directory
    - jail -uc: Don't leak host /etc/src-env.conf into jail builds
    - timestamp: Fix not exiting when stdin closes.
    - timestamp: Fix not properly handling newlines.
    - Fix umounting when using MDMFS
    - Make jail -k try harder to cleanup any messes left behind.

 

20:19 bdrewery 

Update to 3.0-2067-g6593db39.

    - Add an ALLOW_NETWORKING_PACKAGES to allow networking for select packages
    - testport: Support -B
    - Only load linux64 if the host is newer than ~10.2 Current that had it
    - Determine UMOUNT_NONBUSY at startup, which allows jail -k to benefit
    - jail cleanup: Fix only the first 2 builders cleaning sometimes on older
      systems.
    - build_pkg: Assert that rollbackfs worked
    - Rework ZFS rollback race fix by creating the file at markfs time.

 

18:15 bdrewery 

Update to 3.0-2048-gfb46d057.

    - Really fix testport -c to not look in /usr/ports.

Reported by:	mat

 

17:44 bdrewery 

Update to 3.0-2047-ge55e0387.

    - Actually install cache.sh
    - Fix very old bug with ZFS rollback not succeeding due to
      race with zfs rollback + zfs snapshot.
      https://www.illumos.org/issues/7600

 

17:24 bdrewery 

Forgot to install cache.sh, will fix soon

 

17:18 bdrewery 

Update to 3.0-2045-gc6b1c034.

    - bulk/status summaries: Fix build time being wildly wrong
    - MOVED: Convert to using shash
    - jail -u: Don't show /compat mount warning.
    - Automatically handle making some internal paths relative when
      doing 'cd'
    - Add a per-run caching mechanism for commands
    - Cache ZFS list (for mountpath) lookups.
    - jail -u, etc: Fix ZFS snapshots not being created after 33297b28f.
    - destroyfs: Avoid zfs_getfs() if not needed
    - testport: Support MOVED for main port being tested
    - locks: Disable INT/TERM traps while in here
    - HTML JSON is now generated with TERM delayed, meaning leftover tempfiles
      in the logdir should be fixed and the JSON should be more consistent.
    - poudriere: Allow -v to increase VERBOSE since not all sub-commands allow
it.
    - poudriere: Allow -A to force colors, even if not in a TTY
    - HTML JSON: Use relative paths for reading/writing files in logdirs
    - prefix_output: Append into proctitle to make debugging simpler
    - testport -c: Fix after 88334520d1159.
    - Introduce HTML_TYPE to select if HTML files are inline or hosted

 

19:38 bdrewery 

Update to 3.0-2007-g2c59e4c7.

    - Rewrite parsing of 'bulk -f' and 'bulk PORT1 PORT2' (and testport)
      handling of ports into the queue.
    - Update sh to FreeBSD head r315005.
    - compute_deps_pkg: Give a hint about failed pooldir creation being from
      duplicates.  This is still undergoing further changes.  It's technically
      an assertion still that is has proven to be possible.
    - Support copying a static ccache into the jail with CCACHE_STATIC_PREFIX.
      This is to support using something like devel/ccache-memcached-static
      in the jail to support memccached without any bootstrap or cyclic
      dependency problems.

 

02:04 bdrewery 

Update to 3.0-2002-gf74f5e60.

   - Fix spurious SIGALRM on poudriere processes.
   - Add a LOCAL_MTREE_EXCLUDES to allow appending to the list of directories
     to ignore in the mtree checks.
   - Document RESTRICT_NETWORKING

 

04:46 bdrewery 

Update to 3.0-1994-g605f6348

    - Fix regression from last build not causing ZFS+USE_TMPFS=all to
      rollback to the clean snapshot before cloning.
    - Fix mktemp using TMPDIR='' by default (thus /).  This broke
      some non-root operations.
    - options: Fix harmless warning about missing 'arch' file.
    - Fix very old crash with SIGINFO while cleaning the queue after
      a port is done building.
    - Revert a change for port statistics changes which may have resulted in
      warnings such as:
          mv: rename
/usr/local/poudriere/data/logs/bulk/103i386-default/434652/.tmp..poudriere.stats_ignored
to
/usr/local/poudriere/data/logs/bulk/103i386-default/434652/.poudriere.stats_ignored:
No such file or directory
      Note that the change here does not restore ignoring errors like
      the previous code did.  So some odd crashes may occur, but all
      callers of this code were audited and should be ignoring the
      error anyhow.

 

22:07 bdrewery 

Update to 3.0-1987-g33297b28.

   - Just a small optimization to not run 'zfs list' in the USE_TMPFS=all case.

 

21:57 bdrewery 

Update to 3.0-1986-gdbc2cc63.

  - Fix build on <head
  - Fix startup depqueue errors if the listed ports have duplicates.
  - Fix NO_ZFS/USE_TMPFS=all jail cloning error:
    [00:00:00] ====>> Creating the reference jail...realpath: Illegal option -r
  - NO_ZFS now overrides existing ZFS datasets; ZFS won't be used at all if
    NO_ZFS is set.
  - ZFS datasets are now looked up with 'zfs list' rather than 'mount -t zfs',
    which fixes some cases of ZFS datasets being left around after an error.

 

17:06 bdrewery 

- Insert the PKGVERSION into POUDRIERE_VERSION.
  This will aid in debugging rather than having something like '3.2-pre'
  which does not indicate which actual version of poudriere was used.

 

16:47 bdrewery 

Update to 3.0-1974-g9dd8a906

    - Properly ignore /proc without invoking pseudofs kernel code.
    - mtree: Remove exclusion of /usr/home
    - mtree: Remove exclusion of .p4config
    - mtree: Restore ignoring /var/tmp in prebuild/prestage.
    - mtree: Don't descend into /dev, avoiding devfs_readdir, etc.
    - mtree: Avoid descending into all directories.
    - gather_distfiles: Use port_var_fetch to lessen needed make executions
    - sh: Make touch a builtin
    - Fix commit c0daac2f: /dev/null is a special character device, not
directory.
    - pwait builtin: Properly restore SIGALRM on exit

 

04:45 bdrewery 

Update to 3.0-1957-gb3d3e0c2

    - pkgclean/distclean: Properly support PREPARE_PARALLEL_JOBS from
      poudriere.conf
    - Default PREPARE_PARALLEL_JOBS to 1.25*PARALLEL_JOBS
    - Poudriere now sets process title for some operations via setproctitle(2).
    - Dependency calculation majorly refactored to fetch more make variables
      at once rather than fetching some and then more later.  This rework also
      speeds up some startups by up to 60% by keeping the compute_deps work
      queue full and more parallelized.  This is especially seen in meta
      port lists.  The storage for the make variables fetched is not very
      efficient yet and will improve more in the future.
    - Add more sh builtins: pwait, mkdir, rename, setproctitle, rmdir, mktemp
    - nohang: Do read before logfile comparison.
    - update_stats: Stop building from html_json coproc after done building
    - More work to use relative paths, thus reducing namecache contention.
    - rm is bundled if the base system version does not support rm -x.
    - Determine at runtime if umount -n (MNT_NONBUSY) is supported
    - buildlog: Properly show limits in jail
    - The "balance_pool" operation after a port is done building is now
      asynchronous.
    - Fix some cases where stats were not updated on early exit.
    - Detect race during jail startup; prevent multiple concurrent jail
      startups for the same jail+set+portstree.
    - Some unexpected older packages may be deleted during startup.
    - bulk: Change dependency information to -v rather than -vv
    - Limit parallel umounts if batched free vnode lists not supported.
    - Only fetch LIB/RUN_DEPENDS and OPTIONS if the CHECK_CHANGED_DEPS/OPTIONS
      is set
    - Add some missing license headers in HTML code.
    - run_hook: cd to / before running hook to avoid umount problems.
    - Pass -DNOCLEANDEPENDS when cleaning to not clean dependency dirs.
    - Slightly reword some of the port job statuses.
    - api: Allow evalling from stdin
    - Move /var/db/freebsd-update exemption into common_mtree.
    - More tests added
    - Fix PORTBUILD_UID lookup when user doesn't exist in jail.
    - configure: Don't prefer GCC (poudriere build only)

 

20:35 bdrewery 

Restore 'umount -f' usage for now as older releases do not support 'umount -n'.

A better fix will be coming soon.

Reported by:	ohauer

 

20:30 bdrewery 

Mark BROKEN due to 'umount -n' being unsupported.

This is in the cleanup code, let's not cause problems for
people as I get it fixed.

 

18:21 bdrewery 

Update to 3.0-1822-ge8f0d3e

   - Manpage updates
   - Remove pkg_install support.
   - Remove NO_STAGE support.
   - Remove use of umount -f where possible.
   - Use relative paths where possible to avoid namecache contention.
   - USE_CACHED reworked to use POSIX mq (will soon change again)
   - PRIORITY_BOOST is fixed to boost dependencies as well now with
     USE_PTSORT enabled (default yes).
   - Load linux64 when needed
   - Improved ports_env support (less executions during ports interations)
   - Show resource limits in build log
   - Limit filedescriptors to 1024 by default with MAX_FILES
   - Shutdown/unmount build jails in parallel
   - Don't leak mount path in build log from ident(1)
   - sh: Add some builtins to avoid fork/execs (mostly poudriere C helpers):
     cachec, clock_monotonic, date +%s, dirempty, locked_mkdir, realpath,
     sleep
   - BUILD_AS_NON_ROOT: Remove redundant chown -R.
   - Add HTML_JSON_UPDATE_INTERVAL (def: 2) to allow overriding JSON update
     interval.
   - Add support for USE_TMPFS=no
   - jail: install the kernel requested with -K when using src method
   - jail -c -m src: Add support for building the src tree with -b.
   - jail -u -m src: Update the version for the jail as well.
   - jail -c: Allow @rev for releng/X.Y branch
   - jail: Switch to http protocol for ftp-archive.
   - ports: Do not create a FS when '-m none'
   - ports -d: Do not delete a ports tree created with method=none or -.
   - ports -d: Confirm if in a TTY
   - ports -d: Really delete the zfs dataset when TMPFS_ALL is used
   - ports: Add git+http support
   - ports/jail: Auto pass PROXY env vars from parent environment
   - image: only isos have a restriction in the image name
   - image: If the images dir does not exist, attempt to create it
   - image: Handle a relative path with -o
   - image: Various fixes.
   - image: usb|*firmware|rawdisk now require a kernel and image size.
   - testport: Fix fdescfs/procfs/linprocfs not being mounted.
   - testport: Fix limits not being applied
   - testport+SIGINFO: Fix very old deadlock with update_stats.
   - pkgclean: Add hook: pkgclean done <DELETED_FILES: 0|1> <BUILT_REPO: 0|1>
   - pkgclean: Cleanup corrupt packages
   - pkgclean: Act on .latest directory for ATOMIC_PACKAGE_REPOSITORY
   - poudriere.conf: Don't suggest changing svn.FreeBSD.org to a mirror anymore.
   - QEMU+Arm64: Coppy the latest aarch64-binutils ld into the jail at startup.
   - QEMU+Arm64: Link /usr/bin/ld to /nxb-bin/usr/bin/ld.
   - QEMU+Arm64: Tell about copying ld
   * QEMU+Arm64: Note that this is not working properly yet due to the
     aarch64-binutils port not providing a static ld.
   - options: Properly setup ARCH/MACHINE in make.conf for cross-builds

 

16:43 bdrewery 

Fix building arm64 jails by copying in the needed binutils.

 

23:37 bdrewery 

Move the release MANIFESTS to misc/freebsd-release-manifests.

Also add a dependency for ca_root_nss to Poudriere.

 

15:53 bdrewery 

Fix debugging that crept in

 

15:51 bdrewery 

- Update to 3.0-1677-g146fc3f

  - Support 252 colors for job IDs
  - Ensure bmake is used for ports_env (fixes usage for 9.x)
  - Fix creating /nxb-bin in the root system

 

22:11 bdrewery 

- Update to checkin 3.0-1669-g5d15cfe

Changes:
 - jail -c: Fix fetching for 11.0-ALPHA

 

22:36 bdrewery 

- Update to checkin 3.0-1668-g5880c23

Changes:
  - jail: Fix usage for -m src=PATH
  - jail -v: Note that non-listed methods used the value only for display.
  - QEMU: Copy the latest emulator into the jail at startup. This fixes
    the jail running into bugs with qemu that are fixed with the latest
    qemu.  It was only copying it in during creation before.
  - bulk: Avoid redundant cleaning message with jailversion cleanup.
  - Add and document PORTBUILD_UID and CCACHE_DIR_NON_ROOT_SAFE. [1]

PR:		209786 [1]

 

22:31 bdrewery 

- Update to 3.0-1663-gf6c1bad

Changes:
 - Tweak ccache+BUILD_AS_NON_ROOT so that BUILD_AS_NON_ROOT is just default
   off, with a warning, when CCACHE_DIR is set.

PR:		209786

 

16:47 bdrewery 

- Update to 3.0-1662-gc11d922

Changes:
 - Fix incorrect handling of null-mounting /nxb-bin in jail
 - Disable BUILD_AS_NON_ROOT if CCACHE_DIR is set [1]
 - Fix mount path too long when using linprocfs

PR:		209786 [1]

 

18:49 bdrewery 

- Update to 3.0-1659-gfdf5930

Changes:
  - Fix build on < 10.0.

PR:		209656
Reported by:	vas@mpeks.tomsk.su

 

17:45 bdrewery 

- Update to 3.0-1658-g99b3286

Changes:
  - Hide warnings when cleaning up schg files.

 

22:59 bdrewery 

- Update to 3.0-1657-g0b204f0

Changes:
  - jail/ports -u: Default git pull to use --rebase.
  - destroyfs: Run chflags -R 0 and on a smaller subset of files.
  - ports: Ignore failures when removing the ports tree
  - jail: Ignore errors trying to remove the jail
  - Create port-specific directories in do_portbuild_mounts.
  - Rework the cleanup to respect -x inside of the directory.
  - Support -(j|p|z)<param> without space for poudriere.conf lookups
  - hash_var_name: Quote the pattern to _gsub to avoid globbing local files.
  - Update sh from head @ r296813
  - Switch BUILD_AS_NON_ROOT as default to on.

 

14:16 mat 

Remove ${PORTSDIR}/ from dependencies, categories m, n, o, and p.

With hat:	portmgr
Sponsored by:	Absolight

 

17:01 bdrewery 

- Update to 3.0-1641-gf976ae1

Changes:
   - Fix error starting up when jail contains ':' (or other special characters)

 

00:14 bdrewery 

- Update to 3.0-1639-ga5325bf

Changes:
  - Optimize jail startup/cloning/rollback and mtree comparisons.
  - api: Make more useful
  - check_fs_violation: Use mktemp rather than hard-coded tmpfile
  - Fix false-positive 'Leftover processes' warning after disabling jexecd
  - Conditionalize the jexec logic around USE_JEXECD and add back missing
jkills.
  - QEMU: Remove _MAKE_JOBS not present in release-3.1 and noted to break
    builds by sbruno
  - Kill processes before remounting/rolling back the builder FS, rather than
    after.
  - jail -c: Support older FREEBSD_HOST=ftp.freebsd.org URL schemes still. [1]
  - jail -c: Support pre-distributed MANIFESTs for checksum comparing.

PR:		206848 [1]

 

00:07 bdrewery 

Enable ZSH option by default

 

19:56 bdrewery 

- Update to 3.0-1609-g7147a70

Changes:
 - jail -c: Always copy in QEMU emulator, even if not building from src.
 - jail -c: Ensure MANIFEST is not empty or give an error.
 - Clear CMD_ENV to disallow sneaking in environment vars
 - Update libnv to the latest head @ r293361
 - Update sh from head @ r293359
 - Null-mount read-only /rescue and /nxb-bin into the jails as they will not
   change.
 - Add a MUTABLE_BASE option (default yes) to experiment with null-mounting of
   base.
 - Prefer https://download.FreeBSD.org for snapshot downloads from FreeBSD.
 - Remove duplicate NM from make.nxb.conf.

 

12:50 bapt 

Fix default svn url for ports

Reported by:	many
Pointy hat:	bapt

 

16:42 bdrewery 

- Update to 3.0-1596-g9dc9ca4

Changes:
  - jail -d: If stdin is a TTY, confirm before removing jail.
  - Disable rexec/jexecd for now as it has issues on <head and seems racy on
    head as well, possibly leading to "Unable to execute id(1) in jail."
  - QEMU: Use host pkg-static in the jail for repo to speed it up.  For
    this PKG_REPO_FROM_HOST=yes may be needed on mips.

 

17:26 bdrewery 

Revert usage of -x for rm(1) for now due to 9.x not having it.

 

17:27 bdrewery 

- Update to master branch checkin 1e0fd46149f9e17e12dadcdd0a28ef40b06587aa

This brings in almost a year of updates that had been held back.

Changes: https://github.com/freebsd/poudriere/wiki/release_notes_32

  - New sub-command 'image' which is still in development, for generating
    install images.
  - Some poudriered fixes, but it is still experimental.
  - DISTFILES_CACHES may be 'no' to use distfiles/ from ports tree.
  - A cache daemon has been added in, off by default, for experimentation.
  - The ports 'environment' feature from
Mk/Scripts/functions.sh:export_ports_env
    is used for dependency gathering now, which avoids 8 or so fork/execs for
    every make -V call.

  jail:
    - New -K [KERNCONF] flag to build and install a kernel into the jail.
    - New -S <path> flag to specify what srcpath to use from the master jail,
      rather than /usr/src.
    - Git support.
    - New -U flag to specify what url to fetch from for git and svn.
    - EXTRA_DISTS added to add to the distribution list fetched/extracted, from
      poudriere.conf.
    - NO_LIB32 added, when set to 'yes' skips installing lib32 distribution.

  ports:
    - Support '-m none' to disable portsnap usage.
    - New -U flag to specify what url to fetch from for git and svn.

  Build process handling:
    - A jexecd process is spawned in the jail and communicated with via rexec
      using a pipe.  This is intended to lessen the jail locking contention,
      allow more easily cleaning up processes, and limiting of TTY.  It is
      still considered experimental.

 

17:29 bdrewery 

Update to 3.1.9-30-g47b14b7

Changes:
  - Fix 'builder stop' hook, which never worked.
  - Don't transcend mount directories when running rm -rf
  - Stop exporting MY_JOBID
  - Run 'builder stop' hook always in stop_builder() [this means the hook
    runs at startup as well to clean out stale builders].
  - Enable post-mount jail hooks.

 

17:14 bdrewery 

Update to 3.1.9-22-ga91b224.

Unless something major is wrong here, this will be 3.1.10 and the next update
to -devel *will be* master which has a year of pending updates.

Changes:
  -Always call make by absolute path of /usr/bin/make.
  -Update stale comment about MFS
  -Fun things happen with /nonexistent exists. Ensure it doesn't.
  -testport: Allow -o to be optional.
  -Mark poudriere-queue experimental.
  -Using ccache on 10+ is fine so long as we use a PATH.
  -XDEV: Don't endlessly append to make.conf on updates.
  -Fix leftover lock file in /tmp at cleanup
  -Support in-tree ccache for buildworld on recent head
  -Always use the FAST_DEPEND option for buildworld.
  -Go crazy, use -j for installworld targets on recent head
  -Allow comments on the same line with port entries in blacklist

 

21:06 bdrewery 

- Update to 3.1.9

Changes: https://github.com/freebsd/poudriere/wiki/release_notes_319

  - Fix handling of ports dependencies without a PORTSDIR
  - jail -c: Fix fetching when TARGET does not match TARGET_ARCH

 

15:48 bdrewery 

- Update to 3.1.7-54-g6b5b90c

Changes:
  - Fix cases where /var/db/freebsd-update was not being ignored.
  - Fix crash from 'make showconfig'

 

23:35 bdrewery 

- Update to 3.1.7-52-g1988cd4

Changes:
  - Support new pkg bootstrap PUBKEY signature format.

PR:		202622

 

17:52 bdrewery 

Update to 3.1.7-51-ga3fb251

Changes:
  - Remove old references to the fossil site and point to github.
  - options: Override LOCALBASE to prevent pollution from
    LOCALBASE/etc/perl5_version. Also use which(1) to find
    some helper tools.
  - Avoid SIGINFO crash in startup

As long as this is stable, this will be release as 3.1.8. The next update will
then be an update from master, holding the 3.2 code.

 

23:06 bdrewery 

- Update to 3.1.7-41-gb7d0543

Changes:
  - bulk -c: Restore previous behavior with log deletion. Don't wipe out ALL
             logs, only delete the ones for the given build. This change
             almost inadvertently wiped out all logs and violates POLA at
             this point.
  - bulk -c: Fix it, it wouldn't start.
  - Misc cleanups

 

19:45 bdrewery 

- Update to 3.1.7-34-g1c90084

Changes:
  - jail: check the directory for method src=
  - csup has been deorbited from the project
  - Test to make sure $SVN_CMD is actually set before trying to use it.
    Improve test and error message for detecting if svn is installed.
  - jail -x: Run native-xtools from /usr/src for now.
  - Remove EOL 8.3 support
  - Run 'jail start' hook before any 'make' commands.
  - jail -m src: Fix handling of cross-compile by setting proper
TARGET/TARGET_ARCH
  - Remove use of SVN mirrors.
  - Fix need_emulation to only check TARGET_ARCH against kern.supported_archs.
  - Let KEEP_OLD_PACKAGES work on 9.x/8.4 with sort(1) lacking -V [1]
  - Fix typo in poudriere.8
  - Correct typo in poudriere -p help output

PR:		193732 [1]

 

20:37 bdrewery 

Update to 3.1.7-15-ge84bac5.

I had intended to update this to master but have not yet fixed a blocking
bug on it.

Changes:
  - status -a: Fix handling of showing older builds.
  - QEMU: Add a hack to raise the default build times.
  - Don't crash starting up a job, or otherwise, if the time goes backwards.
  - blacklist: Fix loading of JAIL-SETNAME-blacklist
  - QEMU: Always try loading a qemu-blacklist file
  - Add a helper 'clock_monotonic' to use clock_gettime(CLOCK_MONOTONIC)
    rather than non-monotonic 'date +%s'
  - Use monotonic time for calculating durations
  - Add a build.started epoch time.
  - Add a build.ended epoch time that is set in the last HTML json generation.
  - Update sh to FreeBSD r281982
  - Fix build on older FreeBSD due to sh. If F_DUPFD_CLOEXEC is unavailable
    then use system sh.
  - Ignore /var/db/freebsd-update/ too.

 

14:44 bdrewery 

Update to 3.1.7

Changes: https://github.com/freebsd/poudriere/wiki/release_notes_317
 - Restore /usr/sbin and /sbin to PATH lost in 3.1.5
 - HTML: Fix broken log link from 3.1.5
 - Avoid copying /var/db/freebsd-update into build jails
 - QEMU: Fix handling of elftoolchain install for older src checkouts.

 

15:57 bdrewery 

Update to 3.1.6

Changes:
  - jail -m src: Fix asking about removing files. This was a bug in 3.1.0. The
    fix came in right after 3.1.5 release.

 

14:03 bdrewery 

Update to 3.1.5

Changes: https://github.com/freebsd/poudriere/wiki/release_notes_315

 

17:25 bdrewery 

Update to 3.1.4-71-g652abb7

Changes:
  - Fix running poudriere in a jail due to lack of procctl(2) access.

 

05:39 bdrewery 

Update to 3.1.4-70-gea2537e

Changes:
  - Fix testport -o for invalid origins.
  - HTML open tag fixes
  - Fix temporary file creation causing bad 'mv: fastcopy' warnings about
    JSON files.

 

17:27 bdrewery 

No need for bsd.port.options.mk now

 

16:18 bdrewery 

Update to 3.1.4-62-g431268b

Changes:
  Fix building of HTML json files / an occasional 'mv: fastcopy:' warning.

 

18:24 bdrewery 

Remove my accidentally committed test for r384436

 

18:20 bdrewery 

Update to 3.1.4-61-g2259889

Changes:
  Support STRICT_DEPENDS.

 

17:01 bdrewery 

Update to 3.1.4-60-ga6e4d2b

Changes:
  Fix build with 8.4.

 

16:34 bdrewery 

Update to 3.1.4-58-gd237819

Changes:
    Fix not setting proper UNAME_m/p for powerpc64 cross build
    Fix qemu builds not setting MACHINE/MARCHINE_ARCH in make.conf
    QEMU: No need to set MACHINE/MACHINE_ARCH in env.
    QEMU: For consistency set UNAME_m/p in jail's login.conf.
    Don't let balance_pool() failure crash a builder.
    Avoid double ln(1) when called in a clean_pool/stop_build failure from
build_pkg
    When a build crashes and does not complete, properly cleanup its builder
jail.
    bulk queue optimizations
    Call pkg_cache_data in a separate worker. This allows build_pkg() to finish
quicker.
    bulk -t/testport: Fix the first package built in a jail not showing its
needed shared libraries.
    Disable 'set -x' in some noisy functions
    Rewrite lock_acquire() to not spam 'sleep 0.1'
    SIGINFO: Disable trap when erroring, exiting or in other traps
    SIGINFO: Don't allow running twice, and ignore errors.
    SIGINFO: Hide html_json's sleep(1) SIGINFO output
    Allow TMPFS_DATA to be used for builders too.
    Always protect(1) poudriere and its coprocesses from OOM killer.
    Create temporary files in [MASTER]MNT/.p/tmp when possible rather than /tmp
    Don't ignore SIGINT in bg processes. This should fix cpdup spam on ^C during
cloning.
    Fix some interleaved messages during parallel processing.
    Rework stderr prefixer for parallel jobs.
    Don't show 2 errors when failing to get PKGNAME.
    Import and prefer /bin/sh from FreeBSD r281718. This simplifies
compatibility and allows job control.

 

01:54 bdrewery 

Update to 3.1.3-7-g07740a0

Changes:
  - Run ldconfig -m (/etc/rc.d/ldconfig) on jail startup rather than
    jail creation.

 

18:55 bdrewery 

Update to 3.1.3-6-g784f9aa

Changes:
  - jail -cx: Fix incorrect hard linking.
  - Support building powerpc from powerpc64 without qemu.
  - Document that '.' is not allowed in -jzp
  - jail_start: Enforce no '.' in -jzp.

 

04:45 bdrewery 

Update to 3.1.3

Changes:
  - Fix deleting jails when using NO_ZFS/TMPFS_ALL is used.

 

17:12 bdrewery 

Update to 3.1.2

Changes:
  - HTML: Fix JS error processing data.status by improving compatibilty with
    older JSON files.

 

01:59 bdrewery 

Update to 3.1.1-42-g77fcbdb

Changes:
  - jail -u: Fix freebsd-update caring about host `sysctl kern.bootfile`

 

22:03 bdrewery 

Update to 3.1.1-41-g00ae908

Changes:
  - Fix 'cp: File Exists' and 'identical (not copied)' errors
  - jail -u: Fix freebsd-update for EOL and non-TTY usage
  - ATOMIC_PACKAGE_REPOSITORY: Fix crash if user removes the dir .latest
    refers to

 

05:30 bdrewery 

Update to 3.1.1-36-g2c5e0ca

Changes:
  - jail -i: Show 'fs' and 'mnt' values
  - Fix ZFS not rolling back the jail to clean when using TMPFS

 

21:17 bdrewery 

- Update to 3.1.1-34-g9b5d330

This fixes a realpath warning from all poudriere commands.

 

21:08 bdrewery 

Actually there is a harmless warning only.

 

21:05 bdrewery 

Block this for now as it is not actually running now.

 

19:29 bdrewery 

- Update to 3.1.1-33-gbf2a55b
  (I decided to use 'git-describe --tags' now that USE_GITHUB supports it)

Changes:
 - Allow overriding jail params with JAIL_PARAMS
 - Remove old nxb-bin directory if needed.
 - Fix more cases of running from local checkout
 - Allow all COLOR variables to be overridden in poudriere.conf.
 - testport -c is fixed
 - bulk now creates a copy of /var/db/ports to avoid breakage if the
   directory in /usr/local/etc/poudriere.d/options is touched during a build.
 - XDEV: Remove /bin/sh /bin/csh from the static hardlink list on mips/mips64
   as there are endian issues to work out.

 

20:07 bdrewery 

For the new USE_GITHUB with only GH_TAGNAME set default DISTNAME to
include GH_PROJECT/GH_ACCOUNT/GH_TAGNAME. This prevents the distfile
having the same name despite changing one of these values and causing
a bad checksum.

Differential Revision:	https://reviews.freebsd.org/D2103
Reviewed by:	mat
With hat:	bdrewery

 

17:52 bdrewery 

Update to checkin 54183f5f

Changes:
  - When using TMPFS_LOCALBASE (TMPFS_ALL) always try to clone the ref
    jail's LOCALBASE to the builder jail on port build startups. There
    is an optimization to not do this but it is needed for 'jail start'
    hooks that want to customize LOCALBASE. It normally will be a NOP.

 

16:55 bdrewery 

Convert to new USE_GITHUB

 

15:45 bdrewery 

Update to checkin 80b7167

Changes:
  - Clean up language of the zsh completion for bulk -c and -C.
  - Manpage fixes
  - jail: Fix handling of games distribution for recent CURRENT.
  - testport: Show error when unable to extract pkg
  - jail -uc: Support a SETNAME-src.conf
  - Add 'builder' start/stop hook. Params: id mnt
  - Add a check to see if id(1) works in the jail.
  - HTML: Show proper percentage in progress bar.
  - Fix creating cpdup ignore files in jail if cpdup is not used (ZFS).
  - Cross-building updates

 

17:33 amdmi3 

- Add missing EXAMPLES option

PR:		196244
Submitted by:	amdmi3
Approved by:	bdrewery (maintainer)

 

17:15 bdrewery 

- Update to 3.1.1 which fixes pkg(8) crashing in 8.4 jails.
  8.4 jails should be recreated if created with Poudriere 3.1 or
  poudriere-devel-3.0.99.20141117.

 

00:03 bdrewery 

- Update to 3.1.0

No changes are in this from RC3.

 

14:55 bdrewery 

- Update to 3.1-RC3

Changes:

 * Qemu fixes
 * pkgclean -f fix
 * Support creating jails from projects/ branch.

 

16:33 bdrewery 

- Update to checkin e3445da which is 3.1-RC2

Changes:
  * Fix pkgclean -f after recent cwd changes
  * Fix for native-xdev login.conf support

 

20:15 bdrewery 

- Update to checkin 7851588, which is 3.1-RC1

  See https://github.com/freebsd/poudriere/wiki/release_notes_31 for Release
  Notes.

 

17:11 bdrewery 

- Update to checkin 8d28349

  The next update will be 3.1-RC1.

Changes:
  * The HTML interface is now fixed for file:// and direct access. This
    currently only works for the build directory. The jail-level and top-level
    do not yet work, but may in the future.
  * Fix usage over NFS when root does not have access to current directory.
  * Fix performance for qemu/native-xdev by not using /bin/sh for pkg(8)'s
    ABI_FILE

 

19:04 bdrewery 

Update to checkin d2f5c83

Changes:
  * Minor display fixes
  * poudriered cleanups
  * ports -l: Support -n like jail
  * Add a 'jail stop' hook called right before jail is shutdown
  * Auto fix shadowed files in repository that are owned by pkg(8)
  * jail -cx: TARGET/TARGET_ARCH fixes