summaryrefslogtreecommitdiffstats
path: root/Tools
Commit message (Collapse)AuthorAgeFilesLines
...
* Add support for "PORTREVISION?=" and "PORTEPOCH"edwin2008-06-061-52/+62
| | | | Tested on: devel/gettext bump
* Rewrite this to make it more efficient (fewer external commandkris2008-06-021-138/+181
| | | | | | | invocations). It also fixes some edge cases that were not handled in the previous version. TODO: Correctly report IPv6 sockets (already in use by the sparc64 build)
* Remove support for FreeBSD 5.xerwin2008-06-011-21/+1
|
* Remove the force file, if it was used.linimon2008-05-291-0/+1
| | | | Forgotten by: linimon
* Add a force function here, just like processlogs.linimon2008-05-291-1/+1
|
* Add a note that processonelog and processlogs2 are finicky about thelinimon2008-05-291-0/+1
| | | | header format of the log files.
* Fix these after the 1.31 update to buildscript.linimon2008-05-292-5/+7
| | | | Forgotten by: pav
* Rewrite this in python instead of shell. Because we can read thekris2008-05-251-39/+55
| | | | | INDEX once and process internally instead of invoking many external utilities, runtime is improved from ~20 minutes to <10 seconds.
* NNew build scheduler written in python to replace the make+sh jobkris2008-05-102-0/+1040
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | ordering, which had become too limited. We now build packages ordered by those that are part of the longest dependency chains first. This has the effect of building the deepest parts of the tree first and levelling out the tree height, hopefully avoiding the situation we currently face where there appear bottlenecks late in the build where the cluster becomes mostly idle while waiting for a few long dependency chains to finish building before the cluster can become fully loaded again. The algorithm is that we sort the list of remaining packages according to height (longest dependency chain), then add leaf packages from each in order until we have filled a queue of length between 100 and 200, to amortise the cost of this queue rebalancing while not losing the height averaging property. Jobs are dispatched from this queue into worker threads as machine slots become available. Unlike the make-based solution that required a fixed -j concurrency value and could not respond to addition/removal of build resources, we now can dynamically add new machines as they become available to the queue. The other advantage of using python is that we have more customisability and visibility into the build status, e.g. we periodically report the number of remaining packages, as well as the list of deepest packages that we are working on. TODO: * Implement mtime checking for parent package staleness, so that parents are rebuilt if the dependencies are touched more recently. Currently packages will not be rebuild if they exist, whether or not they are "stale" wrt their dependencies. * Offload the machine selection into an external queue manager. Currently the queue manager used here doesn't interoperate with the old one (getmachine/releasemachine) because it's not possible to use the lockf()-based mutual exclusion within a multithreaded client. Doing that will also allow for a more flexible job placement algorithm as well as finer queue customization.
* Add a tiny sh hack - ardiff - compares two archives.sat2008-05-062-0/+98
|
* Remove XFree86-4 from quickportspav2008-04-111-1/+1
|
* Parallelize to 4 concurrent jobspav2008-04-112-2/+2
|
* Include per-machine configuration and respect use_zfs flagpav2008-04-111-2/+3
|
* Sync with pointyhat (reorg)pav2008-04-111-9/+9
|
* - Add the port's Makefile ident string to the build log headerspav2008-03-131-2/+7
| | | | | | | PR: 113234 Submitted by: Andrej Zverev <andrey.zverev@electro-com.ru> - Sync with actual script on pointyhat (whitespace, mostly)
* - Don't write queue entry for machine that's not on mlist. This allows us topav2008-03-121-0/+6
| | | | | gracefully remove a node from the workload, and also it prevents build from stucking when machine is deleted from mlist.
* Make the INDEX_JOBS definition actually effectivepav2008-03-111-1/+1
|
* Remove support for 5-exp and add 7-exp, 8 and 8-experwin2008-01-145-11/+17
|
* Change homebrew locking routines with lockf(1) based locking.erwin2008-01-011-14/+4
|
* Add the standard 6-line header and URL to all build failure logs, notlinimon2007-12-241-1/+10
| | | | | | | | | just the plist ones. If the log is less than 1000 lines after the header, include it all; else, trim to last 1000 lines. This should help when deciding where to forward logs. Tested on: pointyhat
* Copy the duds file to a directory where the web server can find it. Thislinimon2007-12-241-0/+7
| | | | | | | | makes it possible to correctly analyze why packages were not built for a specific run. Add a beginning and ending email notification to help coordinate between multiple portmgrs doing runs.
* Make the script less whiny for unpopulated builds.linimon2007-12-231-2/+2
|
* Fix a problem when add new ports on ports-mgmt category. ports-mgmt/Makefilegarga2007-12-191-6/+13
| | | | | | | | | | lines has 3 spaces before SUBDIR word and all other categories has 4. I've asked pav@ if there is a default format of category Makefiles and he said the number of spaces doesn't matter, so, i fix addport to respect the current number of spaces and/or tabs the file has. Reported by: miwi, erwin
* Add support for 7-exp and 8 brancheskris2007-11-042-3/+3
| | | | Approved by: portmgr (self)
* Correctly report active builds when ZFS is in usekris2007-11-041-1/+1
| | | | Approved by: portmgr (self)
* * Add support for 7-exp and 8 brancheskris2007-11-041-3/+8
| | | | | | * XORG_UPGRADE and USA_RESIDENT are no longer required Approved by: portmgr (self)
* - Add support for FreeBSD 8.0erwin2007-10-251-4/+25
| | | | | - Be more robust about param.h and allow space as well as tab as seperator while determining OSVERION
* Add 7-exp, 8.linimon2007-10-161-0/+8
|
* Add 7-exp and 8.linimon2007-10-161-1/+1
|
* Rename 'missing' column to 'not yet built' so as not to confuse terminologylinimon2007-10-161-6/+6
| | | | | | with portsmon reports. Noticed by: erwin
* s/query-pr.real/query-pr/ to fix getpr after freefall migrationgarga2007-10-151-1/+1
| | | | Discussed at: #bsdports
* Reflect 8-CURRENT.linimon2007-10-151-1/+94
|
* The index page used on pointyhat.linimon2007-10-151-0/+950
|
* Update this example file to reflect 7.0 branching.linimon2007-10-141-1/+1
|
* Replace two further instances of /var/db/pkg by $PKG_DBDIR.gerald2007-09-161-2/+2
|
* Remove the following false positives, which show up as compiler warnings,linimon2007-09-131-2/+2
| | | | | | | | not errors: discards qualifiers [0-9]: implicit declaration of function ISO C\+\+ forbids
* Use PKG_DBDIR instead of hard-coding /var/db/pkg/. Do not silently revertgerald2007-09-081-3/+15
| | | | | | | to defaults for PORTSDIR and PKG_DBDIR if the respective directory does not exist, but bail out. Approved by: netchild
* Change to the latest names of the ooo ports; add jdk16; sort a bit.linimon2007-09-041-1/+1
| | | | Glanced at by: kris
* explicit_lib_depends.sh:netchild2007-09-043-14/+120
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - check if an installed libtool records dependencies recursively and print a warning if it does currently it prints the warning on every system which has libtool installed from ports (only my local version doesn't do this, the version in the ports is not correctly patched for this, a patch similar in complexity (= simple) like the ltdl.m4 one in the libtool-port-patch-directory is needed) - enhance the regex which is responsible to not print a dependency to the port we are just checking - add a work in progress (not executed) to collapse the USE_* which can have more than one value neededlibs.sh: - we also care about shared libs resolveportsfromlibs.sh: - take care about USE_OPENSSL, USE_EFL, USE_GL, USE_FAM, USE_OPENLDAP, USE_SDL - search in the "ldconfig -r" output if we can not find the lib ourself - a better way of getting the first part of the LIB_DEPENDS stuff (lib/libXYZ.so can be specified now too) - some line wrapping + whitespace - print the origin for the USE_* too (except USE_OPENSSL), so an user can make some sanity checks and the explicit_lib_depends.sh can DTRT if we check the USE_* port itself - warn if we can not determine the right component (can happen for XORG) unambiguously.
* One more sanity check, else /+CONTENS will be searched.netchild2007-08-301-0/+5
|
* USE_FREETYPE is for v1, not for v2. Use a perfect match in the case statement.netchild2007-08-301-4/+5
|
* Do not list libs which come with the port itself.netchild2007-08-261-2/+5
|
* Add explicit_lib_depends.sh.netchild2007-08-261-0/+2
|
* - Add USE_FREETYPE.netchild2007-08-261-1/+5
| | | | | - Print the portsdir variable in front of the origin for easy copy und paste of the output.
* We should also look into sbin/ (not only bin/ and lib/).netchild2007-08-241-1/+1
|
* explicit_lib_depends.sh shows you the current explicit dependency list ofnetchild2007-08-241-0/+115
| | | | | | | | | | | | | | | | | libs for a given installed port, e.g.: # ./explicit_lib_depends.sh gnome-vfs-2.18.1_2 USE_GETTEXT=yes USE_GNOME+=gconf2 USE_GNOME+=glib20 USE_GNOME+=gnomevfs2 USE_GNOME+=libxml2 USE_GNOME+=orbit2 USE_ICONV=yes avahi-client:net/avahi avahi-common:net/avahi avahi-glib:net/avahi dbus-1:devel/dbus dbus-glib-1:devel/dbus-glib
* Teach about USE_ICONV, USE_GETTEXT, USE_GNOME and USE_XORG.netchild2007-08-241-1/+38
|
* Add 2 scripts which help in port maintenance to list all direct librarynetchild2007-08-123-0/+170
| | | | | | | | | | | | | | | dependencies of a port: neededlibs.sh Extract direct library dependencies (filenames) from binaries. resolveportsfromlibs.sh Prints the name(s) of ports(s) given a library filename, suitable for direct use (copy&paste) in LIB_DEPENDS. Example usage is included in the scripts. The following combined usage may be helpful for further porting/testing automation: resolveportsfromlibs.sh -b /usr/local $(neededlibs.sh /test/bin/*) Requested by: kris, lofi (sort of)
* - Extract command variable definitions from bsd.port.mk, they are now stored ingabor2007-08-041-40/+10
| | | | | | | | | bsd.commands.mk and can be easily reused within the infrastructure. - Revert old DESTDIR implementation. - Add a new, fully chrooted DESTDIR implementation as bsd.destdir.mk. Sponsored by: Google Summer of Code 2007 Approved by: portmgr (pav)
* Support builds using zfs and tmpfs backing storekris2007-07-293-7/+40
| | | | | | | | | | | | | | | | | | | | | | | | | zfs: * Enabled by use_zfs=1 in portbuild.conf * Populate build chroots by cloning a zfs snapshot instead of maintaining many duplicate copies. In principle this is very efficient since everything is copy-on-write and zfs snapshot creation is almost instantaneous. There might be additional overheads from building on zfs though. Currently the snapshot base is hard-wired to y/${branch}@base but should be parametrized. This also must be populated beforehand, e.g. during machine startup * Clean build chroots by just destroying the snapshot. tmpfs: * Enabled by use_tmpfs=1 and tmpfs_size in portbuild.conf * The previous md strategy of mounting in used/, populating and then remounting (to avoid possible races from multiple builds claiming the same chroot) doesn't work here because tmpfs instances are destroyed at umount. I am not entirely sure the simpler approach is free from races.
OpenPOWER on IntegriCloud