summaryrefslogtreecommitdiffstats
path: root/tools/regression
Commit message (Collapse)AuthorAgeFilesLines
* MFC r298881, 298882, 298883, 298885:pfg2016-05-151-1/+1
| | | | | | | Minor spelling fixes in: tools, share, bluetooth, pmcstat, etc Many of these have user-visible strings.
* MFC r295385: semget(): Check for [EEXIST] error first.jilles2016-04-091-0/+9
| | | | | | | | | | Although POSIX literally permits failing with [EINVAL] if IPC_CREAT and IPC_EXCL were both passed, the semaphore set already exists and has fewer semaphores than nsems, this does not allow an application to retry safely: if the [EINVAL] is actually because of the semmsl limit, an infinite loop would result. PR: 206927
* MFC r293821:ngie2016-03-1464-3272/+0
| | | | | | | | | | | | | | | | | | Integrate tools/regression/geom_{concat,eli,gate,mirror,nop,raid3,shsec,stripe,uzip} in to the FreeBSD test suite as tests/sys/geom/class/{concat,eli,gate,mirror,nop,raid3,shsec,stripe,uzip} The tools/regression/geom and tools/regression/geom_part testcases are being left alone because both test sets are both currently broken. The majority of this work was done on ^/user/ngie/more-tests2 . The differences are as follows: - tests/sys/geom/class/Makefile.inc is not present; it was inlined into the class's Makefiles for explicitness. - The testcases officially require root via kyua - The geom_gate(4) tests don't use the pidfile changes proposed in https://reviews.freebsd.org/D4836 .
* MFC r293621,r293622,r293815:ngie2016-03-139-170/+122
| | | | | | | | | | | | | | | | | | | | | | | r293621: - Delete non-TAP testcases - Add a conf.sh file for executing common functions with geom_gate - Use attach_md for attaching md(4) devices - Don't hardcode /tmp for temporary files, which violates the kyua sandbox - Add/increase sleeps to try and improve synchronization - Add debug output for when checksums fail test-1.t: - Use pkill for killing ggated r293622: Remove Makefile now that the testcases are all TAP based and prove -rv can be used on them r293815: Add conf.sh file missed in r293621
* MFC r293443:ngie2016-03-136-62/+43
| | | | | | | | | - Make test-1.sh into a TAP testable testcase - Delete test-2.sh as it was an incomplete testcase, and the contents were basically a subset of test-1.sh - Add a conf.sh file for executing common functions with geom_uzip - Use attach_md for attaching md(4) devices - Don't hardcode /tmp for temporary files, which violates the kyua sandbox
* MFC r293442:ngie2016-03-133-22/+17
| | | | | | | - Add a geom_stripe specific cleanup function and trap on that function at exit so things are cleaned up properly - Use attach_md for attaching md(4) devices - Don't hardcode /tmp for temporary files, which violates the kyua sandbox
* MFC r293441:ngie2016-03-133-29/+20
| | | | | | | - Add a geom_shsec specific cleanup function and trap on that function at exit so things are cleaned up properly - Use attach_md for attaching md(4) devices - Don't hardcode /tmp for temporary files, which violates the kyua sandbox
* MFC r293438:ngie2016-03-1313-177/+97
| | | | | | | - Add a geom_raid3 specific cleanup function and trap on that function at exit so things are cleaned up properly - Use attach_md for attaching md(4) devices - Don't hardcode /tmp for temporary files, which violates the kyua sandbox
* MFC r293437:ngie2016-03-133-17/+16
| | | | | | - Add a conf.sh file for executing common functions with gnop - Use attach_md for attaching md(4) devices - Don't hardcode /tmp for temporary files, which violates the kyua sandbox
* MFC r293436:ngie2016-03-1321-73/+98
| | | | | | | - Add a conf.sh file for executing common functions with geli -- Use linear probing to find the first unique md(4) device, unlike the other code which uses attach_md, as geli(8) allocates the md(4) devices itself - Don't hardcode /tmp for temporary files, which violates the kyua sandbox
* MFC r293434:ngie2016-03-123-23/+18
| | | | | | | - Use attach_md for memory disks so they can be tracked. - Add a geom_concat specific cleanup function and trap on that function at exit so things are cleaned up properly - Don't hardcode /tmp for temporary files, which violates the kyua sandbox
* MFC r294565: sem: Don't free nameinfo that is still in list when open()jilles2016-01-271-0/+35
| | | | | | | | | | | fails. This bug could be reproduced easily by calling sem_open() with O_CREAT | O_EXCL on a semaphore that is already open in the process. The struct sem_nameinfo would be freed while still in sem_list and later calls to sem_open() or sem_close() could access freed memory. PR: 206396
* MFC r293073:ngie2016-01-248-107/+67
| | | | | | | | | | - Use attach_md instead of hardcoding md(4) provider unit numbers - Implement a gmirror_test_cleanup function, which in turn calls geom_test_cleanup to clean up all md(4) providers allocated in the test run. - Remove duplicate logic in test scripts for removing md(4) providers. - Don't create files in /tmp (outside the kyua sandbox); use the current directory instead
* MFC r294125:ngie2016-01-232-5/+5
| | | | | | | | | Test for EPROTOTYPE not EPROTONOSUPPORT - `SOCK_RAW` is the implied supported type parameter for socket(2) per route(4) - localsw in `sys/kern/uipc_usrreq.c` doesn't have an entry for `SOCK_RAW`, so the prototype is invalid (this isn't explicitly documented anywhere I could find)
* MFC r293048,r293444:ngie2016-01-221-15/+27
| | | | | | | | | | | | | | | | | r293048: - Use a temporary file for the temporary md(4) devices instead of hardcoding it - Remove the temporary file in the cleanup routine r293444: - Move functions that might be used in class-specific cleanup functions (geom_test_cleanup, etc) down so the testcases don't emit noise when bailing - Conform to the TAP protocol better when dealing with classes that can't be loaded and with temporary files that can't be allocated for tracking md(4) devices.
* MFC r294126:ngie2016-01-212-4/+2
| | | | | | | | | | | | | Fix warnings with gcc 5.0 reconnect.c: - Convert the K&R prototype of main to an ANSI prototype to mute a warning from gcc 4.2.1 - Close s_sock2 after finishing off the last test to plug a leak and mute a warning from gcc 5.0 about a -Wunused-but-set variable sendfile.c: - Fix a -Wunused-but-set warning with gcc 5.0 with pagesize in main(..)
* MFC r294127:ngie2016-01-212-33/+33
| | | | | | | | | Fix warnings with clang/gcc - Get rid of unused argc/argv variables in main - Exit on failure with a return code of 1 instead of -1 with err/errx as a return code of -1 is implementation dependent - Bump WARNS to 6
* MFC r294128:ngie2016-01-192-2/+2
| | | | | | | Fix -Wunused warning with clang/gcc - Get rid of unused argc/argv variables in main - Bump WARNS to 6
* MFC r294103:ngie2016-01-191-2/+13
| | | | | | - Check for accf_filter before running the tests, otherwise it will always fail at subtest 9/11 - Use strncpy instead of strcpy with afa.af_name
* MFC r294123:ngie2016-01-191-1/+1
| | | | | | | Add missing newline to message about requiring root privileges This will help ensure that scripts/parsers don't get confused when the message is printed out
* Remove tools/regression/lib/msun (follow up to r292497)ngie2016-01-1816-3059/+0
| | | | Sponsored by: EMC / Isilon Storage Division
* MFC r293032:ngie2016-01-155-5/+5
| | | | | Use randomly generated device names in testcases via mktemp -u instead of using the hardcoded device name, "test"
* MFC r293028,r293029:ngie2016-01-151-1/+35
| | | | | | | | | | | | | | r293028: - Use geom <class> load instead of g<class> load; g<class> doesn't exist for all geom classes, e.g. geom_uzip(4) - These tests require root. Skip all of the tests if they're run as non-root r293029: Add functions for managing md(4) devices and cleaning up said md(4) devices These will be used soon in the various test scripts that source geom_subr.sh
* MFC r292914,r292957:ngie2016-01-062-397/+0
| | | | | | | | | | | | | | | | | | | | r292914: Integrate tools/regression/sockets/unix_passfd into the FreeBSD test suite as tests/sys/kern/unix_passfd_test - Convert testcases to ATF - Fix an alignment issues - Mark rights_creds_payload(..) as an expected failure (see PR # 181741) https://reviews.freebsd.org/D689 Submitted by: markj r292957: Rename `recvfd` and `sendfd` variables in recvfd/sendfd functions to avoid -Wshadow issues with gcc
* MFC r292328:ngie2016-01-0624-2502/+3
| | | | | | | | | | | | Integrate a number of testcases from tools/regression/lib/msun into the FreeBSD test suite There's no functional change with these testcases; they're purposely being left in TAP format for the time being Other testcases which crash on amd64/i386 as-is have not been integrated yet (they need to be retested on a later version of CURRENT, as I haven't used i386 in some time)
* MFC r292530,r292546:ngie2016-01-061-36/+55
| | | | | | | | | | | | | | | r292530: - Use 1 for an exit code instead of -1 with err, errx, and exit - Add unistd.h for getuid(3) - Sort #includes r292546: - Convert testcase to TAP format - Use nitems(x) instead of handrolled sizeof(x) / sizeof(*x) macro - Do not mark count != 0 case with bsde_get_rule_count as a failure; this generates false positives on systems with ugidfw rules set on it
* MFC r292814:ngie2016-01-041-5/+6
| | | | | | | | | - Explicitly initialize ch to 0 - Delete some spurious whitespace - Use calloc instead of malloc in the last test to ensure that sendspace is properly zero'ed out Submitted by: markj
* MFC r292531,r292532,r292533,r292545:ngie2016-01-041-71/+257
| | | | | | | | | | | | | | | | | | | | | | | | | | | r292531: Make test_matches.sh into a series of TAP testcases Use temporary filesystems / memory disks instead of a hardcoded path which doesn't exist on test systems r292532: Mark `subject matching jailid` testcase as an unexpected failure with TODO to ensure that the testcase isn't marked as a failure PR: 205481 r292533: Skip the testcases if mac_bsdextended(4) isn't detected on the system r292545: Redo the TAP integration so it works with Kyua Kyua needs numbers in the TAP results :/, but prove doesn't
* MFC r292569:ngie2015-12-283-21/+31
| | | | | | | | | | | | | | | | | | | | | Make the mac_portacl testcases work / more robust - A trap(1) call has been added to the test scripts to better ensure that the tests do a better job at trying to restore the test host state at the end of the tests (if the test was interrupted before it would leave the system in an odd state, potentially making the test results for subsequent runs non-deterministic). - Add root user checks - Fix nc(1) usage: -- -o is deprecated -- Using `-w 10` will make the call timeout after 10 seconds so it doesn't block indefinitely - Use local variables - Be more terse in the error messages - Parameterize out "127.0.0.1" Sponsored by: EMC / Isilon Storage Division
* MFC r292489:ngie2015-12-271-0/+2
| | | | | | | | | Disable test-ctrig.t testcases which fail assertions on i386 Tested on: stable/10 (amd64/i386), head (amd64/i386) PR: 205446 X-MFC to: stable/10 Sponsored by: EMC / Isilon Storage Division
* MFC r292492,r292495,r292647:ngie2015-12-271-12/+22
| | | | | | | | | | | | | | | | | | | | | | | | | | r292492: - Use nitems instead of handrolling the macro - Use a separate variable for tracking the testcase count instead of hardcoding the offset for the testcases Sponsored by: EMC / Isilon Storage Division r292495: Initialize j so it doesn't print out a garbage index Use it consistently instead of i in the first loop Sponsored by: EMC / Isilon Storage Division r292647: Use j instead of a hardcoded index (9) and increment it after running the NaNs testcases Pointyhat to: ngie Sponsored by: EMC / Isilon Storage Division
* MFC r292491,r292493,r292496:ngie2015-12-272-3/+37
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | r292491: Disable test-ctrig.t testcases which fail assertions on i386 [*] Also, don't compile the exp2l(3) testcases on platforms that don't support the libcall (technically only x86 right now). This makes this test buildable on arm*/mips*/powerpc* Tested on: stable/10 (amd64/i386), head (amd64/i386) PR: 205446 [*] X-MFC to: stable/10 Sponsored by: EMC / Isilon Storage Division r292493: Don't run test-fma on i386 It completely fails all assertions on i386 on both stable/9 and stable/10 PR: 205448 X-MFC to: stable/10 Sponsored by: EMC / Isilon Storage Division r292496: Skip the testcases on i386 (all the assertions fail) [*] Also, don't compile the ldexpl(3) testcases on platforms that don't support the libcall (technically only x86 right now). This makes this test buildable on arm*/mips*/powerpc* PR: 205449 [*] Tested on: stable/10 (amd64/i386), head (amd64/i386) Sponsored by: EMC / Isilon Storage Division
* MFC r292493:ngie2015-12-271-0/+6
| | | | | | | | | | Don't run test-fma on i386 It completely fails all assertions on i386 on both stable/9 and stable/10 PR: 205448 X-MFC to: stable/10 Sponsored by: EMC / Isilon Storage Division
* MFC r292316:ngie2015-12-232-94/+0
| | | | | | Remove hosts that don't resolve properly with the nss and resolv tests Sponsored by: EMC / Isilon Storage Division
* MFC r292327:ngie2015-12-231-4/+4
| | | | | | | Use fabsl instead of fabs to mute -Wabsolute-value warnings from clang because `nums[]` is an array of long doubles Sponsored by: EMC / Isilon Storage Division
* MFC r291982:ngie2015-12-151-2/+1
| | | | | | | Skip the MAC portacl tests if MAC_PORTACL support is missing instead of marking them failed Sponsored by: EMC / Isilon Storage Division
* MFC r291983,r291984:ngie2015-12-132-4/+13
| | | | | | | | | | | | | | | | | r291983: Fix compilation warnings by adding unistd.h #include and missing return statements Sponsored by: EMC / Isilon Storage Division r291984: Add missing stdlib.h header Apply some minor style(9) fixes Sponsored by: EMC / Isilon Storage Division
* Remove stale tools/regression directory that should have been deletedngie2015-12-0525-2296/+0
| | | | | | in r291840 Sponsored by: EMC / Isilon Storage Division
* MFC r291359,r291362:ngie2015-12-041-1/+4
| | | | | | | | | | | | | r291359: Skip over lines that start with # (comments) r291362: r291359 was incorrect. Skip over tokens that start with `#' as fgetln can return more than one '\n' delimited line in a buffer Handle empty lines too, just in case
* MFC r291363:ngie2015-12-049-583/+582
| | | | Clean up trailing whitespace
* MFC r291358:ngie2015-12-042-2/+2
| | | | | Remove cnftp.bjpu.edu.cn (it no longer resolves) Add localhost to resolv/mach for parity with nss/mach
* MFC r264737:ngie2015-11-255-1/+237
| | | | | | | | | | | | | | | Discussed with: jilles r264737 (by jilles): libc/stdio: Fail fdopen() on an execute-only fd. An execute-only fd (opened with O_EXEC) allows neither read() nor write() and is therefore incompatible with all stdio modes. Therefore, the [EINVAL] error applies. Also adjust the similar check in freopen() with a NULL path, even though this checks an fd which is already from a FILE.
* MFC r290914:ngie2015-11-2310-655/+0
| | | | | | | | | | | | | | Integrate tools/regression/pipe in to the FreeBSD test suite as tests/sys/kern/pipe - Fix style(9) bugs - Fix compiler warnings - Use `nitems(x)` instead of `sizeof(x) / sizeof(*x)` pattern The testcases will be converted over to ATF eventually, but for now will be integrated in as plain C tests Sponsored by: EMC / Isilon Storage Division
* MFC r290532,r290561,r290843,r290844,r290845:ngie2015-11-2333-2494/+0
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | r290532: Integrate tools/regression/lib/libc/locale into the FreeBSD test suite as lib/libc/tests/locale Sponsored by: EMC / Isilon Storage Division r290561: Delete leftover printfs from when these were TAP tests Sponsored by: EMC / Isilon Storage Division r290843: Polish up the tests a bit more after projects/collation was merged to head Provide more meaningful diagnostic messages if LC_CTYPE can't be set properly instead of segfaulting, because setlocale returns NULL and strcmp(NULL, b) will always segfault Split up the testcases so one failing (in this case en_US.ISO8859-15) won't cause the rest of the testcases to be skipped Remove some unused variables Sponsored by: EMC / Isilon Storage Division r290844: Polish up iswctype_test - Split up the testcases into C locale and ja_JP.eucJP testcases. - Avoid a segfault in the event that setlocale fails, similar to r290843 - Replace `sizeof(x) / sizeof(*x)` pattern with `nitems(x)` Sponsored by: EMC / Isilon Storage Division r290845: Remove unused variables; sort by alignment where needed Sponsored by: EMC / Isilon Storage Division
* MFC r290563,r290868,r291038:ngie2015-11-238-459/+0
| | | | | | | | | | | | | | | | | | | | | | | | | | | r290563: Integrate tools/regression/lib/libc/net into the FreeBSD test suite as lib/libc/tests/net Also, fix eui64_aton_test:test_str(..). The test was comparing the result of eui64_aton to a pointer of the expected result. Sponsored by: EMC / Isilon Storage Division r290868: Fix -Wformat issues Reported by: gcc Sponsored by: EMC / Isilon Storage Division r291038: Do not print out errno if the call succeeded unexpectedly; this was a mistake made in r290868 Reported by: jilles Sponsored by: EMC / Isilon Storage Division
* MFC r290905,r290922:ngie2015-11-233-169/+0
| | | | | | | | | | | | | | | | | | | r290905: Integrate acct(2) testcase in as tests/sys/kern/acct/acct_test The :encode_tv_random_million testcase fails the epsilon tests a few thousand times out of one million, so expect the testcase to fail Submitted by: keramida Sponsored by: EMC / Isilon Storage Division r290922: Remove directory made obsolete by r290905 X-MFC note: stable/10 only Sponsored by: EMC / Isilon Storage Division
* Remove tools/regression/acltoolsngie2015-11-1613-3295/+0
| | | | | | Should have been done with r290894 Sponsored by: EMC / Isilon Storage Division
* MFC r289195:ngie2015-11-154-667/+667
| | | | | | | | | | | | | | | | | | | | | | Integrate the tests from lib/libarchive, usr.bin/cpio, and usr.bin/tar in to the FreeBSD test suite functional_test.sh was ported from bin/sh/tests/functional_test.sh, as a small wrapper around libarchive_test, bsdcpio_test, and bsdtar_test provided by upstream. A handful of testcases in lib/libarchive/tests have been disabled as they were failing when run with kyua test (see BROKEN_TESTS in lib/libarchive/tests/Makefile) As a sidenote: this removes the check/test targets from the Makefiles as they don't match the pattern used in the rest of the FreeBSD test suite. Sponsored by: EMC / Isilon Storage Division Conflicts: lib/libarchive/test usr.bin/cpio/test
* MFC r290538:ngie2015-11-158-510/+0
| | | | | | | | | | Integrate tools/regression/lib/libc/stdlib into the FreeBSD test suite as lib/libc/tests/stdlib - Make the code a bit more style(9) compliant - Convert a sizeof(x)/sizeof(x[0]) to nitems Sponsored by: EMC / Isilon Storage Division
* MFC r290539:ngie2015-11-156-436/+0
| | | | | | | Integrate tools/regression/lib/libc/string into the FreeBSD test suite as lib/libc/tests/string Sponsored by: EMC / Isilon Storage Division
OpenPOWER on IntegriCloud