![[BACK]](/icons/back.gif){kind=icon}
Up to [local] / src / share / mk
Request diff between arbitrary revisions
Default branch: MAIN
Revision 1.27 / (download) - annotate - [select for diffs], Sun Sep 24 08:28:20 2023 UTC (7 months, 3 weeks ago) by tb
Branch: MAIN
CVS Tags: OPENBSD_7_5_BASE,
OPENBSD_7_5,
OPENBSD_7_4_BASE,
OPENBSD_7_4,
HEAD
Changes since 1.26: +4 -1 lines
Diff to previous 1.26 (colored)
Make REGRESS_LOG more useful again Enabling REGRESS_FAIL_EARLY made REGRESS_LOG error out at the first error, which is pointless. So default to no if REGRESS_LOG is set unless the user explicitly enabled it. Requested by claudio ok bluhm
Revision 1.26 / (download) - annotate - [select for diffs], Fri Sep 15 07:13:35 2023 UTC (8 months ago) by tb
Branch: MAIN
Changes since 1.25: +2 -2 lines
Diff to previous 1.25 (colored)
Default REGRESS_FAIL_EARLY to yes The current fail open behavior may be desirable in some circumstances, but it is an unexpected and dangerous default since one expects some kind of feedback when running a test suite. Currently failing tests are only visible on inspecting the log, which led to unsuspecting people missing failures several times in the past. Flip the default to fail closed. For those that want to have the old behavior, it is easy enough to set the variable to no. Positive feedback job and schwarze ok kn
Revision 1.25 / (download) - annotate - [select for diffs], Fri Dec 9 09:30:54 2022 UTC (17 months, 1 week ago) by tb
Branch: MAIN
CVS Tags: OPENBSD_7_3_BASE,
OPENBSD_7_3
Changes since 1.24: +3 -1 lines
Diff to previous 1.24 (colored)
Allow overriding default run-regress-* targets Overriding a default run-regress-* target with custom commands is already possible and done by many tests. The fact that it currently works depends on behavior in the BUGs section of make.1, however. The fix is not to add commands if the target is already defined with commands. tested by anton correct fix from espie, ok anton
Revision 1.24 / (download) - annotate - [select for diffs], Tue Aug 31 23:33:05 2021 UTC (2 years, 8 months ago) by bluhm
Branch: MAIN
CVS Tags: OPENBSD_7_2_BASE,
OPENBSD_7_2,
OPENBSD_7_1_BASE,
OPENBSD_7_1,
OPENBSD_7_0_BASE,
OPENBSD_7_0
Changes since 1.23: +10 -10 lines
Diff to previous 1.23 (colored)
Make include bsd.prog.mk is supporting PROGS for a while. Allow multiple programs also in bsd.regress.mk for consistency. OK anton@
Revision 1.23 / (download) - annotate - [select for diffs], Thu Dec 17 14:54:15 2020 UTC (3 years, 4 months ago) by bluhm
Branch: MAIN
CVS Tags: OPENBSD_6_9_BASE,
OPENBSD_6_9
Changes since 1.22: +4 -1 lines
Diff to previous 1.22 (colored)
Run setup_once targets in a sepearate block with headline before all other targets. OK tb@
Revision 1.22 / (download) - annotate - [select for diffs], Wed Dec 16 16:53:24 2020 UTC (3 years, 5 months ago) by bluhm
Branch: MAIN
Changes since 1.21: +5 -1 lines
Diff to previous 1.21 (colored)
When debugging tests, it is useful to see the target name and which output belongs to it. Echo headline with regress target and empty line afterwards. OK sthen@ tb@ OK claudio@
Revision 1.21 / (download) - annotate - [select for diffs], Mon Jun 17 17:20:24 2019 UTC (4 years, 11 months ago) by espie
Branch: MAIN
CVS Tags: OPENBSD_6_8_BASE,
OPENBSD_6_8,
OPENBSD_6_7_BASE,
OPENBSD_6_7,
OPENBSD_6_6_BASE,
OPENBSD_6_6
Changes since 1.20: +11 -1 lines
Diff to previous 1.20 (colored)
add REGRESS_EXPECTED_FAILURES variable, for those tests that are expected to fail because they're not yet implemented. okay bluhm@
Revision 1.20 / (download) - annotate - [select for diffs], Sat Jun 15 07:30:26 2019 UTC (4 years, 11 months ago) by espie
Branch: MAIN
Changes since 1.19: +6 -5 lines
Diff to previous 1.19 (colored)
simplify cleanup handling okay bluhm@
Revision 1.19 / (download) - annotate - [select for diffs], Tue Jun 11 18:14:23 2019 UTC (4 years, 11 months ago) by espie
Branch: MAIN
Changes since 1.18: +23 -25 lines
Diff to previous 1.18 (colored)
make things slightly less insane: - actually use the ERRORS framework for REGRESS_LOG - put it at end of file, as best working (years of practice on bsd.port.mk) - actually use .SILENT - fix REGRESS_IGNORE_FAIL. Don't put a - in front of lines, but just don't error out as false on FAILED tests. This finally allows ^C to actually interrupt a testsuite. - add one missing .PHONY (quite a few more for later) okay bluhm@
Revision 1.18 / (download) - annotate - [select for diffs], Tue May 14 16:43:26 2019 UTC (5 years ago) by bluhm
Branch: MAIN
Changes since 1.17: +6 -19 lines
Diff to previous 1.17 (colored)
Remove the REGRESS_MAXTIME feature from regress framework. The timeout based on CPU seconds is pretty useless, most hanging tests sleep and do not spin. The timeout could not be distinguished from failure. Only 3 tests used it. OK anton@ schwarze@ cheloha@ otto@
Revision 1.17 / (download) - annotate - [select for diffs], Mon Dec 3 22:30:04 2018 UTC (5 years, 5 months ago) by bluhm
Branch: MAIN
CVS Tags: OPENBSD_6_5_BASE,
OPENBSD_6_5
Changes since 1.16: +2 -1 lines
Diff to previous 1.16 (colored)
If a regress uses REGRESS_SKIP_TARGETS to skip part of its tests, print SKIPPED. This helps to detect such incomplete tests. OK anton@
Revision 1.16 / (download) - annotate - [select for diffs], Fri Oct 5 11:15:29 2018 UTC (5 years, 7 months ago) by bluhm
Branch: MAIN
CVS Tags: OPENBSD_6_4_BASE,
OPENBSD_6_4
Changes since 1.15: +17 -1 lines
Diff to previous 1.15 (colored)
Add regress variable to run setup once for all tests. OK anton@ benno@
Revision 1.15 / (download) - annotate - [select for diffs], Wed Sep 26 09:34:23 2018 UTC (5 years, 7 months ago) by bluhm
Branch: MAIN
Changes since 1.14: +9 -3 lines
Diff to previous 1.14 (colored)
Add variables for setup and cleanup of regression tests. OK anton@ jca@ tb@ benno@
Revision 1.14 / (download) - annotate - [select for diffs], Mon Jan 15 20:38:47 2018 UTC (6 years, 4 months ago) by bluhm
Branch: MAIN
CVS Tags: OPENBSD_6_3_BASE,
OPENBSD_6_3
Changes since 1.13: +1 -17 lines
Diff to previous 1.13 (colored)
We have no deprecated regress variables in our tree. Remove the compatibility layer.
Revision 1.13 / (download) - annotate - [select for diffs], Sat Jul 19 18:15:53 2014 UTC (9 years, 10 months ago) by miod
Branch: MAIN
CVS Tags: OPENBSD_6_2_BASE,
OPENBSD_6_2,
OPENBSD_6_1_BASE,
OPENBSD_6_1,
OPENBSD_6_0_BASE,
OPENBSD_6_0,
OPENBSD_5_9_BASE,
OPENBSD_5_9,
OPENBSD_5_8_BASE,
OPENBSD_5_8,
OPENBSD_5_7_BASE,
OPENBSD_5_7,
OPENBSD_5_6_BASE,
OPENBSD_5_6
Changes since 1.12: +2 -2 lines
Diff to previous 1.12 (colored)
Explicitely check the value of REGRESS_SKIP_SLOW rather than its emptyness, for it defaults to a non-empty value; Doug Hogan
Revision 1.12 / (download) - annotate - [select for diffs], Thu Aug 1 20:43:07 2013 UTC (10 years, 9 months ago) by kettenis
Branch: MAIN
CVS Tags: OPENBSD_5_5_BASE,
OPENBSD_5_5
Changes since 1.11: +2 -2 lines
Diff to previous 1.11 (colored)
Don't error out if there are no regression for a particular architecture in a subdirectory.
Revision 1.11 / (download) - annotate - [select for diffs], Fri Jun 14 22:38:50 2013 UTC (10 years, 11 months ago) by halex
Branch: MAIN
CVS Tags: OPENBSD_5_4_BASE,
OPENBSD_5_4
Changes since 1.10: +13 -3 lines
Diff to previous 1.10 (colored)
introduce REGRESS_FAIL_EARLY to stop regression tests at first encountered failure ok phessler@ bluhm@
Revision 1.10 / (download) - annotate - [select for diffs], Mon Sep 2 19:56:55 2002 UTC (21 years, 8 months ago) by avsm
Branch: MAIN
CVS Tags: OPENBSD_5_3_BASE,
OPENBSD_5_3,
OPENBSD_5_2_BASE,
OPENBSD_5_2,
OPENBSD_5_1_BASE,
OPENBSD_5_1,
OPENBSD_5_0_BASE,
OPENBSD_5_0,
OPENBSD_4_9_BASE,
OPENBSD_4_9,
OPENBSD_4_8_BASE,
OPENBSD_4_8,
OPENBSD_4_7_BASE,
OPENBSD_4_7,
OPENBSD_4_6_BASE,
OPENBSD_4_6,
OPENBSD_4_5_BASE,
OPENBSD_4_5,
OPENBSD_4_4_BASE,
OPENBSD_4_4,
OPENBSD_4_3_BASE,
OPENBSD_4_3,
OPENBSD_4_2_BASE,
OPENBSD_4_2,
OPENBSD_4_1_BASE,
OPENBSD_4_1,
OPENBSD_4_0_BASE,
OPENBSD_4_0,
OPENBSD_3_9_BASE,
OPENBSD_3_9,
OPENBSD_3_8_BASE,
OPENBSD_3_8,
OPENBSD_3_7_BASE,
OPENBSD_3_7,
OPENBSD_3_6_BASE,
OPENBSD_3_6,
OPENBSD_3_5_BASE,
OPENBSD_3_5,
OPENBSD_3_4_BASE,
OPENBSD_3_4,
OPENBSD_3_3_BASE,
OPENBSD_3_3,
OPENBSD_3_2_BASE,
OPENBSD_3_2
Changes since 1.9: +67 -32 lines
Diff to previous 1.9 (colored)
- Precede internal bsd.regress.mk variables with a _ - Rename old variables to be easier to read, and deprecate old variables. The old variables will still work, but emit warnings. - REGRESS_SKIP_SLOW only needs to be non-empty now, not explicitly set to 'yes' - REGRESS_LOG can contain more than one file to append results to - ERRORS variable can be set in Makefile to emit warnings or indicate fatal errors. - Add REGRESS_MAIL variable which can be set to an email address to send results to. Currently this only works for a full regression run, since art doesnt want partial run results - sync bsd.regress.mk(5) with these changes ok art@ , also looked over by miod@
Revision 1.9 / (download) - annotate - [select for diffs], Sun Feb 17 01:10:15 2002 UTC (22 years, 3 months ago) by marc
Branch: MAIN
CVS Tags: OPENBSD_3_1_BASE,
OPENBSD_3_1
Changes since 1.8: +9 -1 lines
Diff to previous 1.8 (colored)
skip tests that require root (REGRESSROOTTARGETS) unless the user is root or SUDO is not empty. OK art@
Revision 1.8 / (download) - annotate - [select for diffs], Thu Jan 3 16:54:38 2002 UTC (22 years, 4 months ago) by brad
Branch: MAIN
Changes since 1.7: +2 -2 lines
Diff to previous 1.7 (colored)
use :L variable modifier
Revision 1.7 / (download) - annotate - [select for diffs], Thu Jan 3 02:20:29 2002 UTC (22 years, 4 months ago) by art
Branch: MAIN
Changes since 1.6: +4 -1 lines
Diff to previous 1.6 (colored)
make regress the main target (now that dependencies are correct)
Revision 1.6 / (download) - annotate - [select for diffs], Thu Jan 3 01:47:23 2002 UTC (22 years, 4 months ago) by art
Branch: MAIN
Changes since 1.5: +1 -0 lines
Diff to previous 1.5 (colored)
OpenBSD tag
Revision 1.5 / (download) - annotate - [select for diffs], Thu Jan 3 01:46:43 2002 UTC (22 years, 4 months ago) by art
Branch: MAIN
Changes since 1.4: +1 -1 lines
Diff to previous 1.4 (colored)
s/timeout/possible timeout/ the test could simply fail.
Revision 1.4 / (download) - annotate - [select for diffs], Thu Jan 3 01:01:51 2002 UTC (22 years, 4 months ago) by art
Branch: MAIN
Changes since 1.3: +6 -0 lines
Diff to previous 1.3 (colored)
Two new variables. REGRESSSLOWTARGETS, contains a list of all regress targets that are slow. REGRESSSKIPSLOW, settable to "yes"/"no" (default is "no") when running regress. Skips slow tests. (*for some arbitrary and very subjective value of "slow")
Revision 1.3 / (download) - annotate - [select for diffs], Thu Jan 3 00:28:28 2002 UTC (22 years, 4 months ago) by art
Branch: MAIN
Changes since 1.2: +13 -2 lines
Diff to previous 1.2 (colored)
Support for a new variable REGRESSMAXTIME that sets the cpu time ulimit for tests. Needed for libc_r tests. With some help from marc@
Revision 1.2 / (download) - annotate - [select for diffs], Wed Jan 2 03:27:54 2002 UTC (22 years, 4 months ago) by art
Branch: MAIN
Changes since 1.1: +2 -3 lines
Diff to previous 1.1 (colored)
Eh? Why could I finish a make build with this 6 hours ago?
Revision 1.1 / (download) - annotate - [select for diffs], Tue Jan 1 22:54:28 2002 UTC (22 years, 4 months ago) by art
Branch: MAIN
Start for a framework for regression tests. Simplifies the most common regress test targets, provides logging of success/failure and various minor features. Much Makefile magic from espie@ who thinks that my shell programming skills are "atrocious" (and I agree).