[BACK]Return to FIXES CVS log [TXT][DIR] Up to [local] / src / usr.bin / awk

Annotation of src/usr.bin/awk/FIXES, Revision 1.47

1.1       tholo       1: /****************************************************************
1.6       kstailey    2: Copyright (C) Lucent Technologies 1997
1.1       tholo       3: All Rights Reserved
                      4:
                      5: Permission to use, copy, modify, and distribute this software and
                      6: its documentation for any purpose and without fee is hereby
                      7: granted, provided that the above copyright notice appear in all
                      8: copies and that both that the copyright notice and this
                      9: permission notice and warranty disclaimer appear in supporting
1.6       kstailey   10: documentation, and that the name Lucent Technologies or any of
                     11: its entities not be used in advertising or publicity pertaining
                     12: to distribution of the software without specific, written prior
                     13: permission.
                     14:
                     15: LUCENT DISCLAIMS ALL WARRANTIES WITH REGARD TO THIS SOFTWARE,
                     16: INCLUDING ALL IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS.
                     17: IN NO EVENT SHALL LUCENT OR ANY OF ITS ENTITIES BE LIABLE FOR ANY
                     18: SPECIAL, INDIRECT OR CONSEQUENTIAL DAMAGES OR ANY DAMAGES
                     19: WHATSOEVER RESULTING FROM LOSS OF USE, DATA OR PROFITS, WHETHER
                     20: IN AN ACTION OF CONTRACT, NEGLIGENCE OR OTHER TORTIOUS ACTION,
                     21: ARISING OUT OF OR IN CONNECTION WITH THE USE OR PERFORMANCE OF
                     22: THIS SOFTWARE.
1.1       tholo      23: ****************************************************************/
                     24:
                     25: This file lists all bug fixes, changes, etc., made since the AWK book
1.47    ! millert    26: was sent to the printers in August 1987.
1.45      millert    27:
1.47    ! millert    28: Aug 30, 2022:
        !            29:        Various leaks and use-after-free issues plugged/fixed.
        !            30:        Thanks to Miguel Pineiro Jr. <mpj@pineiro.cc>.
1.46      millert    31:
                     32: May 23, 2022:
                     33:        Memory leak when assigning a string to some of the built-in
                     34:        variables. allocated string erroneously marked DONTFREE.
                     35:        Thanks to Miguel Pineiro Jr. <mpj@pineiro.cc>.
                     36:
1.45      millert    37: Mar 14, 2022:
1.46      millert    38:        Historic bug: command-line "name=value" assignment had been
                     39:        truncating its entry in ARGV. (circa 1989) Thanks to
                     40:        Miguel Pineiro Jr. <mpj@pineiro.cc>.
1.44      millert    41:
                     42: Mar 3, 2022:
                     43:        Fixed file management memory leak that appears to have been
                     44:        there since the files array was first initialized with stdin,
                     45:        stdout, and stderr (circa 1992). Thanks to Miguel Pineiro Jr.
                     46:        <mpj@pineiro.cc>.
1.43      millert    47:
                     48: December 8, 2021:
                     49:        The error handling in closefile and closeall was mangled. Long
                     50:        standing warnings had been made fatal and some fatal errors went
                     51:        undetected. Thanks to Miguel Pineiro Jr. <mpj@pineiro.cc>.
1.42      millert    52:
                     53: Nov 03, 2021:
                     54:         getline accesses uninitialized data after getrec()
                     55:        returns 0 on EOF and leaves the contents of buf unchanged.
                     56:        Thanks to Volodymyr Gubarkov, and Todd C Miller.
1.41      millert    57:
                     58: Oct 12, 2021:
                     59:        The fix for #83 changed the code to insert 2 chars, but the
                     60:        call to adjbuf just above it only allows for 1 char. This can
                     61:        cause a heap buffer overflow.
                     62:
                     63: July 27, 2021:
                     64:        As per IEEE Std 1003.1-2008, -F "str" is now consistent with
                     65:        -v FS="str" when str is null. Thanks to Warner Losh.
                     66:
                     67: July 24, 2021:
                     68:        Fix readrec's definition of a record. This fixes an issue
                     69:        with NetBSD's RS regular expression support that can cause
                     70:        an infinite read loop. Thanks to Miguel Pineiro Jr.
                     71:
                     72:        Fix regular expression RS ^-anchoring. RS ^-anchoring needs to
                     73:        know if it is reading the first record of a file. This change
                     74:        restores a missing line that was overlooked when porting NetBSD's
                     75:        RS regex functionality. Thanks to Miguel Pineiro Jr.
                     76:
                     77:        Fix size computation in replace_repeat() for special case
                     78:        REPEAT_WITH_Q. Thanks to Todd C. Miller.
                     79:
                     80: February 15, 2021:
                     81:        Small fix so that awk will compile again with g++. Thanks to
                     82:        Arnold Robbins.
                     83:
                     84: January 06, 2021:
                     85:        Fix a decision bug with trailing stuff in lib.c:is_valid_number
                     86:        after recent changes. Thanks to Ozan Yigit.
1.40      millert    87:
                     88: December 18, 2020:
                     89:        Fix problems converting inf and NaN values in lib.c:is_valid_number.
                     90:        Enhance number to string conversion to do the right thing for
                     91:        NaN and inf values.  Things are now pretty much the same as in
                     92:        gawk.  (Found a gawk bug while we're at it.) Added a torture
                     93:        test for these values.  Thanks to Arnold Robbins.  Allows closing
                     94:        of PR #101.
                     95:
                     96: December 15, 2020:
                     97:        Merge PR #99, which gets the right header for strcasecmp.
                     98:        Thanks to GitHub user michaelforney.
1.39      millert    99:
                    100: December 8, 2020:
                    101:        Merge PR #98: Disallow hex data. Allow only +nan, -nan,
                    102:        +inf, -inf (case independent) to give NaN and infinity values.
                    103:        Improve things so that string to double conversion is only
                    104:        done once, yielding something of a speedup.  This obviate
                    105:        PR #95. Thanks to Arnold Robbins.
                    106:
                    107: December 3, 2020:
                    108:        Fix to argument parsing to avoid printing spurious newlines.
                    109:        Thanks to Todd Miller. Merges PR #97.
                    110:
                    111: October 13, 2020:
                    112:        Add casts before all the calls to malloc/calloc/realloc in order
                    113:        to get it to compile with g++. Thanks to Arnold Robbins.
                    114:
                    115: August 16, 2020:
                    116:        Additional fixes for DJGPP. Thanks to Eli Zaretskii for
                    117:        the testing.
1.38      millert   118:
                    119: August 7, 2020:
                    120:        Merge PR #93, which adds casts to (void*) for debug prints
                    121:        using the %p format specifier. Thanks to GitHub user YongHaoWu
                    122:        ("Chris") for the fixes.
                    123:
                    124: August 4, 2020:
                    125:        In run.c, use non-restartable multibyte routines to attain
                    126:        portability to DJGPP. Should fix Issue 92. Thanks to Albert Wik
                    127:        for the report and to Todd Miller for the suggested fix.
1.37      millert   128:
                    129: July 30, 2020:
                    130:        Merge PRs 88-91 which fix small bugs. Thanks to Todd Miller and
                    131:        Tim van der Molen for the fixes.
                    132:
                    133:        In order to make life easier, we move exclusively to bison
                    134:        as the parser generator.
1.36      millert   135:
                    136: July 2, 2020:
                    137:        Merge PRs 85 and 86 which fix regressions. Thanks to
                    138:        Tim van der Molen for the fixes.
1.35      millert   139:
                    140: June 25, 2020:
                    141:        Merge PRs 82 and 84. The latter fixes issue #83. Thanks to
                    142:        Todd Miller and awkfan77.
1.34      millert   143:
                    144: June 12, 2020:
                    145:        Clear errno before calling errcheck to avoid any spurious errors
                    146:        left over from previous calls that may have set it. Thanks to
                    147:        Todd Miller for the fix, from PR #80.
                    148:
                    149:        Fix Issue #78 by allowing \r to follow floating point numbers in
                    150:        lib.c:is_number. Thanks to GitHub user ajcarr for the report
                    151:        and to Arnold Robbins for the fix.
1.33      millert   152:
                    153: June 5, 2020:
                    154:        In fldbld(), make sure that inputFS is set before trying to
                    155:        use it. Thanks to  Steffen Nurpmeso <steffen@sdaoden.eu>
                    156:        for the report.
                    157:
                    158: May 5, 2020:
                    159:        Fix checks for compilers that can handle noreturn. Thanks to
                    160:        GitHub user enh-google for pointing it out. Closes Issue #79.
                    161:
                    162: April 16, 2020:
                    163:        Handle old compilers that don't support C11 (for noreturn).
                    164:        Thanks to Arnold Robbins.
                    165:
                    166: April 5, 2020:
                    167:        Use <stdnoreturn.h> and noreturn instead of GCC attributes.
                    168:        Thanks to GitHub user awkfan77. Closes PR #77.
1.30      millert   169:
1.32      millert   170: February 28, 2020:
                    171:        More cleanups from Christos Zoulas: notably backslash continuation
                    172:        inside strings removes the newline and a fix for RS = "^a".
                    173:        Fix for address sanitizer-found problem. Thanks to GitHub user
                    174:        enh-google.
                    175:
                    176: February 19, 2020:
                    177:        More small cleanups from Christos Zoulas.
                    178:
                    179: February 18, 2020:
                    180:        Additional cleanups from Christos Zoulas. It's no longer necessary
                    181:        to use the -y flag to bison.
                    182:
                    183: February 6, 2020:
                    184:        Additional small cleanups from Christos Zoulas. awk is now
                    185:        a little more robust about reporting I/O errors upon exit.
                    186:
1.31      millert   187: January 31, 2020:
                    188:        Merge PR #70, which avoids use of variable length arrays. Thanks
                    189:        to GitHub user michaelforney.  Fix issue #60 ({0} in interval
1.32      millert   190:        expressions doesn't work).  Also get all tests working again.
                    191:        Thanks to Arnold Robbins.
1.31      millert   192:
                    193: January 24, 2020:
                    194:        A number of small cleanups from Christos Zoulas.  Add the close
                    195:        on exec flag to files/pipes opened for redirection; courtesy of
                    196:        Arnold Robbins.
                    197:
                    198: January 19, 2020:
                    199:        If POSIXLY_CORRECT is set in the environment, then sub and gsub
                    200:        use POSIX rules for multiple backslashes.  This fixes Issue #66,
                    201:        while maintaining backwards compatibility.
                    202:
                    203: January 9, 2020:
                    204:        Input/output errors on closing files are now fatal instead of
                    205:        mere warnings. Thanks to Martijn Dekker <martijn@inlv.org>.
                    206:
1.30      millert   207: January 5, 2020:
                    208:        Fix a bug in the concatentation of two string constants into
                    209:        one done in the grammar.  Fixes GitHub issue #61.  Thanks
                    210:        to GitHub user awkfan77 for pointing out the direction for
                    211:        the fix.  New test T.concat added to the test suite.
                    212:        Fix a few memory leaks reported by valgrind, as well.
                    213:
                    214: December 27, 2019:
                    215:        Fix a bug whereby a{0,3} could match four a's.  Thanks to
                    216:        "Anonymous AWK fan" for the report.
                    217:
                    218: December 11, 2019:
                    219:        Further printf-related fixes for 32 bit systems.
                    220:        Thanks again to Christos Zoulas.
                    221:
                    222: December 8, 2019:
                    223:        Fix the return value of sprintf("%d") on 32 bit systems.
                    224:        Thanks to Jim Lowe for the report and to Christos Zoulas
                    225:        for the fix.
1.29      millert   226:
                    227: November 10, 2019:
                    228:        Convert a number of Boolean integer variables into
                    229:        actual bools. Convert compile_time variable into an
                    230:        enum and simplify some of the related code.  Thanks
                    231:        to Arnold Robbins.
                    232:
                    233: November 8, 2019:
                    234:        Fix from Ori Bernstein to get UTF-8 characters instead of
                    235:        bytes when FS = "".  This is currently the only bit of
                    236:        the One True Awk that understands multibyte characters.
                    237:        From Arnold Robbins, apply some cleanups in the test suite.
1.28      millert   238:
                    239: October 25, 2019:
                    240:        More fixes and cleanups from NetBSD, courtesy of Christos
                    241:        Zoulas. Merges PRs 54 and 55.
                    242:
                    243: October 24, 2019:
                    244:        Import second round of code cleanups from NetBSD. Much thanks
1.31      millert   245:        to Christos Zoulas (GitHub user zoulasc). Merges PR 53.
1.28      millert   246:        Add an optimization for string concatenation, also from
                    247:        Christos.
1.27      millert   248:
                    249: October 17, 2019:
                    250:        Import code cleanups from NetBSD. Much thanks to Christos
1.31      millert   251:        Zoulas (GitHub user zoulasc). Merges PR 51.
1.26      millert   252:
                    253: October 6, 2019:
                    254:        Import code from NetBSD awk that implements RS as a regular
                    255:        expression.
1.23      millert   256:
1.25      millert   257: September 10, 2019:
                    258:        Fixes for various array / memory overruns found via gcc's
1.31      millert   259:        -fsanitize=unknown. Thanks to Alexander Richardson (GitHub
1.25      millert   260:        user arichardson). Merges PRs 47 and 48.
                    261:
                    262: July 28, 2019:
                    263:        Import grammar optimization from NetBSD: Two string constants
                    264:        concatenated together get turned into a single string.
                    265:
                    266: July 26, 2019:
                    267:        Support POSIX-specified C-style escape sequences "\a" (alarm)
                    268:        and "\v" (vertical tab) in command line arguments and regular
                    269:        expressions, further to the support for them in strings added on
                    270:        Apr 9, 1989. These now no longer match as literal "a" and "v"
                    271:        characters (as they don't on other awk implementations).
                    272:        Thanks to Martijn Dekker.
                    273:
                    274: July 17, 2019:
                    275:        Pull in a number of code cleanups and minor fixes from
                    276:        Warner Losh's bsd-ota branch.  The only user visible change
                    277:        is the use of random(3) as the random number generator.
                    278:        Thanks to Warner Losh for collecting all these fixes in
                    279:        one easy place to get them from.
                    280:
                    281: July 16, 2019:
                    282:        Fix field splitting to use FS value as of the time a record
                    283:        was read or assigned to.  Thanks to GitHub user Cody Mello (melloc)
                    284:        for the fix. (Merged from his branch, via PR #42.) Updated
                    285:        testdir/T.split per said PR as well.
                    286:
                    287: June 24, 2019:
                    288:        Extract awktest.tar into testdir directory. Add some very
                    289:        simple mechanics to the makefile for running the tests and
                    290:        for cleaning up. No changes to awk itself.
                    291:
1.24      millert   292: June 17, 2019:
                    293:        Disallow deleting SYMTAB and its elements, which creates
                    294:        use-after-free bugs. Thanks to GitHub user Cody Mello (melloc)
                    295:        for the fix. (Merged from PR #43.)
                    296:
                    297: June 5, 2019:
                    298:        Allow unmatched right parenthesis in a regular expression to
                    299:        be treated literally. Fixes Issue #40. Thanks to GitHub user
                    300:        Warner Losh (bsdimp) for the report. Thanks to Arnold Robbins
                    301:        for the fix.
                    302:
                    303: May 29,2019:
                    304:        Fix check for command line arguments to no longer require that
                    305:        first character after '=' not be another '='. Reverts change of
                    306:        August 11, 1989. Thanks to GitHub user Jamie Landeg Jones for
                    307:        pointing out the issue; from Issue #38.
                    308:
                    309: Apr 7, 2019:
                    310:        Update awktest.tar(p.50) to use modern options to sort. Needed
                    311:        for Android development. Thanks to GitHub user mohd-akram (Mohamed
                    312:        Akram).  From Issue #33.
                    313:
                    314: Mar 12, 2019:
                    315:        Added very simplistic support for cross-compiling in the
                    316:        makefile.  We are NOT going to go in the direction of the
                    317:        autotools, though.  Thanks to GitHub user nee-san for
                    318:        the basic change. (Merged from PR #34.)
                    319:
1.23      millert   320: Mar 5, 2019:
                    321:        Added support for POSIX-standard interval expressions (a.k.a.
                    322:        bounds, a.k.a. repetition expressions) in regular expressions,
                    323:        backported (via NetBSD) from Apple awk-24 (20070501).
                    324:        Thanks to Martijn Dekker <martijn@inlv.org> for the port.
                    325:        (Merged from PR #30.)
                    326:
                    327: Mar 3, 2019:
                    328:        Merge PRs as follows:
                    329:        #12: Avoid undefined behaviour when using ctype(3) functions in
                    330:             relex(). Thanks to GitHub user iamleot.
                    331:        #31: Make getline handle numeric strings, and update FIXES. Thanks
1.47    ! millert   332:             to GitHub user Arnold Robbins (arnoldrobbins)
1.23      millert   333:        #32: maketab: support build systems with read-only source. Thanks
                    334:             to GitHub user enh.
1.22      millert   335:
                    336: Jan 25, 2019:
                    337:        Make getline handle numeric strings properly in all cases.
                    338:        (Thanks, Arnold.)
                    339:
                    340: Jan 21, 2019:
                    341:        Merged a number of small fixes from GitHub pull requests.
                    342:        Thanks to GitHub users Arnold Robbins (arnoldrobbins),
                    343:        Cody Mello (melloc) and Christoph Junghans (junghans).
                    344:        PR numbers: 13-21, 23, 24, 27.
1.21      millert   345:
                    346: Oct 25, 2018:
                    347:        Added test in maketab.c to prevent generating a proctab entry
                    348:        for YYSTYPE_IS_DEFINED.  It was harmless but some gcc settings
                    349:        generated a warning message.  Thanks to Nan Xiao for report.
1.20      millert   350:
                    351: Aug 27, 2018:
                    352:        Disallow '$' in printf formats; arguments evaluated in order
                    353:        and printed in order.
                    354:
                    355:        Added some casts to silence warnings on debugging printfs.
                    356:        (Thanks, Arnold.)
1.18      millert   357:
1.19      millert   358: Aug 23, 2018:
                    359:         A long list of fixes courtesy of Arnold Robbins,
                    360:         to whom profound thanks.
                    361:
                    362:         1. ofs-rebuild: OFS value used to rebuild the record was incorrect.
                    363:         Fixed August 19, 2014. Revised fix August 2018.
                    364:
                    365:         2. system-status: Instead of a floating-point division by 256, use
                    366:         the wait(2) macros to create a reasonable exit status.
                    367:         Fixed March 12, 2016.
                    368:
                    369:         3. space: Use provided xisblank() function instead of ispace() for
                    370:         matching [[:blank:]].
                    371:
                    372:         4. a-format: Add POSIX standard %a and %A to supported formats. Check
                    373:         at runtime that this format is available.
                    374:
                    375:         5. decr-NF: Decrementing NF did not change $0. This is a decades-old
                    376:         bug. There are interactions with the old and new value of OFS as well.
                    377:         Most of the fix came from the NetBSD awk.
                    378:
                    379:         6. string-conv: String conversions of scalars were sticky.  Once a
                    380:         conversion to string happened, even with OFMT, that value was used until
                    381:         a new numeric value was assigned, even if OFMT differed from CONVFMT,
                    382:         and also if CONVFMT changed.
                    383:
                    384:         7. unary-plus: Unary plus on a string constant returned the string.
                    385:         Instead, it should convert the value to numeric and give that value.
                    386:
                    387:        Also added Arnold's tests for these to awktest.tar as T.arnold.
                    388:
                    389: Aug 15, 2018:
                    390:        fixed mangled awktest.tar (thanks, Arnold), posted all
                    391:        current (very minor) fixes to github / onetrueawk
                    392:
1.18      millert   393: Jun 7, 2018:
                    394:        (yes, a long layoff)
                    395:        Updated some broken tests (beebe.tar, T.lilly)
                    396:        [thanks to Arnold Robbins]
                    397:
                    398: Mar 26, 2015:
                    399:        buffer overflow in error reporting; thanks to tobias ulmer
                    400:        and john-mark gurney for spotting it and the fix.
                    401:
                    402: Feb 4, 2013:
                    403:        cleaned up a handful of tests that didn't seem to actually
                    404:        test for correct behavior: T.latin1, T.gawk.
                    405:
                    406: Jan 5, 2013:
                    407:        added ,NULL initializer to static Cells in run.c; not really
                    408:        needed but cleaner.  Thanks to Michael Bombardieri.
1.17      millert   409:
                    410: Dec 20, 2012:
                    411:        fiddled makefile to get correct yacc and bison flags.  pick yacc
                    412:        (linux) or bison (mac) as necessary.
                    413:
                    414:        added  __attribute__((__noreturn__)) to a couple of lines in
                    415:        proto.h, to silence someone's enthusiastic checker.
                    416:
                    417:        fixed obscure call by value bug in split(a[1],a) reported on
                    418:        9fans.  the management of temporary values is just a mess; i
                    419:        took a shortcut by making an extra string copy.  thanks
                    420:        to paul patience and arnold robbins for passing it on and for
                    421:        proposed patches.
                    422:
                    423:        tiny fiddle in setfval to eliminate -0 results in T.expr, which
                    424:        has irritated me for 20+ years.
1.16      millert   425:
                    426: Aug 10, 2011:
                    427:        another fix to avoid core dump with delete(ARGV); again, many thanks
                    428:        to ruslan ermilov.
                    429:
                    430: Aug 7, 2011:
                    431:        split(s, a, //) now behaves the same as split(s, a, "")
                    432:
                    433: Jun 12, 2011:
                    434:        /pat/, \n /pat/ {...} is now legal, though bad style to use.
                    435:
                    436:        added checks to new -v code that permits -vnospace; thanks to
1.25      millert   437:        ruslan ermilov for spotting this and providing the patch.
1.16      millert   438:
                    439:        removed fixed limit on number of open files; thanks to aleksey
1.25      millert   440:        cheusov and christos zoulos.
1.16      millert   441:
                    442:        fixed day 1 bug that resurrected deleted elements of ARGV when
                    443:        used as filenames (in lib.c).
                    444:
                    445:        minor type fiddles to make gcc -Wall -pedantic happier (but not
                    446:        totally so); turned on -fno-strict-aliasing in makefile.
                    447:
                    448: May 6, 2011:
                    449:        added #ifdef for isblank.
                    450:        now allows -ffoo as well as -f foo arguments.
                    451:        (thanks, ruslan)
                    452:
                    453: May 1, 2011:
                    454:        after advice from todd miller, kevin lo, ruslan ermilov,
                    455:        and arnold robbins, changed srand() to return the previous
                    456:        seed (which is 1 on the first call of srand).  the seed is
                    457:        an Awkfloat internally though converted to unsigned int to
1.25      millert   458:        pass to the library srand().  thanks, everyone.
1.16      millert   459:
                    460:        fixed a subtle (and i hope low-probability) overflow error
1.25      millert   461:        in fldbld, by adding space for one extra \0.  thanks to
1.16      millert   462:        robert bassett for spotting this one and providing a fix.
                    463:
                    464:        removed the files related to compilation on windows.  i no
                    465:        longer have anything like a current windows environment, so
                    466:        i can't test any of it.
1.15      millert   467:
                    468: May 23, 2010:
                    469:        fixed long-standing overflow bug in run.c; many thanks to
                    470:        nelson beebe for spotting it and providing the fix.
                    471:
                    472:        fixed bug that didn't parse -vd=1 properly; thanks to santiago
                    473:        vila for spotting it.
                    474:
                    475: Feb 8, 2010:
                    476:        i give up.  replaced isblank with isspace in b.c; there are
                    477:        no consistent header files.
                    478:
                    479: Nov 26, 2009:
                    480:        fixed a long-standing issue with when FS takes effect.  a
                    481:        change to FS is now noticed immediately for subsequent splits.
                    482:
                    483:        changed the name getline() to awkgetline() to avoid yet another
                    484:        name conflict somewhere.
                    485:
                    486: Feb 11, 2009:
                    487:        temporarily for now defined HAS_ISBLANK, since that seems to
                    488:        be the best way through the thicket.  isblank arrived in C99,
                    489:        but seems to be arriving at different systems at different
                    490:        times.
                    491:
                    492: Oct 8, 2008:
                    493:        fixed typo in b.c that set tmpvec wrongly.  no one had ever
                    494:        run into the problem, apparently.  thanks to alistair crooks.
1.14      millert   495:
                    496: Oct 23, 2007:
                    497:        minor fix in lib.c: increase inputFS to 100, change malloc
1.25      millert   498:        for fields to n+1.
1.14      millert   499:
                    500:        fixed memory fault caused by out of order test in setsval.
                    501:
                    502:        thanks to david o'brien, freebsd, for both fixes.
                    503:
                    504: May 1, 2007:
                    505:        fiddle in makefile to fix for BSD make; thanks to igor sobrado.
                    506:
                    507: Mar 31, 2007:
                    508:        fixed some null pointer refs calling adjbuf.
                    509:
                    510: Feb 21, 2007:
                    511:        fixed a bug in matching the null RE in sub and gsub.  thanks to al aho
                    512:        who actually did the fix (in b.c), and to wolfgang seeberg for finding
                    513:        it and providing a very compact test case.
                    514:
                    515:        fixed quotation in b.c; thanks to Hal Pratt and the Princeton Dante
                    516:        Project.
                    517:
                    518:        removed some no-effect asserts in run.c.
                    519:
                    520:        fiddled maketab.c to not complain about bison-generated values.
                    521:
                    522:        removed the obsolete -V argument; fixed --version to print the
                    523:        version and exit.
                    524:
                    525:        fixed wording and an outright error in the usage message; thanks to igor
                    526:        sobrado and jason mcintyre.
                    527:
                    528:        fixed a bug in -d that caused core dump if no program followed.
                    529:
                    530: Jan 1, 2007:
                    531:        dropped mac.code from makefile; there are few non-MacOSX
                    532:        mac's these days.
                    533:
                    534: Jan 17, 2006:
                    535:        system() not flagged as unsafe in the unadvertised -safe option.
                    536:        found it while enhancing tests before shipping the ;login: article.
                    537:        practice what you preach.
                    538:
                    539:        removed the 9-years-obsolete -mr and -mf flags.
                    540:
                    541:        added -version and --version options.
                    542:
                    543:        core dump on linux with BEGIN {nextfile}, now fixed.
                    544:
1.25      millert   545:        removed some #ifdef's in run.c and lex.c that appear to no
1.14      millert   546:        longer be necessary.
                    547:
                    548: Apr 24, 2005:
                    549:        modified lib.c so that values of $0 et al are preserved in the END
                    550:        block, apparently as required by posix.  thanks to havard eidnes
                    551:        for the report and code.
                    552:
                    553: Jan 14, 2005:
                    554:        fixed infinite loop in parsing, originally found by brian tsang.
                    555:        thanks to arnold robbins for a suggestion that started me
                    556:        rethinking it.
                    557:
                    558: Dec 31, 2004:
1.25      millert   559:        prevent overflow of -f array in main, head off potential error in
                    560:        call of SYNTAX(), test malloc return in lib.c, all with thanks to
1.14      millert   561:        todd miller.
1.13      millert   562:
                    563: Dec 22, 2004:
                    564:        cranked up size of NCHARS; coverity thinks it can be overrun with
                    565:        smaller size, and i think that's right.  added some assertions to b.c
                    566:        to catch places where it might overrun.  the RE code is still fragile.
                    567:
                    568: Dec 5, 2004:
                    569:        fixed a couple of overflow problems with ridiculous field numbers:
                    570:        e.g., print $(2^32-1).  thanks to ruslan ermilov, giorgos keramidas
                    571:        and david o'brien at freebsd.org for patches.  this really should
                    572:        be re-done from scratch.
                    573:
                    574: Nov 21, 2004:
                    575:        fixed another 25-year-old RE bug, in split.  it's another failure
                    576:        to (re-)initialize.  thanks to steve fisher for spotting this and
                    577:        providing a good test case.
                    578:
                    579: Nov 22, 2003:
                    580:        fixed a bug in regular expressions that dates (so help me) from 1977;
                    581:        it's been there from the beginning.  an anchored longest match that
                    582:        was longer than the number of states triggered a failure to initialize
                    583:        the machine properly.  many thanks to moinak ghosh for not only finding
                    584:        this one but for providing a fix, in some of the most mysterious
                    585:        code known to man.
                    586:
                    587:        fixed a storage leak in call() that appears to have been there since
1.25      millert   588:        1983 or so -- a function without an explicit return that assigns a
                    589:        string to a parameter leaked a Cell.  thanks to moinak ghosh for
1.13      millert   590:        spotting this very subtle one.
                    591:
                    592: Jul 31, 2003:
                    593:        fixed, thanks to andrey chernov and ruslan ermilov, a bug in lex.c
                    594:        that mis-handled the character 255 in input.  (it was being compared
                    595:        to EOF with a signed comparison.)
                    596:
                    597: Jul 29, 2003:
                    598:        fixed (i think) the long-standing botch that included the beginning of
                    599:        line state ^ for RE's in the set of valid characters; this led to a
                    600:        variety of odd problems, including failure to properly match certain
                    601:        regular expressions in non-US locales.  thanks to ruslan for keeping
                    602:        at this one.
                    603:
                    604: Jul 28, 2003:
                    605:        n-th try at getting internationalization right, with thanks to volker
                    606:        kiefel, arnold robbins and ruslan ermilov for advice, though they
                    607:        should not be blamed for the outcome.  according to posix, "."  is the
                    608:        radix character in programs and command line arguments regardless of
                    609:        the locale; otherwise, the locale should prevail for input and output
                    610:        of numbers.  so it's intended to work that way.
1.25      millert   611:
1.13      millert   612:        i have rescinded the attempt to use strcoll in expanding shorthands in
                    613:        regular expressions (cclenter).  its properties are much too
                    614:        surprising; for example [a-c] matches aAbBc in locale en_US but abBcC
                    615:        in locale fr_CA.  i can see how this might arise by implementation
                    616:        but i cannot explain it to a human user.  (this behavior can be seen
                    617:        in gawk as well; we're leaning on the same library.)
                    618:
                    619:        the issue appears to be that strcoll is meant for sorting, where
                    620:        merging upper and lower case may make sense (though note that unix
                    621:        sort does not do this by default either).  it is not appropriate
                    622:        for regular expressions, where the goal is to match specific
                    623:        patterns of characters.  in any case, the notations [:lower:], etc.,
                    624:        are available in awk, and they are more likely to work correctly in
                    625:        most locales.
                    626:
                    627:        a moratorium is hereby declared on internationalization changes.
                    628:        i apologize to friends and colleagues in other parts of the world.
                    629:        i would truly like to get this "right", but i don't know what
                    630:        that is, and i do not want to keep making changes until it's clear.
                    631:
                    632: Jul 4, 2003:
                    633:        fixed bug that permitted non-terminated RE, as in "awk /x".
                    634:
                    635: Jun 1, 2003:
                    636:        subtle change to split: if source is empty, number of elems
                    637:        is always 0 and the array is not set.
                    638:
                    639: Mar 21, 2003:
                    640:        added some parens to isblank, in another attempt to make things
                    641:        internationally portable.
                    642:
                    643: Mar 14, 2003:
                    644:        the internationalization changes, somewhat modified, are now
                    645:        reinstated.  in theory awk will now do character comparisons
                    646:        and case conversions in national language, but "." will always
                    647:        be the decimal point separator on input and output regardless
                    648:        of national language.  isblank(){} has an #ifndef.
                    649:
                    650:        this no longer compiles on windows: LC_MESSAGES isn't defined
                    651:        in vc6++.
                    652:
                    653:        fixed subtle behavior in field and record splitting: if FS is
                    654:        a single character and RS is not empty, \n is NOT a separator.
                    655:        this tortuous reading is found in the awk book; behavior now
                    656:        matches gawk and mawk.
1.11      millert   657:
                    658: Dec 13, 2002:
                    659:        for the moment, the internationalization changes of nov 29 are
                    660:        rolled back -- programs like x = 1.2 don't work in some locales,
                    661:        because the parser is expecting x = 1,2.  until i understand this
                    662:        better, this will have to wait.
                    663:
                    664: Nov 29, 2002:
                    665:        modified b.c (with tiny changes in main and run) to support
                    666:        locales, using strcoll and iswhatever tests for posix character
                    667:        classes.  thanks to ruslan ermilov (ru@freebsd.org) for code.
                    668:        the function isblank doesn't seem to have propagated to any
                    669:        header file near me, so it's there explicitly.  not properly
                    670:        tested on non-ascii character sets by me.
                    671:
                    672: Jun 28, 2002:
                    673:        modified run/format() and tran/getsval() to do a slightly better
                    674:        job on using OFMT for output from print and CONVFMT for other
1.25      millert   675:        number->string conversions, as promised by posix and done by
1.11      millert   676:        gawk and mawk.  there are still places where it doesn't work
                    677:        right if CONVFMT is changed; by then the STR attribute of the
                    678:        variable has been irrevocably set.  thanks to arnold robbins for
                    679:        code and examples.
                    680:
                    681:        fixed subtle bug in format that could get core dump.  thanks to
                    682:        Jaromir Dolecek <jdolecek@NetBSD.org> for finding and fixing.
                    683:        minor cleanup in run.c / format() at the same time.
                    684:
                    685:        added some tests for null pointers to debugging printf's, which
                    686:        were never intended for external consumption.  thanks to dave
                    687:        kerns (dkerns@lucent.com) for pointing this out.
                    688:
                    689:        GNU compatibility: an empty regexp matches anything (thanks to
                    690:        dag-erling smorgrav, des@ofug.org).  subject to reversion if
                    691:        this does more harm than good.
                    692:
                    693:        pervasive small changes to make things more const-correct, as
                    694:        reported by gcc's -Wwrite-strings.  as it says in the gcc manual,
                    695:        this may be more nuisance than useful.  provoked by a suggestion
                    696:        and code from arnaud desitter, arnaud@nimbus.geog.ox.ac.uk
                    697:
                    698:        minor documentation changes to note that this now compiles out
                    699:        of the box on Mac OS X.
                    700:
                    701: Feb 10, 2002:
                    702:        changed types in posix chars structure to quiet solaris cc.
                    703:
                    704: Jan 1, 2002:
                    705:        fflush() or fflush("") flushes all files and pipes.
                    706:
1.25      millert   707:        length(arrayname) returns number of elements; thanks to
1.11      millert   708:        arnold robbins for suggestion.
                    709:
                    710:        added a makefile.win to make it easier to build on windows.
                    711:        based on dan allen's buildwin.bat.
                    712:
                    713: Nov 16, 2001:
                    714:        added support for posix character class names like [:digit:],
                    715:        which are not exactly shorter than [0-9] and perhaps no more
                    716:        portable.  thanks to dag-erling smorgrav for code.
                    717:
                    718: Feb 16, 2001:
                    719:        removed -m option; no longer needed, and it was actually
                    720:        broken (noted thanks to volker kiefel).
                    721:
                    722: Feb 10, 2001:
                    723:        fixed an appalling bug in gettok: any sequence of digits, +,-, E, e,
                    724:        and period was accepted as a valid number if it started with a period.
                    725:        this would never have happened with the lex version.
                    726:
                    727:        other 1-character botches, now fixed, include a bare $ and a
                    728:        bare " at the end of the input.
                    729:
                    730: Feb 7, 2001:
                    731:        more (const char *) casts in b.c and tran.c to silence warnings.
1.8       millert   732:
1.10      millert   733: Nov 15, 2000:
                    734:        fixed a bug introduced in august 1997 that caused expressions
                    735:        like $f[1] to be syntax errors.  thanks to arnold robbins for
                    736:        noticing this and providing a fix.
                    737:
                    738: Oct 30, 2000:
                    739:        fixed some nextfile bugs: not handling all cases.  thanks to
                    740:        arnold robbins for pointing this out.  new regressions added.
                    741:
                    742:        close() is now a function.  it returns whatever the library
                    743:        fclose returns, and -1 for closing a file or pipe that wasn't
                    744:        opened.
                    745:
                    746: Sep 24, 2000:
                    747:        permit \n explicitly in character classes; won't work right
                    748:        if comes in as "[\n]" but ok as /[\n]/, because of multiple
                    749:        processing of \'s.  thanks to arnold robbins.
                    750:
                    751: July 5, 2000:
                    752:        minor fiddles in tran.c to keep compilers happy about uschar.
                    753:        thanks to norman wilson.
                    754:
                    755: May 25, 2000:
                    756:        yet another attempt at making 8-bit input work, with another
1.25      millert   757:        band-aid in b.c (member()), and some (uschar) casts to head
1.10      millert   758:        off potential errors in subscripts (like isdigit).  also
                    759:        changed HAT to NCHARS-2.  thanks again to santiago vila.
                    760:
                    761:        changed maketab.c to ignore apparently out of range definitions
                    762:        instead of halting; new freeBSD generates one.  thanks to
                    763:        jon snader <jsnader@ix.netcom.com> for pointing out the problem.
                    764:
                    765: May 2, 2000:
                    766:        fixed an 8-bit problem in b.c by making several char*'s into
                    767:        unsigned char*'s.  not clear i have them all yet.  thanks to
                    768:        Santiago Vila <sanvila@unex.es> for the bug report.
                    769:
                    770: Apr 21, 2000:
                    771:        finally found and fixed a memory leak in function call; it's
                    772:        been there since functions were added ~1983.  thanks to
                    773:        jon bentley for the test case that found it.
                    774:
                    775:        added test in envinit to catch environment "variables" with
1.12      otto      776:        names beginning with '='; thanks to Berend Hasselman.
1.10      millert   777:
                    778: Jul 28, 1999:
                    779:        added test in defn() to catch function foo(foo), which
                    780:        otherwise recurses until core dump.  thanks to arnold
                    781:        robbins for noticing this.
                    782:
1.9       millert   783: Jun 20, 1999:
                    784:        added *bp in gettok in lex.c; appears possible to exit function
                    785:        without terminating the string.  thanks to russ cox.
                    786:
                    787: Jun 2, 1999:
                    788:        added function stdinit() to run to initialize files[] array,
                    789:        in case stdin, etc., are not constants; some compilers care.
                    790:
                    791: May 10, 1999:
                    792:        replaced the ERROR ... FATAL, etc., macros with functions
                    793:        based on vprintf, to avoid problems caused by overrunning
                    794:        fixed-size errbuf array.  thanks to ralph corderoy for the
                    795:        impetus, and for pointing out a string termination bug in
                    796:        qstring as well.
                    797:
                    798: Apr 21, 1999:
                    799:        fixed bug that caused occasional core dumps with commandline
                    800:        variable with value ending in \.  (thanks to nelson beebe for
                    801:        the test case.)
                    802:
1.8       millert   803: Apr 16, 1999:
1.25      millert   804:        with code kindly provided by Bruce Lilly, awk now parses
1.8       millert   805:        /=/ and similar constructs more sensibly in more places.
1.10      millert   806:        Bruce also provided some helpful test cases.
1.8       millert   807:
                    808: Apr 5, 1999:
                    809:        changed true/false to True/False in run.c to make it
                    810:        easier to compile with C++.  Added some casts on malloc
                    811:        and realloc to be honest about casts; ditto.  changed
                    812:        ltype int to long in struct rrow to reduce some 64-bit
                    813:        complaints; other changes scattered throughout for the
                    814:        same purpose.  thanks to Nelson Beebe for these portability
                    815:        improvements.
                    816:
                    817:        removed some horrible pointer-int casting in b.c and elsewhere
                    818:        by adding ptoi and itonp to localize the casts, which are
                    819:        all benign.  fixed one incipient bug that showed up on sgi
                    820:        in 64-bit mode.
                    821:
                    822:        reset lineno for new source file; include filename in error
                    823:        message.  also fixed line number error in continuation lines.
                    824:        (thanks to Nelson Beebe for both of these.)
                    825:
                    826: Mar 24, 1999:
                    827:        Nelson Beebe notes that irix 5.3 yacc dies with a bogus
                    828:        error; use a newer version or switch to bison, since sgi
                    829:        is unlikely to fix it.
1.1       tholo     830:
1.7       millert   831: Mar 5, 1999:
1.9       millert   832:        changed isnumber to is_number to avoid the problem caused by
                    833:        versions of ctype.h that include the name isnumber.
1.7       millert   834:
                    835:        distribution now includes a script for building on a Mac,
                    836:        thanks to Dan Allen.
                    837:
                    838: Feb 20, 1999:
                    839:        fixed memory leaks in run.c (call) and tran.c (setfval).
                    840:        thanks to Stephen Nutt for finding these and providing the fixes.
                    841:
                    842: Jan 13, 1999:
                    843:        replaced srand argument by (unsigned int) in run.c;
                    844:        avoids problem on Mac and potentially on Unix & Windows.
                    845:        thanks to Dan Allen.
                    846:
                    847:        added a few (int) casts to silence useless compiler warnings.
                    848:        e.g., errorflag= in run.c jump().
                    849:
                    850:        added proctab.c to the bundle outout; one less thing
                    851:        to have to compile out of the box.
                    852:
                    853:        added calls to _popen and _pclose to the win95 stub for
                    854:        pipes (thanks to Steve Adams for this helpful suggestion).
                    855:        seems to work, though properties are not well understood
                    856:        by me, and it appears that under some circumstances the
                    857:        pipe output is truncated.  Be careful.
                    858:
                    859: Oct 19, 1998:
                    860:        fixed a couple of bugs in getrec: could fail to update $0
1.25      millert   861:        after a getline var; because inputFS wasn't initialized,
1.7       millert   862:        could split $0 on every character, a misleading diversion.
                    863:
                    864:        fixed caching bug in makedfa: LRU was actually removing
                    865:        least often used.
                    866:
                    867:        thanks to ross ridge for finding these, and for providing
                    868:        great bug reports.
                    869:
                    870: May 12, 1998:
                    871:        fixed potential bug in readrec: might fail to update record
                    872:        pointer after growing.  thanks to dan levy for spotting this
                    873:        and suggesting the fix.
                    874:
                    875: Mar 12, 1998:
                    876:        added -V to print version number and die.
1.19      millert   877:
                    878: [notify dave kerns, dkerns@dacsoup.ih.lucent.com]
1.7       millert   879:
                    880: Feb 11, 1998:
                    881:        subtle silent bug in lex.c: if the program ended with a number
                    882:        longer than 1 digit, part of the input would be pushed back and
                    883:        parsed again because token buffer wasn't terminated right.
                    884:        example:  awk 'length($0) > 10'.  blush.  at least i found it
                    885:        myself.
                    886:
                    887: Aug 31, 1997:
                    888:        s/adelete/awkdelete/: SGI uses this in malloc.h.
                    889:        thanks to nelson beebe for pointing this one out.
                    890:
                    891: Aug 21, 1997:
                    892:        fixed some bugs in sub and gsub when replacement includes \\.
                    893:        this is a dark, horrible corner, but at least now i believe that
                    894:        the behavior is the same as gawk and the intended posix standard.
                    895:        thanks to arnold robbins for advice here.
                    896:
                    897: Aug 9, 1997:
                    898:        somewhat regretfully, replaced the ancient lex-based lexical
                    899:        analyzer with one written in C.  it's longer, generates less code,
                    900:        and more portable; the old one depended too much on mysterious
                    901:        properties of lex that were not preserved in other environments.
                    902:        in theory these recognize the same language.
                    903:
                    904:        now using strtod to test whether a string is a number, instead of
                    905:        the convoluted original function.  should be more portable and
                    906:        reliable if strtod is implemented right.
                    907:
                    908:        removed now-pointless optimization in makefile that tries to avoid
                    909:        recompilation when awkgram.y is changed but symbols are not.
                    910:
                    911:        removed most fixed-size arrays, though a handful remain, some
                    912:        of which are unchecked.  you have been warned.
                    913:
                    914: Aug 4, 1997:
                    915:        with some trepidation, replaced the ancient code that managed
                    916:        fields and $0 in fixed-size arrays with arrays that grow on
                    917:        demand.  there is still some tension between trying to make this
                    918:        run fast and making it clean; not sure it's right yet.
                    919:
                    920:        the ill-conceived -mr and -mf arguments are now useful only
                    921:        for debugging.  previous dynamic string code removed.
                    922:
                    923:        numerous other minor cleanups along the way.
1.1       tholo     924:
1.7       millert   925: Jul 30, 1997:
                    926:        using code provided by dan levy (to whom profuse thanks), replaced
                    927:        fixed-size arrays and awkward kludges by a fairly uniform mechanism
                    928:        to grow arrays as needed for printf, sub, gsub, etc.
1.1       tholo     929:
1.7       millert   930: Jul 23, 1997:
                    931:        falling off the end of a function returns "" and 0, not 0.
                    932:        thanks to arnold robbins.
1.1       tholo     933:
1.7       millert   934: Jun 17, 1997:
                    935:        replaced several fixed-size arrays by dynamically-created ones
                    936:        in run.c; added overflow tests to some previously unchecked cases.
                    937:        getline, toupper, tolower.
1.1       tholo     938:
1.7       millert   939:        getline code is still broken in that recursive calls may wind
                    940:        up using the same space.  [fixed later]
1.1       tholo     941:
1.7       millert   942:        increased RECSIZE to 8192 to push problems further over the horizon.
1.1       tholo     943:
1.7       millert   944:        added \r to \n as input line separator for programs, not data.
                    945:        damn CRLFs.
1.1       tholo     946:
1.7       millert   947:        modified format() to permit explicit printf("%c", 0) to include
                    948:        a null byte in output.  thanks to ken stailey for the fix.
1.1       tholo     949:
1.7       millert   950:        added a "-safe" argument that disables file output (print >,
                    951:        print >>), process creation (cmd|getline, print |, system), and
                    952:        access to the environment (ENVIRON).  this is a first approximation
                    953:        to a "safe" version of awk, but don't rely on it too much.  thanks
                    954:        to joan feigenbaum and matt blaze for the inspiration long ago.
1.1       tholo     955:
1.7       millert   956: Jul 8, 1996:
                    957:        fixed long-standing bug in sub, gsub(/a/, "\\\\&"); thanks to
                    958:        ralph corderoy.
1.1       tholo     959:
1.7       millert   960: Jun 29, 1996:
                    961:        fixed awful bug in new field splitting; didn't get all the places
                    962:        where input was done.
1.1       tholo     963:
1.7       millert   964: Jun 28, 1996:
                    965:        changed field-splitting to conform to posix definition: fields are
                    966:        split using the value of FS at the time of input; it used to be
                    967:        the value when the field or NF was first referred to, a much less
                    968:        predictable definition.  thanks to arnold robbins for encouragement
                    969:        to do the right thing.
1.1       tholo     970:
1.7       millert   971: May 28, 1996:
                    972:        fixed appalling but apparently unimportant bug in parsing octal
                    973:        numbers in reg exprs.
1.1       tholo     974:
1.7       millert   975:        explicit hex in reg exprs now limited to 2 chars: \xa, \xaa.
1.1       tholo     976:
1.7       millert   977: May 27, 1996:
                    978:        cleaned up some declarations so gcc -Wall is now almost silent.
1.1       tholo     979:
1.7       millert   980:        makefile now includes backup copies of ytab.c and lexyy.c in case
                    981:        one makes before looking; it also avoids recreating lexyy.c unless
                    982:        really needed.
1.1       tholo     983:
1.7       millert   984:        s/aprintf/awkprint, s/asprintf/awksprintf/ to avoid some name clashes
                    985:        with unwisely-written header files.
1.1       tholo     986:
1.7       millert   987:        thanks to jeffrey friedl for several of these.
1.1       tholo     988:
1.7       millert   989: May 26, 1996:
                    990:        an attempt to rationalize the (unsigned) char issue.  almost all
                    991:        instances of unsigned char have been removed; the handful of places
                    992:        in b.c where chars are used as table indices have been hand-crafted.
                    993:        added some latin-1 tests to the regression, but i'm not confident;
                    994:        none of my compilers seem to care much.  thanks to nelson beebe for
                    995:        pointing out some others that do care.
1.1       tholo     996:
1.7       millert   997: May 2, 1996:
                    998:        removed all register declarations.
1.1       tholo     999:
1.7       millert  1000:        enhanced split(), as in gawk, etc:  split(s, a, "") splits s into
                   1001:        a[1]...a[length(s)] with each character a single element.
1.1       tholo    1002:
1.7       millert  1003:        made the same changes for field-splitting if FS is "".
1.1       tholo    1004:
1.7       millert  1005:        added nextfile, as in gawk: causes immediate advance to next
                   1006:        input file. (thanks to arnold robbins for inspiration and code).
1.1       tholo    1007:
1.7       millert  1008:        small fixes to regexpr code:  can now handle []], [[], and
1.25      millert  1009:        variants;  [] is now a syntax error, rather than matching
1.7       millert  1010:        everything;  [z-a] is now empty, not z.  far from complete
                   1011:        or correct, however.  (thanks to jeffrey friedl for pointing out
                   1012:        some awful behaviors.)
1.1       tholo    1013:
1.7       millert  1014: Apr 29, 1996:
1.12      otto     1015:        replaced uchar by uschar everywhere; apparently some compilers
1.7       millert  1016:        usurp this name and this causes conflicts.
1.1       tholo    1017:
1.7       millert  1018:        fixed call to time in run.c (bltin); arg is time_t *.
1.1       tholo    1019:
1.7       millert  1020:        replaced horrible pointer/long punning in b.c by a legitimate
                   1021:        union.  should be safer on 64-bit machines and cleaner everywhere.
                   1022:        (thanks to nelson beebe for pointing out some of these problems.)
1.1       tholo    1023:
1.7       millert  1024:        replaced nested comments by #if 0...#endif in run.c, lib.c.
1.1       tholo    1025:
1.7       millert  1026:        removed getsval, setsval, execute macros from run.c and lib.c.
                   1027:        machines are 100x faster than they were when these macros were
                   1028:        first used.
1.1       tholo    1029:
1.7       millert  1030:        revised filenames: awk.g.y => awkgram.y, awk.lx.l => awklex.l,
                   1031:        y.tab.[ch] => ytab.[ch], lex.yy.c => lexyy.c, all in the aid of
                   1032:        portability to nameless systems.
1.1       tholo    1033:
1.7       millert  1034:        "make bundle" now includes yacc and lex output files for recipients
                   1035:        who don't have yacc or lex.
1.1       tholo    1036:
1.7       millert  1037: Aug 15, 1995:
                   1038:        initialized Cells in setsymtab more carefully; some fields
                   1039:        were not set.  (thanks to purify, all of whose complaints i
                   1040:        think i now understand.)
1.1       tholo    1041:
1.7       millert  1042:        fixed at least one error in gsub that looked at -1-th element
                   1043:        of an array when substituting for a null match (e.g., $).
1.1       tholo    1044:
1.7       millert  1045:        delete arrayname is now legal; it clears the elements but leaves
                   1046:        the array, which may not be the right behavior.
1.1       tholo    1047:
1.7       millert  1048:        modified makefile: my current make can't cope with the test used
                   1049:        to avoid unnecessary yacc invocations.
1.1       tholo    1050:
1.7       millert  1051: Jul 17, 1995:
                   1052:        added dynamically growing strings to awk.lx.l and b.c
                   1053:        to permit regular expressions to be much bigger.
                   1054:        the state arrays can still overflow.
1.1       tholo    1055:
1.7       millert  1056: Aug 24, 1994:
                   1057:        detect duplicate arguments in function definitions (mdm).
1.1       tholo    1058:
1.7       millert  1059: May 11, 1994:
                   1060:        trivial fix to printf to limit string size in sub().
1.1       tholo    1061:
1.7       millert  1062: Apr 22, 1994:
                   1063:        fixed yet another subtle self-assignment problem:
                   1064:        $1 = $2; $1 = $1 clobbered $1.
1.1       tholo    1065:
1.7       millert  1066:        Regression tests now use private echo, to avoid quoting problems.
1.1       tholo    1067:
1.7       millert  1068: Feb 2, 1994:
                   1069:        changed error() to print line number as %d, not %g.
1.1       tholo    1070:
1.7       millert  1071: Jul 23, 1993:
                   1072:        cosmetic changes: increased sizes of some arrays,
                   1073:        reworded some error messages.
1.1       tholo    1074:
1.7       millert  1075:        added CONVFMT as in posix (just replaced OFMT in getsval)
1.1       tholo    1076:
1.7       millert  1077:        FILENAME is now "" until the first thing that causes a file
                   1078:        to be opened.
1.1       tholo    1079:
1.7       millert  1080: Nov 28, 1992:
                   1081:        deleted yyunput and yyoutput from proto.h;
                   1082:        different versions of lex give these different declarations.
1.1       tholo    1083:
1.7       millert  1084: May 31, 1992:
                   1085:        added -mr N and -mf N options: more record and fields.
                   1086:        these really ought to adjust automatically.
1.1       tholo    1087:
1.7       millert  1088:        cleaned up some error messages; "out of space" now means
                   1089:        malloc returned NULL in all cases.
1.1       tholo    1090:
1.7       millert  1091:        changed rehash so that if it runs out, it just returns;
                   1092:        things will continue to run slow, but maybe a bit longer.
1.1       tholo    1093:
1.7       millert  1094: Apr 24, 1992:
                   1095:        remove redundant close of stdin when using -f -.
1.1       tholo    1096:
1.7       millert  1097:        got rid of core dump with -d; awk -d just prints date.
1.1       tholo    1098:
1.7       millert  1099: Apr 12, 1992:
                   1100:        added explicit check for /dev/std(in,out,err) in redirection.
                   1101:        unlike gawk, no /dev/fd/n yet.
1.1       tholo    1102:
1.7       millert  1103:        added (file/pipe) builtin.  hard to test satisfactorily.
                   1104:        not posix.
1.1       tholo    1105:
1.7       millert  1106: Feb 20, 1992:
                   1107:        recompile after abortive changes;  should be unchanged.
1.1       tholo    1108:
1.7       millert  1109: Dec 2, 1991:
                   1110:        die-casting time:  converted to ansi C, installed that.
1.1       tholo    1111:
1.7       millert  1112: Nov 30, 1991:
                   1113:        fixed storage leak in freefa, failing to recover [N]CCL.
                   1114:        thanks to Bill Jones (jones@cs.usask.ca)
1.1       tholo    1115:
1.7       millert  1116: Nov 19, 1991:
                   1117:        use RAND_MAX instead of literal in builtin().
1.1       tholo    1118:
1.7       millert  1119: Nov 12, 1991:
                   1120:        cranked up some fixed-size arrays in b.c, and added a test for
                   1121:        overflow in penter.  thanks to mark larsen.
1.1       tholo    1122:
1.7       millert  1123: Sep 24, 1991:
                   1124:        increased buffer in gsub.  a very crude fix to a general problem.
                   1125:        and again on Sep 26.
1.1       tholo    1126:
1.7       millert  1127: Aug 18, 1991:
                   1128:        enforce variable name syntax for commandline variables: has to
                   1129:        start with letter or _.
1.1       tholo    1130:
1.7       millert  1131: Jul 27, 1991:
                   1132:        allow newline after ; in for statements.
1.1       tholo    1133:
1.7       millert  1134: Jul 21, 1991:
                   1135:        fixed so that in self-assignment like $1=$1, side effects
                   1136:        like recomputing $0 take place.  (this is getting subtle.)
1.1       tholo    1137:
1.7       millert  1138: Jun 30, 1991:
                   1139:        better test for detecting too-long output record.
1.1       tholo    1140:
1.7       millert  1141: Jun 2, 1991:
                   1142:        better defense against very long printf strings.
                   1143:        made break and continue illegal outside of loops.
1.1       tholo    1144:
1.7       millert  1145: May 13, 1991:
                   1146:        removed extra arg on gettemp, tempfree.  minor error message rewording.
1.1       tholo    1147:
                   1148: May 6, 1991:
                   1149:        fixed silly bug in hex parsing in hexstr().
                   1150:        removed an apparently unnecessary test in isnumber().
                   1151:        warn about weird printf conversions.
                   1152:        fixed unchecked array overwrite in relex().
                   1153:
                   1154:        changed for (i in array) to access elements in sorted order.
                   1155:        then unchanged it -- it really does run slower in too many cases.
                   1156:        left the code in place, commented out.
                   1157:
1.7       millert  1158: Feb 10, 1991:
                   1159:        check error status on all writes, to avoid banging on full disks.
1.1       tholo    1160:
1.7       millert  1161: Jan 28, 1991:
                   1162:        awk -f - reads the program from stdin.
1.1       tholo    1163:
1.7       millert  1164: Jan 11, 1991:
                   1165:        failed to set numeric state on $0 in cmd|getline context in run.c.
1.1       tholo    1166:
1.7       millert  1167: Nov 2, 1990:
                   1168:        fixed sleazy test for integrality in getsval;  use modf.
1.1       tholo    1169:
1.7       millert  1170: Oct 29, 1990:
                   1171:        fixed sleazy buggy code in lib.c that looked (incorrectly) for
                   1172:        too long input lines.
1.1       tholo    1173:
1.7       millert  1174: Oct 14, 1990:
                   1175:        fixed the bug on p. 198 in which it couldn't deduce that an
                   1176:        argument was an array in some contexts.  replaced the error
                   1177:        message in intest() by code that damn well makes it an array.
1.1       tholo    1178:
1.7       millert  1179: Oct 8, 1990:
                   1180:        fixed horrible bug:  types and values were not preserved in
                   1181:        some kinds of self-assignment. (in assign().)
1.1       tholo    1182:
1.7       millert  1183: Aug 24, 1990:
                   1184:        changed NCHARS to 256 to handle 8-bit characters in strings
                   1185:        presented to match(), etc.
1.1       tholo    1186:
1.7       millert  1187: Jun 26, 1990:
                   1188:        changed struct rrow (awk.h) to use long instead of int for lval,
                   1189:        since cfoll() stores a pointer in it.  now works better when int's
                   1190:        are smaller than pointers!
1.1       tholo    1191:
1.7       millert  1192: May 6, 1990:
                   1193:        AVA fixed the grammar so that ! is uniformly of the same precedence as
                   1194:        unary + and -.  This renders illegal some constructs like !x=y, which
                   1195:        now has to be parenthesized as !(x=y), and makes others work properly:
                   1196:        !x+y is (!x)+y, and x!y is x !y, not two pattern-action statements.
                   1197:        (These problems were pointed out by Bob Lenk of Posix.)
1.1       tholo    1198:
1.7       millert  1199:        Added \x to regular expressions (already in strings).
                   1200:        Limited octal to octal digits; \8 and \9 are not octal.
                   1201:        Centralized the code for parsing escapes in regular expressions.
                   1202:        Added a bunch of tests to T.re and T.sub to verify some of this.
1.1       tholo    1203:
1.7       millert  1204: Feb 9, 1990:
                   1205:        fixed null pointer dereference bug in main.c:  -F[nothing].  sigh.
1.1       tholo    1206:
1.7       millert  1207:        restored srand behavior:  it returns the current seed.
1.1       tholo    1208:
1.7       millert  1209: Jan 18, 1990:
                   1210:        srand now returns previous seed value (0 to start).
1.1       tholo    1211:
1.7       millert  1212: Jan 5, 1990:
                   1213:        fix potential problem in tran.c -- something was freed,
                   1214:        then used in freesymtab.
1.1       tholo    1215:
1.7       millert  1216: Oct 18, 1989:
                   1217:        another try to get the max number of open files set with
                   1218:        relatively machine-independent code.
1.1       tholo    1219:
1.7       millert  1220:        small fix to input() in case of multiple reads after EOF.
1.1       tholo    1221:
1.7       millert  1222: Oct 11, 1989:
                   1223:        FILENAME is now defined in the BEGIN block -- too many old
                   1224:        programs broke.
1.1       tholo    1225:
1.7       millert  1226:        "-" means stdin in getline as well as on the commandline.
1.1       tholo    1227:
1.7       millert  1228:        added a bunch of casts to the code to tell the truth about
                   1229:        char * vs. unsigned char *, a right royal pain.  added a
                   1230:        setlocale call to the front of main, though probably no one
                   1231:        has it usefully implemented yet.
1.1       tholo    1232:
1.7       millert  1233: Aug 24, 1989:
                   1234:        removed redundant relational tests against nullnode if parse
                   1235:        tree already had a relational at that point.
1.1       tholo    1236:
1.7       millert  1237: Aug 11, 1989:
                   1238:        fixed bug:  commandline variable assignment has to look like
                   1239:        var=something.  (consider the man page for =, in file =.1)
1.1       tholo    1240:
1.7       millert  1241:        changed number of arguments to functions to static arrays
                   1242:        to avoid repeated malloc calls.
1.1       tholo    1243:
1.7       millert  1244: Aug 2, 1989:
                   1245:        restored -F (space) separator
1.1       tholo    1246:
1.7       millert  1247: Jul 30, 1989:
                   1248:        added -v x=1 y=2 ... for immediate commandline variable assignment;
                   1249:        done before the BEGIN block for sure.  they have to precede the
                   1250:        program if the program is on the commandline.
                   1251:        Modified Aug 2 to require a separate -v for each assignment.
1.1       tholo    1252:
1.7       millert  1253: Jul 10, 1989:
                   1254:        fixed ref-thru-zero bug in environment code in tran.c
1.1       tholo    1255:
1.7       millert  1256: Jun 23, 1989:
                   1257:        add newline to usage message.
1.1       tholo    1258:
1.7       millert  1259: Jun 14, 1989:
                   1260:        added some missing ansi printf conversion letters: %i %X %E %G.
                   1261:        no sensible meaning for h or L, so they may not do what one expects.
1.1       tholo    1262:
1.7       millert  1263:        made %* conversions work.
1.1       tholo    1264:
1.7       millert  1265:        changed x^y so that if n is a positive integer, it's done
                   1266:        by explicit multiplication, thus achieving maximum accuracy.
                   1267:        (this should be done by pow() but it seems not to be locally.)
                   1268:        done to x ^= y as well.
1.1       tholo    1269:
1.7       millert  1270: Jun 4, 1989:
                   1271:        ENVIRON array contains environment: if shell variable V=thing,
                   1272:                ENVIRON["V"] is "thing"
1.1       tholo    1273:
1.7       millert  1274:        multiple -f arguments permitted.  error reporting is naive.
                   1275:        (they were permitted before, but only the last was used.)
1.1       tholo    1276:
1.7       millert  1277:        fixed a really stupid botch in the debugging macro dprintf
1.1       tholo    1278:
1.7       millert  1279:        fixed order of evaluation of commandline assignments to match
                   1280:        what the book claims:  an argument of the form x=e is evaluated
                   1281:        at the time it would have been opened if it were a filename (p 63).
                   1282:        this invalidates the suggested answer to ex 4-1 (p 195).
1.1       tholo    1283:
1.7       millert  1284:        removed some code that permitted -F (space) fieldseparator,
                   1285:        since it didn't quite work right anyway.  (restored aug 2)
1.1       tholo    1286:
1.7       millert  1287: Apr 27, 1989:
                   1288:        Line number now accumulated correctly for comment lines.
1.1       tholo    1289:
1.7       millert  1290: Apr 26, 1989:
                   1291:        Debugging output now includes a version date,
                   1292:        if one compiles it into the source each time.
1.1       tholo    1293:
1.7       millert  1294: Apr 9, 1989:
                   1295:        Changed grammar to prohibit constants as 3rd arg of sub and gsub;
                   1296:        prevents class of overwriting-a-constant errors.  (Last one?)
                   1297:        This invalidates the "banana" example on page 43 of the book.
1.1       tholo    1298:
1.7       millert  1299:        Added \a ("alert"), \v (vertical tab), \xhhh (hexadecimal),
                   1300:        as in ANSI, for strings.  Rescinded the sloppiness that permitted
                   1301:        non-octal digits in \ooo.  Warning:  not all compilers and libraries
                   1302:        will be able to deal with \x correctly.
1.1       tholo    1303:
1.7       millert  1304: Jan 9, 1989:
                   1305:        Fixed bug that caused tempcell list to contain a duplicate.
                   1306:        The fix is kludgy.
1.1       tholo    1307:
1.7       millert  1308: Dec 17, 1988:
                   1309:        Catches some more commandline errors in main.
                   1310:        Removed redundant decl of modf in run.c (confuses some compilers).
                   1311:        Warning:  there's no single declaration of malloc, etc., in awk.h
                   1312:        that seems to satisfy all compilers.
1.1       tholo    1313:
1.7       millert  1314: Dec 7, 1988:
                   1315:        Added a bit of code to error printing to avoid printing nulls.
                   1316:        (Not clear that it actually would.)
1.1       tholo    1317:
1.7       millert  1318: Nov 27, 1988:
                   1319:        With fear and trembling, modified the grammar to permit
                   1320:        multiple pattern-action statements on one line without
                   1321:        an explicit separator.  By definition, this capitulation
                   1322:        to the ghost of ancient implementations remains undefined
                   1323:        and thus subject to change without notice or apology.
                   1324:        DO NOT COUNT ON IT.
1.1       tholo    1325:
1.7       millert  1326: Oct 30, 1988:
                   1327:        Fixed bug in call() that failed to recover storage.
1.1       tholo    1328:
1.7       millert  1329:        A warning is now generated if there are more arguments
                   1330:        in the call than in the definition (in lieu of fixing
                   1331:        another storage leak).
1.2       millert  1332:
1.7       millert  1333: Oct 20, 1988:
                   1334:        Fixed %c:  if expr is numeric, use numeric value;
                   1335:        otherwise print 1st char of string value.  still
                   1336:        doesn't work if the value is 0 -- won't print \0.
1.2       millert  1337:
1.7       millert  1338:        Added a few more checks for running out of malloc.
1.2       millert  1339:
1.7       millert  1340: Oct 12, 1988:
                   1341:        Fixed bug in call() that freed local arrays twice.
1.5       kstailey 1342:
1.7       millert  1343:        Fixed to handle deletion of non-existent array right;
                   1344:        complains about attempt to delete non-array element.
1.6       kstailey 1345:
1.7       millert  1346: Sep 30, 1988:
                   1347:        Now guarantees to evaluate all arguments of built-in
                   1348:        functions, as in C;  the appearance is that arguments
                   1349:        are evaluated before the function is called.  Places
                   1350:        affected are sub (gsub was ok), substr, printf, and
                   1351:        all the built-in arithmetic functions in bltin().
                   1352:        A warning is generated if a bltin() is called with
                   1353:        the wrong number of arguments.
1.6       kstailey 1354:
1.7       millert  1355:        This requires changing makeprof on p167 of the book.
1.6       kstailey 1356:
1.7       millert  1357: Aug 23, 1988:
                   1358:        setting FILENAME in BEGIN caused core dump, apparently
                   1359:        because it was freeing space not allocated by malloc.
1.6       kstailey 1360:
1.7       millert  1361: July 24, 1988:
                   1362:        fixed egregious error in toupper/tolower functions.
                   1363:        still subject to rescinding, however.
1.6       kstailey 1364:
1.7       millert  1365: July 2, 1988:
                   1366:        flush stdout before opening file or pipe
1.6       kstailey 1367:
1.7       millert  1368: July 2, 1988:
                   1369:        performance bug in b.c/cgoto(): not freeing some sets of states.
                   1370:        partial fix only right now, and the number of states increased
                   1371:        to make it less obvious.
1.6       kstailey 1372:
1.7       millert  1373: June 1, 1988:
                   1374:        check error status on close
1.6       kstailey 1375:
1.7       millert  1376: May 28, 1988:
                   1377:        srand returns seed value it's using.
                   1378:        see 1/18/90
1.6       kstailey 1379:
1.7       millert  1380: May 22, 1988:
                   1381:        Removed limit on depth of function calls.
1.6       kstailey 1382:
1.7       millert  1383: May 10, 1988:
                   1384:        Fixed lib.c to permit _ in commandline variable names.
1.6       kstailey 1385:
1.7       millert  1386: Mar 25, 1988:
                   1387:        main.c fixed to recognize -- as terminator of command-
                   1388:        line options.  Illegal options flagged.
                   1389:        Error reporting slightly cleaned up.
1.6       kstailey 1390:
1.7       millert  1391: Dec 2, 1987:
                   1392:        Newer C compilers apply a strict scope rule to extern
                   1393:        declarations within functions.  Two extern declarations in
                   1394:        lib.c and tran.c have been moved to obviate this problem.
1.6       kstailey 1395:
1.7       millert  1396: Oct xx, 1987:
                   1397:        Reluctantly added toupper and tolower functions.
                   1398:        Subject to rescinding without notice.
1.6       kstailey 1399:
1.7       millert  1400: Sep 17, 1987:
                   1401:        Error-message printer had printf(s) instead of
                   1402:        printf("%s",s);  got core dumps when the message
                   1403:        included a %.
1.6       kstailey 1404:
1.7       millert  1405: Sep 12, 1987:
                   1406:        Very long printf strings caused core dump;
                   1407:        fixed aprintf, asprintf, format to catch them.
                   1408:        Can still get a core dump in printf itself.
1.6       kstailey 1409:
                   1410: