Annotation of src/usr.bin/awk/FIXES, Revision 1.49
1.1 tholo 1: /****************************************************************
1.6 kstailey 2: Copyright (C) Lucent Technologies 1997
1.1 tholo 3: All Rights Reserved
4:
5: Permission to use, copy, modify, and distribute this software and
6: its documentation for any purpose and without fee is hereby
7: granted, provided that the above copyright notice appear in all
8: copies and that both that the copyright notice and this
9: permission notice and warranty disclaimer appear in supporting
1.6 kstailey 10: documentation, and that the name Lucent Technologies or any of
11: its entities not be used in advertising or publicity pertaining
12: to distribution of the software without specific, written prior
13: permission.
14:
15: LUCENT DISCLAIMS ALL WARRANTIES WITH REGARD TO THIS SOFTWARE,
16: INCLUDING ALL IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS.
17: IN NO EVENT SHALL LUCENT OR ANY OF ITS ENTITIES BE LIABLE FOR ANY
18: SPECIAL, INDIRECT OR CONSEQUENTIAL DAMAGES OR ANY DAMAGES
19: WHATSOEVER RESULTING FROM LOSS OF USE, DATA OR PROFITS, WHETHER
20: IN AN ACTION OF CONTRACT, NEGLIGENCE OR OTHER TORTIOUS ACTION,
21: ARISING OUT OF OR IN CONNECTION WITH THE USE OR PERFORMANCE OF
22: THIS SOFTWARE.
1.1 tholo 23: ****************************************************************/
24:
25: This file lists all bug fixes, changes, etc., made since the AWK book
1.47 millert 26: was sent to the printers in August 1987.
1.45 millert 27:
1.49 ! millert 28: Dec 15, 2022:
! 29: Force hex escapes in strings to be no more than two characters,
! 30: as they already are in regular expressions. This brings internal
! 31: consistency, as well as consistency with gawk. Thanks to
! 32: Arnold Robbins.
! 33:
1.48 millert 34: Sep 12, 2022:
35: adjbuf minlen error (cannot be 0) in cat, resulting in NULL pbuf.
36: discovered by todd miller. also use-after-free issue with
37: tempfree in cat, thanks to Miguel Pineiro Jr and valgrind.
38:
1.47 millert 39: Aug 30, 2022:
40: Various leaks and use-after-free issues plugged/fixed.
41: Thanks to Miguel Pineiro Jr. <mpj@pineiro.cc>.
1.46 millert 42:
43: May 23, 2022:
44: Memory leak when assigning a string to some of the built-in
45: variables. allocated string erroneously marked DONTFREE.
46: Thanks to Miguel Pineiro Jr. <mpj@pineiro.cc>.
47:
1.45 millert 48: Mar 14, 2022:
1.46 millert 49: Historic bug: command-line "name=value" assignment had been
50: truncating its entry in ARGV. (circa 1989) Thanks to
51: Miguel Pineiro Jr. <mpj@pineiro.cc>.
1.44 millert 52:
53: Mar 3, 2022:
54: Fixed file management memory leak that appears to have been
55: there since the files array was first initialized with stdin,
56: stdout, and stderr (circa 1992). Thanks to Miguel Pineiro Jr.
57: <mpj@pineiro.cc>.
1.43 millert 58:
59: December 8, 2021:
60: The error handling in closefile and closeall was mangled. Long
61: standing warnings had been made fatal and some fatal errors went
62: undetected. Thanks to Miguel Pineiro Jr. <mpj@pineiro.cc>.
1.42 millert 63:
64: Nov 03, 2021:
65: getline accesses uninitialized data after getrec()
66: returns 0 on EOF and leaves the contents of buf unchanged.
67: Thanks to Volodymyr Gubarkov, and Todd C Miller.
1.41 millert 68:
69: Oct 12, 2021:
70: The fix for #83 changed the code to insert 2 chars, but the
71: call to adjbuf just above it only allows for 1 char. This can
72: cause a heap buffer overflow.
73:
74: July 27, 2021:
75: As per IEEE Std 1003.1-2008, -F "str" is now consistent with
76: -v FS="str" when str is null. Thanks to Warner Losh.
77:
78: July 24, 2021:
79: Fix readrec's definition of a record. This fixes an issue
80: with NetBSD's RS regular expression support that can cause
81: an infinite read loop. Thanks to Miguel Pineiro Jr.
82:
83: Fix regular expression RS ^-anchoring. RS ^-anchoring needs to
84: know if it is reading the first record of a file. This change
85: restores a missing line that was overlooked when porting NetBSD's
86: RS regex functionality. Thanks to Miguel Pineiro Jr.
87:
88: Fix size computation in replace_repeat() for special case
89: REPEAT_WITH_Q. Thanks to Todd C. Miller.
90:
91: February 15, 2021:
92: Small fix so that awk will compile again with g++. Thanks to
93: Arnold Robbins.
94:
95: January 06, 2021:
96: Fix a decision bug with trailing stuff in lib.c:is_valid_number
97: after recent changes. Thanks to Ozan Yigit.
1.40 millert 98:
99: December 18, 2020:
100: Fix problems converting inf and NaN values in lib.c:is_valid_number.
101: Enhance number to string conversion to do the right thing for
102: NaN and inf values. Things are now pretty much the same as in
103: gawk. (Found a gawk bug while we're at it.) Added a torture
104: test for these values. Thanks to Arnold Robbins. Allows closing
105: of PR #101.
106:
107: December 15, 2020:
108: Merge PR #99, which gets the right header for strcasecmp.
109: Thanks to GitHub user michaelforney.
1.39 millert 110:
111: December 8, 2020:
112: Merge PR #98: Disallow hex data. Allow only +nan, -nan,
113: +inf, -inf (case independent) to give NaN and infinity values.
114: Improve things so that string to double conversion is only
115: done once, yielding something of a speedup. This obviate
116: PR #95. Thanks to Arnold Robbins.
117:
118: December 3, 2020:
119: Fix to argument parsing to avoid printing spurious newlines.
120: Thanks to Todd Miller. Merges PR #97.
121:
122: October 13, 2020:
123: Add casts before all the calls to malloc/calloc/realloc in order
124: to get it to compile with g++. Thanks to Arnold Robbins.
125:
126: August 16, 2020:
127: Additional fixes for DJGPP. Thanks to Eli Zaretskii for
128: the testing.
1.38 millert 129:
130: August 7, 2020:
131: Merge PR #93, which adds casts to (void*) for debug prints
132: using the %p format specifier. Thanks to GitHub user YongHaoWu
133: ("Chris") for the fixes.
134:
135: August 4, 2020:
136: In run.c, use non-restartable multibyte routines to attain
137: portability to DJGPP. Should fix Issue 92. Thanks to Albert Wik
138: for the report and to Todd Miller for the suggested fix.
1.37 millert 139:
140: July 30, 2020:
141: Merge PRs 88-91 which fix small bugs. Thanks to Todd Miller and
142: Tim van der Molen for the fixes.
143:
144: In order to make life easier, we move exclusively to bison
145: as the parser generator.
1.36 millert 146:
147: July 2, 2020:
148: Merge PRs 85 and 86 which fix regressions. Thanks to
149: Tim van der Molen for the fixes.
1.35 millert 150:
151: June 25, 2020:
152: Merge PRs 82 and 84. The latter fixes issue #83. Thanks to
153: Todd Miller and awkfan77.
1.34 millert 154:
155: June 12, 2020:
156: Clear errno before calling errcheck to avoid any spurious errors
157: left over from previous calls that may have set it. Thanks to
158: Todd Miller for the fix, from PR #80.
159:
160: Fix Issue #78 by allowing \r to follow floating point numbers in
161: lib.c:is_number. Thanks to GitHub user ajcarr for the report
162: and to Arnold Robbins for the fix.
1.33 millert 163:
164: June 5, 2020:
165: In fldbld(), make sure that inputFS is set before trying to
166: use it. Thanks to Steffen Nurpmeso <steffen@sdaoden.eu>
167: for the report.
168:
169: May 5, 2020:
170: Fix checks for compilers that can handle noreturn. Thanks to
171: GitHub user enh-google for pointing it out. Closes Issue #79.
172:
173: April 16, 2020:
174: Handle old compilers that don't support C11 (for noreturn).
175: Thanks to Arnold Robbins.
176:
177: April 5, 2020:
178: Use <stdnoreturn.h> and noreturn instead of GCC attributes.
179: Thanks to GitHub user awkfan77. Closes PR #77.
1.30 millert 180:
1.32 millert 181: February 28, 2020:
182: More cleanups from Christos Zoulas: notably backslash continuation
183: inside strings removes the newline and a fix for RS = "^a".
184: Fix for address sanitizer-found problem. Thanks to GitHub user
185: enh-google.
186:
187: February 19, 2020:
188: More small cleanups from Christos Zoulas.
189:
190: February 18, 2020:
191: Additional cleanups from Christos Zoulas. It's no longer necessary
192: to use the -y flag to bison.
193:
194: February 6, 2020:
195: Additional small cleanups from Christos Zoulas. awk is now
196: a little more robust about reporting I/O errors upon exit.
197:
1.31 millert 198: January 31, 2020:
199: Merge PR #70, which avoids use of variable length arrays. Thanks
200: to GitHub user michaelforney. Fix issue #60 ({0} in interval
1.32 millert 201: expressions doesn't work). Also get all tests working again.
202: Thanks to Arnold Robbins.
1.31 millert 203:
204: January 24, 2020:
205: A number of small cleanups from Christos Zoulas. Add the close
206: on exec flag to files/pipes opened for redirection; courtesy of
207: Arnold Robbins.
208:
209: January 19, 2020:
210: If POSIXLY_CORRECT is set in the environment, then sub and gsub
211: use POSIX rules for multiple backslashes. This fixes Issue #66,
212: while maintaining backwards compatibility.
213:
214: January 9, 2020:
215: Input/output errors on closing files are now fatal instead of
216: mere warnings. Thanks to Martijn Dekker <martijn@inlv.org>.
217:
1.30 millert 218: January 5, 2020:
219: Fix a bug in the concatentation of two string constants into
220: one done in the grammar. Fixes GitHub issue #61. Thanks
221: to GitHub user awkfan77 for pointing out the direction for
222: the fix. New test T.concat added to the test suite.
223: Fix a few memory leaks reported by valgrind, as well.
224:
225: December 27, 2019:
226: Fix a bug whereby a{0,3} could match four a's. Thanks to
227: "Anonymous AWK fan" for the report.
228:
229: December 11, 2019:
230: Further printf-related fixes for 32 bit systems.
231: Thanks again to Christos Zoulas.
232:
233: December 8, 2019:
234: Fix the return value of sprintf("%d") on 32 bit systems.
235: Thanks to Jim Lowe for the report and to Christos Zoulas
236: for the fix.
1.29 millert 237:
238: November 10, 2019:
239: Convert a number of Boolean integer variables into
240: actual bools. Convert compile_time variable into an
241: enum and simplify some of the related code. Thanks
242: to Arnold Robbins.
243:
244: November 8, 2019:
245: Fix from Ori Bernstein to get UTF-8 characters instead of
246: bytes when FS = "". This is currently the only bit of
247: the One True Awk that understands multibyte characters.
248: From Arnold Robbins, apply some cleanups in the test suite.
1.28 millert 249:
250: October 25, 2019:
251: More fixes and cleanups from NetBSD, courtesy of Christos
252: Zoulas. Merges PRs 54 and 55.
253:
254: October 24, 2019:
255: Import second round of code cleanups from NetBSD. Much thanks
1.31 millert 256: to Christos Zoulas (GitHub user zoulasc). Merges PR 53.
1.28 millert 257: Add an optimization for string concatenation, also from
258: Christos.
1.27 millert 259:
260: October 17, 2019:
261: Import code cleanups from NetBSD. Much thanks to Christos
1.31 millert 262: Zoulas (GitHub user zoulasc). Merges PR 51.
1.26 millert 263:
264: October 6, 2019:
265: Import code from NetBSD awk that implements RS as a regular
266: expression.
1.23 millert 267:
1.25 millert 268: September 10, 2019:
269: Fixes for various array / memory overruns found via gcc's
1.31 millert 270: -fsanitize=unknown. Thanks to Alexander Richardson (GitHub
1.25 millert 271: user arichardson). Merges PRs 47 and 48.
272:
273: July 28, 2019:
274: Import grammar optimization from NetBSD: Two string constants
275: concatenated together get turned into a single string.
276:
277: July 26, 2019:
278: Support POSIX-specified C-style escape sequences "\a" (alarm)
279: and "\v" (vertical tab) in command line arguments and regular
280: expressions, further to the support for them in strings added on
281: Apr 9, 1989. These now no longer match as literal "a" and "v"
282: characters (as they don't on other awk implementations).
283: Thanks to Martijn Dekker.
284:
285: July 17, 2019:
286: Pull in a number of code cleanups and minor fixes from
287: Warner Losh's bsd-ota branch. The only user visible change
288: is the use of random(3) as the random number generator.
289: Thanks to Warner Losh for collecting all these fixes in
290: one easy place to get them from.
291:
292: July 16, 2019:
293: Fix field splitting to use FS value as of the time a record
294: was read or assigned to. Thanks to GitHub user Cody Mello (melloc)
295: for the fix. (Merged from his branch, via PR #42.) Updated
296: testdir/T.split per said PR as well.
297:
298: June 24, 2019:
299: Extract awktest.tar into testdir directory. Add some very
300: simple mechanics to the makefile for running the tests and
301: for cleaning up. No changes to awk itself.
302:
1.24 millert 303: June 17, 2019:
304: Disallow deleting SYMTAB and its elements, which creates
305: use-after-free bugs. Thanks to GitHub user Cody Mello (melloc)
306: for the fix. (Merged from PR #43.)
307:
308: June 5, 2019:
309: Allow unmatched right parenthesis in a regular expression to
310: be treated literally. Fixes Issue #40. Thanks to GitHub user
311: Warner Losh (bsdimp) for the report. Thanks to Arnold Robbins
312: for the fix.
313:
314: May 29,2019:
315: Fix check for command line arguments to no longer require that
316: first character after '=' not be another '='. Reverts change of
317: August 11, 1989. Thanks to GitHub user Jamie Landeg Jones for
318: pointing out the issue; from Issue #38.
319:
320: Apr 7, 2019:
321: Update awktest.tar(p.50) to use modern options to sort. Needed
322: for Android development. Thanks to GitHub user mohd-akram (Mohamed
323: Akram). From Issue #33.
324:
325: Mar 12, 2019:
326: Added very simplistic support for cross-compiling in the
327: makefile. We are NOT going to go in the direction of the
328: autotools, though. Thanks to GitHub user nee-san for
329: the basic change. (Merged from PR #34.)
330:
1.23 millert 331: Mar 5, 2019:
332: Added support for POSIX-standard interval expressions (a.k.a.
333: bounds, a.k.a. repetition expressions) in regular expressions,
334: backported (via NetBSD) from Apple awk-24 (20070501).
335: Thanks to Martijn Dekker <martijn@inlv.org> for the port.
336: (Merged from PR #30.)
337:
338: Mar 3, 2019:
339: Merge PRs as follows:
340: #12: Avoid undefined behaviour when using ctype(3) functions in
341: relex(). Thanks to GitHub user iamleot.
342: #31: Make getline handle numeric strings, and update FIXES. Thanks
1.47 millert 343: to GitHub user Arnold Robbins (arnoldrobbins)
1.23 millert 344: #32: maketab: support build systems with read-only source. Thanks
345: to GitHub user enh.
1.22 millert 346:
347: Jan 25, 2019:
348: Make getline handle numeric strings properly in all cases.
349: (Thanks, Arnold.)
350:
351: Jan 21, 2019:
352: Merged a number of small fixes from GitHub pull requests.
353: Thanks to GitHub users Arnold Robbins (arnoldrobbins),
354: Cody Mello (melloc) and Christoph Junghans (junghans).
355: PR numbers: 13-21, 23, 24, 27.
1.21 millert 356:
357: Oct 25, 2018:
358: Added test in maketab.c to prevent generating a proctab entry
359: for YYSTYPE_IS_DEFINED. It was harmless but some gcc settings
360: generated a warning message. Thanks to Nan Xiao for report.
1.20 millert 361:
362: Aug 27, 2018:
363: Disallow '$' in printf formats; arguments evaluated in order
364: and printed in order.
365:
366: Added some casts to silence warnings on debugging printfs.
367: (Thanks, Arnold.)
1.18 millert 368:
1.19 millert 369: Aug 23, 2018:
370: A long list of fixes courtesy of Arnold Robbins,
371: to whom profound thanks.
372:
373: 1. ofs-rebuild: OFS value used to rebuild the record was incorrect.
374: Fixed August 19, 2014. Revised fix August 2018.
375:
376: 2. system-status: Instead of a floating-point division by 256, use
377: the wait(2) macros to create a reasonable exit status.
378: Fixed March 12, 2016.
379:
380: 3. space: Use provided xisblank() function instead of ispace() for
381: matching [[:blank:]].
382:
383: 4. a-format: Add POSIX standard %a and %A to supported formats. Check
384: at runtime that this format is available.
385:
386: 5. decr-NF: Decrementing NF did not change $0. This is a decades-old
387: bug. There are interactions with the old and new value of OFS as well.
388: Most of the fix came from the NetBSD awk.
389:
390: 6. string-conv: String conversions of scalars were sticky. Once a
391: conversion to string happened, even with OFMT, that value was used until
392: a new numeric value was assigned, even if OFMT differed from CONVFMT,
393: and also if CONVFMT changed.
394:
395: 7. unary-plus: Unary plus on a string constant returned the string.
396: Instead, it should convert the value to numeric and give that value.
397:
398: Also added Arnold's tests for these to awktest.tar as T.arnold.
399:
400: Aug 15, 2018:
401: fixed mangled awktest.tar (thanks, Arnold), posted all
402: current (very minor) fixes to github / onetrueawk
403:
1.18 millert 404: Jun 7, 2018:
405: (yes, a long layoff)
406: Updated some broken tests (beebe.tar, T.lilly)
407: [thanks to Arnold Robbins]
408:
409: Mar 26, 2015:
410: buffer overflow in error reporting; thanks to tobias ulmer
411: and john-mark gurney for spotting it and the fix.
412:
413: Feb 4, 2013:
414: cleaned up a handful of tests that didn't seem to actually
415: test for correct behavior: T.latin1, T.gawk.
416:
417: Jan 5, 2013:
418: added ,NULL initializer to static Cells in run.c; not really
419: needed but cleaner. Thanks to Michael Bombardieri.
1.17 millert 420:
421: Dec 20, 2012:
422: fiddled makefile to get correct yacc and bison flags. pick yacc
423: (linux) or bison (mac) as necessary.
424:
425: added __attribute__((__noreturn__)) to a couple of lines in
426: proto.h, to silence someone's enthusiastic checker.
427:
428: fixed obscure call by value bug in split(a[1],a) reported on
429: 9fans. the management of temporary values is just a mess; i
430: took a shortcut by making an extra string copy. thanks
431: to paul patience and arnold robbins for passing it on and for
432: proposed patches.
433:
434: tiny fiddle in setfval to eliminate -0 results in T.expr, which
435: has irritated me for 20+ years.
1.16 millert 436:
437: Aug 10, 2011:
438: another fix to avoid core dump with delete(ARGV); again, many thanks
439: to ruslan ermilov.
440:
441: Aug 7, 2011:
442: split(s, a, //) now behaves the same as split(s, a, "")
443:
444: Jun 12, 2011:
445: /pat/, \n /pat/ {...} is now legal, though bad style to use.
446:
447: added checks to new -v code that permits -vnospace; thanks to
1.25 millert 448: ruslan ermilov for spotting this and providing the patch.
1.16 millert 449:
450: removed fixed limit on number of open files; thanks to aleksey
1.25 millert 451: cheusov and christos zoulos.
1.16 millert 452:
453: fixed day 1 bug that resurrected deleted elements of ARGV when
454: used as filenames (in lib.c).
455:
456: minor type fiddles to make gcc -Wall -pedantic happier (but not
457: totally so); turned on -fno-strict-aliasing in makefile.
458:
459: May 6, 2011:
460: added #ifdef for isblank.
461: now allows -ffoo as well as -f foo arguments.
462: (thanks, ruslan)
463:
464: May 1, 2011:
465: after advice from todd miller, kevin lo, ruslan ermilov,
466: and arnold robbins, changed srand() to return the previous
467: seed (which is 1 on the first call of srand). the seed is
468: an Awkfloat internally though converted to unsigned int to
1.25 millert 469: pass to the library srand(). thanks, everyone.
1.16 millert 470:
471: fixed a subtle (and i hope low-probability) overflow error
1.25 millert 472: in fldbld, by adding space for one extra \0. thanks to
1.16 millert 473: robert bassett for spotting this one and providing a fix.
474:
475: removed the files related to compilation on windows. i no
476: longer have anything like a current windows environment, so
477: i can't test any of it.
1.15 millert 478:
479: May 23, 2010:
480: fixed long-standing overflow bug in run.c; many thanks to
481: nelson beebe for spotting it and providing the fix.
482:
483: fixed bug that didn't parse -vd=1 properly; thanks to santiago
484: vila for spotting it.
485:
486: Feb 8, 2010:
487: i give up. replaced isblank with isspace in b.c; there are
488: no consistent header files.
489:
490: Nov 26, 2009:
491: fixed a long-standing issue with when FS takes effect. a
492: change to FS is now noticed immediately for subsequent splits.
493:
494: changed the name getline() to awkgetline() to avoid yet another
495: name conflict somewhere.
496:
497: Feb 11, 2009:
498: temporarily for now defined HAS_ISBLANK, since that seems to
499: be the best way through the thicket. isblank arrived in C99,
500: but seems to be arriving at different systems at different
501: times.
502:
503: Oct 8, 2008:
504: fixed typo in b.c that set tmpvec wrongly. no one had ever
505: run into the problem, apparently. thanks to alistair crooks.
1.14 millert 506:
507: Oct 23, 2007:
508: minor fix in lib.c: increase inputFS to 100, change malloc
1.25 millert 509: for fields to n+1.
1.14 millert 510:
511: fixed memory fault caused by out of order test in setsval.
512:
513: thanks to david o'brien, freebsd, for both fixes.
514:
515: May 1, 2007:
516: fiddle in makefile to fix for BSD make; thanks to igor sobrado.
517:
518: Mar 31, 2007:
519: fixed some null pointer refs calling adjbuf.
520:
521: Feb 21, 2007:
522: fixed a bug in matching the null RE in sub and gsub. thanks to al aho
523: who actually did the fix (in b.c), and to wolfgang seeberg for finding
524: it and providing a very compact test case.
525:
526: fixed quotation in b.c; thanks to Hal Pratt and the Princeton Dante
527: Project.
528:
529: removed some no-effect asserts in run.c.
530:
531: fiddled maketab.c to not complain about bison-generated values.
532:
533: removed the obsolete -V argument; fixed --version to print the
534: version and exit.
535:
536: fixed wording and an outright error in the usage message; thanks to igor
537: sobrado and jason mcintyre.
538:
539: fixed a bug in -d that caused core dump if no program followed.
540:
541: Jan 1, 2007:
542: dropped mac.code from makefile; there are few non-MacOSX
543: mac's these days.
544:
545: Jan 17, 2006:
546: system() not flagged as unsafe in the unadvertised -safe option.
547: found it while enhancing tests before shipping the ;login: article.
548: practice what you preach.
549:
550: removed the 9-years-obsolete -mr and -mf flags.
551:
552: added -version and --version options.
553:
554: core dump on linux with BEGIN {nextfile}, now fixed.
555:
1.25 millert 556: removed some #ifdef's in run.c and lex.c that appear to no
1.14 millert 557: longer be necessary.
558:
559: Apr 24, 2005:
560: modified lib.c so that values of $0 et al are preserved in the END
561: block, apparently as required by posix. thanks to havard eidnes
562: for the report and code.
563:
564: Jan 14, 2005:
565: fixed infinite loop in parsing, originally found by brian tsang.
566: thanks to arnold robbins for a suggestion that started me
567: rethinking it.
568:
569: Dec 31, 2004:
1.25 millert 570: prevent overflow of -f array in main, head off potential error in
571: call of SYNTAX(), test malloc return in lib.c, all with thanks to
1.14 millert 572: todd miller.
1.13 millert 573:
574: Dec 22, 2004:
575: cranked up size of NCHARS; coverity thinks it can be overrun with
576: smaller size, and i think that's right. added some assertions to b.c
577: to catch places where it might overrun. the RE code is still fragile.
578:
579: Dec 5, 2004:
580: fixed a couple of overflow problems with ridiculous field numbers:
581: e.g., print $(2^32-1). thanks to ruslan ermilov, giorgos keramidas
582: and david o'brien at freebsd.org for patches. this really should
583: be re-done from scratch.
584:
585: Nov 21, 2004:
586: fixed another 25-year-old RE bug, in split. it's another failure
587: to (re-)initialize. thanks to steve fisher for spotting this and
588: providing a good test case.
589:
590: Nov 22, 2003:
591: fixed a bug in regular expressions that dates (so help me) from 1977;
592: it's been there from the beginning. an anchored longest match that
593: was longer than the number of states triggered a failure to initialize
594: the machine properly. many thanks to moinak ghosh for not only finding
595: this one but for providing a fix, in some of the most mysterious
596: code known to man.
597:
598: fixed a storage leak in call() that appears to have been there since
1.25 millert 599: 1983 or so -- a function without an explicit return that assigns a
600: string to a parameter leaked a Cell. thanks to moinak ghosh for
1.13 millert 601: spotting this very subtle one.
602:
603: Jul 31, 2003:
604: fixed, thanks to andrey chernov and ruslan ermilov, a bug in lex.c
605: that mis-handled the character 255 in input. (it was being compared
606: to EOF with a signed comparison.)
607:
608: Jul 29, 2003:
609: fixed (i think) the long-standing botch that included the beginning of
610: line state ^ for RE's in the set of valid characters; this led to a
611: variety of odd problems, including failure to properly match certain
612: regular expressions in non-US locales. thanks to ruslan for keeping
613: at this one.
614:
615: Jul 28, 2003:
616: n-th try at getting internationalization right, with thanks to volker
617: kiefel, arnold robbins and ruslan ermilov for advice, though they
618: should not be blamed for the outcome. according to posix, "." is the
619: radix character in programs and command line arguments regardless of
620: the locale; otherwise, the locale should prevail for input and output
621: of numbers. so it's intended to work that way.
1.25 millert 622:
1.13 millert 623: i have rescinded the attempt to use strcoll in expanding shorthands in
624: regular expressions (cclenter). its properties are much too
625: surprising; for example [a-c] matches aAbBc in locale en_US but abBcC
626: in locale fr_CA. i can see how this might arise by implementation
627: but i cannot explain it to a human user. (this behavior can be seen
628: in gawk as well; we're leaning on the same library.)
629:
630: the issue appears to be that strcoll is meant for sorting, where
631: merging upper and lower case may make sense (though note that unix
632: sort does not do this by default either). it is not appropriate
633: for regular expressions, where the goal is to match specific
634: patterns of characters. in any case, the notations [:lower:], etc.,
635: are available in awk, and they are more likely to work correctly in
636: most locales.
637:
638: a moratorium is hereby declared on internationalization changes.
639: i apologize to friends and colleagues in other parts of the world.
640: i would truly like to get this "right", but i don't know what
641: that is, and i do not want to keep making changes until it's clear.
642:
643: Jul 4, 2003:
644: fixed bug that permitted non-terminated RE, as in "awk /x".
645:
646: Jun 1, 2003:
647: subtle change to split: if source is empty, number of elems
648: is always 0 and the array is not set.
649:
650: Mar 21, 2003:
651: added some parens to isblank, in another attempt to make things
652: internationally portable.
653:
654: Mar 14, 2003:
655: the internationalization changes, somewhat modified, are now
656: reinstated. in theory awk will now do character comparisons
657: and case conversions in national language, but "." will always
658: be the decimal point separator on input and output regardless
659: of national language. isblank(){} has an #ifndef.
660:
661: this no longer compiles on windows: LC_MESSAGES isn't defined
662: in vc6++.
663:
664: fixed subtle behavior in field and record splitting: if FS is
665: a single character and RS is not empty, \n is NOT a separator.
666: this tortuous reading is found in the awk book; behavior now
667: matches gawk and mawk.
1.11 millert 668:
669: Dec 13, 2002:
670: for the moment, the internationalization changes of nov 29 are
671: rolled back -- programs like x = 1.2 don't work in some locales,
672: because the parser is expecting x = 1,2. until i understand this
673: better, this will have to wait.
674:
675: Nov 29, 2002:
676: modified b.c (with tiny changes in main and run) to support
677: locales, using strcoll and iswhatever tests for posix character
678: classes. thanks to ruslan ermilov (ru@freebsd.org) for code.
679: the function isblank doesn't seem to have propagated to any
680: header file near me, so it's there explicitly. not properly
681: tested on non-ascii character sets by me.
682:
683: Jun 28, 2002:
684: modified run/format() and tran/getsval() to do a slightly better
685: job on using OFMT for output from print and CONVFMT for other
1.25 millert 686: number->string conversions, as promised by posix and done by
1.11 millert 687: gawk and mawk. there are still places where it doesn't work
688: right if CONVFMT is changed; by then the STR attribute of the
689: variable has been irrevocably set. thanks to arnold robbins for
690: code and examples.
691:
692: fixed subtle bug in format that could get core dump. thanks to
693: Jaromir Dolecek <jdolecek@NetBSD.org> for finding and fixing.
694: minor cleanup in run.c / format() at the same time.
695:
696: added some tests for null pointers to debugging printf's, which
697: were never intended for external consumption. thanks to dave
698: kerns (dkerns@lucent.com) for pointing this out.
699:
700: GNU compatibility: an empty regexp matches anything (thanks to
701: dag-erling smorgrav, des@ofug.org). subject to reversion if
702: this does more harm than good.
703:
704: pervasive small changes to make things more const-correct, as
705: reported by gcc's -Wwrite-strings. as it says in the gcc manual,
706: this may be more nuisance than useful. provoked by a suggestion
707: and code from arnaud desitter, arnaud@nimbus.geog.ox.ac.uk
708:
709: minor documentation changes to note that this now compiles out
710: of the box on Mac OS X.
711:
712: Feb 10, 2002:
713: changed types in posix chars structure to quiet solaris cc.
714:
715: Jan 1, 2002:
716: fflush() or fflush("") flushes all files and pipes.
717:
1.25 millert 718: length(arrayname) returns number of elements; thanks to
1.11 millert 719: arnold robbins for suggestion.
720:
721: added a makefile.win to make it easier to build on windows.
722: based on dan allen's buildwin.bat.
723:
724: Nov 16, 2001:
725: added support for posix character class names like [:digit:],
726: which are not exactly shorter than [0-9] and perhaps no more
727: portable. thanks to dag-erling smorgrav for code.
728:
729: Feb 16, 2001:
730: removed -m option; no longer needed, and it was actually
731: broken (noted thanks to volker kiefel).
732:
733: Feb 10, 2001:
734: fixed an appalling bug in gettok: any sequence of digits, +,-, E, e,
735: and period was accepted as a valid number if it started with a period.
736: this would never have happened with the lex version.
737:
738: other 1-character botches, now fixed, include a bare $ and a
739: bare " at the end of the input.
740:
741: Feb 7, 2001:
742: more (const char *) casts in b.c and tran.c to silence warnings.
1.8 millert 743:
1.10 millert 744: Nov 15, 2000:
745: fixed a bug introduced in august 1997 that caused expressions
746: like $f[1] to be syntax errors. thanks to arnold robbins for
747: noticing this and providing a fix.
748:
749: Oct 30, 2000:
750: fixed some nextfile bugs: not handling all cases. thanks to
751: arnold robbins for pointing this out. new regressions added.
752:
753: close() is now a function. it returns whatever the library
754: fclose returns, and -1 for closing a file or pipe that wasn't
755: opened.
756:
757: Sep 24, 2000:
758: permit \n explicitly in character classes; won't work right
759: if comes in as "[\n]" but ok as /[\n]/, because of multiple
760: processing of \'s. thanks to arnold robbins.
761:
762: July 5, 2000:
763: minor fiddles in tran.c to keep compilers happy about uschar.
764: thanks to norman wilson.
765:
766: May 25, 2000:
767: yet another attempt at making 8-bit input work, with another
1.25 millert 768: band-aid in b.c (member()), and some (uschar) casts to head
1.10 millert 769: off potential errors in subscripts (like isdigit). also
770: changed HAT to NCHARS-2. thanks again to santiago vila.
771:
772: changed maketab.c to ignore apparently out of range definitions
773: instead of halting; new freeBSD generates one. thanks to
774: jon snader <jsnader@ix.netcom.com> for pointing out the problem.
775:
776: May 2, 2000:
777: fixed an 8-bit problem in b.c by making several char*'s into
778: unsigned char*'s. not clear i have them all yet. thanks to
779: Santiago Vila <sanvila@unex.es> for the bug report.
780:
781: Apr 21, 2000:
782: finally found and fixed a memory leak in function call; it's
783: been there since functions were added ~1983. thanks to
784: jon bentley for the test case that found it.
785:
786: added test in envinit to catch environment "variables" with
1.12 otto 787: names beginning with '='; thanks to Berend Hasselman.
1.10 millert 788:
789: Jul 28, 1999:
790: added test in defn() to catch function foo(foo), which
791: otherwise recurses until core dump. thanks to arnold
792: robbins for noticing this.
793:
1.9 millert 794: Jun 20, 1999:
795: added *bp in gettok in lex.c; appears possible to exit function
796: without terminating the string. thanks to russ cox.
797:
798: Jun 2, 1999:
799: added function stdinit() to run to initialize files[] array,
800: in case stdin, etc., are not constants; some compilers care.
801:
802: May 10, 1999:
803: replaced the ERROR ... FATAL, etc., macros with functions
804: based on vprintf, to avoid problems caused by overrunning
805: fixed-size errbuf array. thanks to ralph corderoy for the
806: impetus, and for pointing out a string termination bug in
807: qstring as well.
808:
809: Apr 21, 1999:
810: fixed bug that caused occasional core dumps with commandline
811: variable with value ending in \. (thanks to nelson beebe for
812: the test case.)
813:
1.8 millert 814: Apr 16, 1999:
1.25 millert 815: with code kindly provided by Bruce Lilly, awk now parses
1.8 millert 816: /=/ and similar constructs more sensibly in more places.
1.10 millert 817: Bruce also provided some helpful test cases.
1.8 millert 818:
819: Apr 5, 1999:
820: changed true/false to True/False in run.c to make it
821: easier to compile with C++. Added some casts on malloc
822: and realloc to be honest about casts; ditto. changed
823: ltype int to long in struct rrow to reduce some 64-bit
824: complaints; other changes scattered throughout for the
825: same purpose. thanks to Nelson Beebe for these portability
826: improvements.
827:
828: removed some horrible pointer-int casting in b.c and elsewhere
829: by adding ptoi and itonp to localize the casts, which are
830: all benign. fixed one incipient bug that showed up on sgi
831: in 64-bit mode.
832:
833: reset lineno for new source file; include filename in error
834: message. also fixed line number error in continuation lines.
835: (thanks to Nelson Beebe for both of these.)
836:
837: Mar 24, 1999:
838: Nelson Beebe notes that irix 5.3 yacc dies with a bogus
839: error; use a newer version or switch to bison, since sgi
840: is unlikely to fix it.
1.1 tholo 841:
1.7 millert 842: Mar 5, 1999:
1.9 millert 843: changed isnumber to is_number to avoid the problem caused by
844: versions of ctype.h that include the name isnumber.
1.7 millert 845:
846: distribution now includes a script for building on a Mac,
847: thanks to Dan Allen.
848:
849: Feb 20, 1999:
850: fixed memory leaks in run.c (call) and tran.c (setfval).
851: thanks to Stephen Nutt for finding these and providing the fixes.
852:
853: Jan 13, 1999:
854: replaced srand argument by (unsigned int) in run.c;
855: avoids problem on Mac and potentially on Unix & Windows.
856: thanks to Dan Allen.
857:
858: added a few (int) casts to silence useless compiler warnings.
859: e.g., errorflag= in run.c jump().
860:
861: added proctab.c to the bundle outout; one less thing
862: to have to compile out of the box.
863:
864: added calls to _popen and _pclose to the win95 stub for
865: pipes (thanks to Steve Adams for this helpful suggestion).
866: seems to work, though properties are not well understood
867: by me, and it appears that under some circumstances the
868: pipe output is truncated. Be careful.
869:
870: Oct 19, 1998:
871: fixed a couple of bugs in getrec: could fail to update $0
1.25 millert 872: after a getline var; because inputFS wasn't initialized,
1.7 millert 873: could split $0 on every character, a misleading diversion.
874:
875: fixed caching bug in makedfa: LRU was actually removing
876: least often used.
877:
878: thanks to ross ridge for finding these, and for providing
879: great bug reports.
880:
881: May 12, 1998:
882: fixed potential bug in readrec: might fail to update record
883: pointer after growing. thanks to dan levy for spotting this
884: and suggesting the fix.
885:
886: Mar 12, 1998:
887: added -V to print version number and die.
1.19 millert 888:
889: [notify dave kerns, dkerns@dacsoup.ih.lucent.com]
1.7 millert 890:
891: Feb 11, 1998:
892: subtle silent bug in lex.c: if the program ended with a number
893: longer than 1 digit, part of the input would be pushed back and
894: parsed again because token buffer wasn't terminated right.
895: example: awk 'length($0) > 10'. blush. at least i found it
896: myself.
897:
898: Aug 31, 1997:
899: s/adelete/awkdelete/: SGI uses this in malloc.h.
900: thanks to nelson beebe for pointing this one out.
901:
902: Aug 21, 1997:
903: fixed some bugs in sub and gsub when replacement includes \\.
904: this is a dark, horrible corner, but at least now i believe that
905: the behavior is the same as gawk and the intended posix standard.
906: thanks to arnold robbins for advice here.
907:
908: Aug 9, 1997:
909: somewhat regretfully, replaced the ancient lex-based lexical
910: analyzer with one written in C. it's longer, generates less code,
911: and more portable; the old one depended too much on mysterious
912: properties of lex that were not preserved in other environments.
913: in theory these recognize the same language.
914:
915: now using strtod to test whether a string is a number, instead of
916: the convoluted original function. should be more portable and
917: reliable if strtod is implemented right.
918:
919: removed now-pointless optimization in makefile that tries to avoid
920: recompilation when awkgram.y is changed but symbols are not.
921:
922: removed most fixed-size arrays, though a handful remain, some
923: of which are unchecked. you have been warned.
924:
925: Aug 4, 1997:
926: with some trepidation, replaced the ancient code that managed
927: fields and $0 in fixed-size arrays with arrays that grow on
928: demand. there is still some tension between trying to make this
929: run fast and making it clean; not sure it's right yet.
930:
931: the ill-conceived -mr and -mf arguments are now useful only
932: for debugging. previous dynamic string code removed.
933:
934: numerous other minor cleanups along the way.
1.1 tholo 935:
1.7 millert 936: Jul 30, 1997:
937: using code provided by dan levy (to whom profuse thanks), replaced
938: fixed-size arrays and awkward kludges by a fairly uniform mechanism
939: to grow arrays as needed for printf, sub, gsub, etc.
1.1 tholo 940:
1.7 millert 941: Jul 23, 1997:
942: falling off the end of a function returns "" and 0, not 0.
943: thanks to arnold robbins.
1.1 tholo 944:
1.7 millert 945: Jun 17, 1997:
946: replaced several fixed-size arrays by dynamically-created ones
947: in run.c; added overflow tests to some previously unchecked cases.
948: getline, toupper, tolower.
1.1 tholo 949:
1.7 millert 950: getline code is still broken in that recursive calls may wind
951: up using the same space. [fixed later]
1.1 tholo 952:
1.7 millert 953: increased RECSIZE to 8192 to push problems further over the horizon.
1.1 tholo 954:
1.7 millert 955: added \r to \n as input line separator for programs, not data.
956: damn CRLFs.
1.1 tholo 957:
1.7 millert 958: modified format() to permit explicit printf("%c", 0) to include
959: a null byte in output. thanks to ken stailey for the fix.
1.1 tholo 960:
1.7 millert 961: added a "-safe" argument that disables file output (print >,
962: print >>), process creation (cmd|getline, print |, system), and
963: access to the environment (ENVIRON). this is a first approximation
964: to a "safe" version of awk, but don't rely on it too much. thanks
965: to joan feigenbaum and matt blaze for the inspiration long ago.
1.1 tholo 966:
1.7 millert 967: Jul 8, 1996:
968: fixed long-standing bug in sub, gsub(/a/, "\\\\&"); thanks to
969: ralph corderoy.
1.1 tholo 970:
1.7 millert 971: Jun 29, 1996:
972: fixed awful bug in new field splitting; didn't get all the places
973: where input was done.
1.1 tholo 974:
1.7 millert 975: Jun 28, 1996:
976: changed field-splitting to conform to posix definition: fields are
977: split using the value of FS at the time of input; it used to be
978: the value when the field or NF was first referred to, a much less
979: predictable definition. thanks to arnold robbins for encouragement
980: to do the right thing.
1.1 tholo 981:
1.7 millert 982: May 28, 1996:
983: fixed appalling but apparently unimportant bug in parsing octal
984: numbers in reg exprs.
1.1 tholo 985:
1.7 millert 986: explicit hex in reg exprs now limited to 2 chars: \xa, \xaa.
1.1 tholo 987:
1.7 millert 988: May 27, 1996:
989: cleaned up some declarations so gcc -Wall is now almost silent.
1.1 tholo 990:
1.7 millert 991: makefile now includes backup copies of ytab.c and lexyy.c in case
992: one makes before looking; it also avoids recreating lexyy.c unless
993: really needed.
1.1 tholo 994:
1.7 millert 995: s/aprintf/awkprint, s/asprintf/awksprintf/ to avoid some name clashes
996: with unwisely-written header files.
1.1 tholo 997:
1.7 millert 998: thanks to jeffrey friedl for several of these.
1.1 tholo 999:
1.7 millert 1000: May 26, 1996:
1001: an attempt to rationalize the (unsigned) char issue. almost all
1002: instances of unsigned char have been removed; the handful of places
1003: in b.c where chars are used as table indices have been hand-crafted.
1004: added some latin-1 tests to the regression, but i'm not confident;
1005: none of my compilers seem to care much. thanks to nelson beebe for
1006: pointing out some others that do care.
1.1 tholo 1007:
1.7 millert 1008: May 2, 1996:
1009: removed all register declarations.
1.1 tholo 1010:
1.7 millert 1011: enhanced split(), as in gawk, etc: split(s, a, "") splits s into
1012: a[1]...a[length(s)] with each character a single element.
1.1 tholo 1013:
1.7 millert 1014: made the same changes for field-splitting if FS is "".
1.1 tholo 1015:
1.7 millert 1016: added nextfile, as in gawk: causes immediate advance to next
1017: input file. (thanks to arnold robbins for inspiration and code).
1.1 tholo 1018:
1.7 millert 1019: small fixes to regexpr code: can now handle []], [[], and
1.25 millert 1020: variants; [] is now a syntax error, rather than matching
1.7 millert 1021: everything; [z-a] is now empty, not z. far from complete
1022: or correct, however. (thanks to jeffrey friedl for pointing out
1023: some awful behaviors.)
1.1 tholo 1024:
1.7 millert 1025: Apr 29, 1996:
1.12 otto 1026: replaced uchar by uschar everywhere; apparently some compilers
1.7 millert 1027: usurp this name and this causes conflicts.
1.1 tholo 1028:
1.7 millert 1029: fixed call to time in run.c (bltin); arg is time_t *.
1.1 tholo 1030:
1.7 millert 1031: replaced horrible pointer/long punning in b.c by a legitimate
1032: union. should be safer on 64-bit machines and cleaner everywhere.
1033: (thanks to nelson beebe for pointing out some of these problems.)
1.1 tholo 1034:
1.7 millert 1035: replaced nested comments by #if 0...#endif in run.c, lib.c.
1.1 tholo 1036:
1.7 millert 1037: removed getsval, setsval, execute macros from run.c and lib.c.
1038: machines are 100x faster than they were when these macros were
1039: first used.
1.1 tholo 1040:
1.7 millert 1041: revised filenames: awk.g.y => awkgram.y, awk.lx.l => awklex.l,
1042: y.tab.[ch] => ytab.[ch], lex.yy.c => lexyy.c, all in the aid of
1043: portability to nameless systems.
1.1 tholo 1044:
1.7 millert 1045: "make bundle" now includes yacc and lex output files for recipients
1046: who don't have yacc or lex.
1.1 tholo 1047:
1.7 millert 1048: Aug 15, 1995:
1049: initialized Cells in setsymtab more carefully; some fields
1050: were not set. (thanks to purify, all of whose complaints i
1051: think i now understand.)
1.1 tholo 1052:
1.7 millert 1053: fixed at least one error in gsub that looked at -1-th element
1054: of an array when substituting for a null match (e.g., $).
1.1 tholo 1055:
1.7 millert 1056: delete arrayname is now legal; it clears the elements but leaves
1057: the array, which may not be the right behavior.
1.1 tholo 1058:
1.7 millert 1059: modified makefile: my current make can't cope with the test used
1060: to avoid unnecessary yacc invocations.
1.1 tholo 1061:
1.7 millert 1062: Jul 17, 1995:
1063: added dynamically growing strings to awk.lx.l and b.c
1064: to permit regular expressions to be much bigger.
1065: the state arrays can still overflow.
1.1 tholo 1066:
1.7 millert 1067: Aug 24, 1994:
1068: detect duplicate arguments in function definitions (mdm).
1.1 tholo 1069:
1.7 millert 1070: May 11, 1994:
1071: trivial fix to printf to limit string size in sub().
1.1 tholo 1072:
1.7 millert 1073: Apr 22, 1994:
1074: fixed yet another subtle self-assignment problem:
1075: $1 = $2; $1 = $1 clobbered $1.
1.1 tholo 1076:
1.7 millert 1077: Regression tests now use private echo, to avoid quoting problems.
1.1 tholo 1078:
1.7 millert 1079: Feb 2, 1994:
1080: changed error() to print line number as %d, not %g.
1.1 tholo 1081:
1.7 millert 1082: Jul 23, 1993:
1083: cosmetic changes: increased sizes of some arrays,
1084: reworded some error messages.
1.1 tholo 1085:
1.7 millert 1086: added CONVFMT as in posix (just replaced OFMT in getsval)
1.1 tholo 1087:
1.7 millert 1088: FILENAME is now "" until the first thing that causes a file
1089: to be opened.
1.1 tholo 1090:
1.7 millert 1091: Nov 28, 1992:
1092: deleted yyunput and yyoutput from proto.h;
1093: different versions of lex give these different declarations.
1.1 tholo 1094:
1.7 millert 1095: May 31, 1992:
1096: added -mr N and -mf N options: more record and fields.
1097: these really ought to adjust automatically.
1.1 tholo 1098:
1.7 millert 1099: cleaned up some error messages; "out of space" now means
1100: malloc returned NULL in all cases.
1.1 tholo 1101:
1.7 millert 1102: changed rehash so that if it runs out, it just returns;
1103: things will continue to run slow, but maybe a bit longer.
1.1 tholo 1104:
1.7 millert 1105: Apr 24, 1992:
1106: remove redundant close of stdin when using -f -.
1.1 tholo 1107:
1.7 millert 1108: got rid of core dump with -d; awk -d just prints date.
1.1 tholo 1109:
1.7 millert 1110: Apr 12, 1992:
1111: added explicit check for /dev/std(in,out,err) in redirection.
1112: unlike gawk, no /dev/fd/n yet.
1.1 tholo 1113:
1.7 millert 1114: added (file/pipe) builtin. hard to test satisfactorily.
1115: not posix.
1.1 tholo 1116:
1.7 millert 1117: Feb 20, 1992:
1118: recompile after abortive changes; should be unchanged.
1.1 tholo 1119:
1.7 millert 1120: Dec 2, 1991:
1121: die-casting time: converted to ansi C, installed that.
1.1 tholo 1122:
1.7 millert 1123: Nov 30, 1991:
1124: fixed storage leak in freefa, failing to recover [N]CCL.
1125: thanks to Bill Jones (jones@cs.usask.ca)
1.1 tholo 1126:
1.7 millert 1127: Nov 19, 1991:
1128: use RAND_MAX instead of literal in builtin().
1.1 tholo 1129:
1.7 millert 1130: Nov 12, 1991:
1131: cranked up some fixed-size arrays in b.c, and added a test for
1132: overflow in penter. thanks to mark larsen.
1.1 tholo 1133:
1.7 millert 1134: Sep 24, 1991:
1135: increased buffer in gsub. a very crude fix to a general problem.
1136: and again on Sep 26.
1.1 tholo 1137:
1.7 millert 1138: Aug 18, 1991:
1139: enforce variable name syntax for commandline variables: has to
1140: start with letter or _.
1.1 tholo 1141:
1.7 millert 1142: Jul 27, 1991:
1143: allow newline after ; in for statements.
1.1 tholo 1144:
1.7 millert 1145: Jul 21, 1991:
1146: fixed so that in self-assignment like $1=$1, side effects
1147: like recomputing $0 take place. (this is getting subtle.)
1.1 tholo 1148:
1.7 millert 1149: Jun 30, 1991:
1150: better test for detecting too-long output record.
1.1 tholo 1151:
1.7 millert 1152: Jun 2, 1991:
1153: better defense against very long printf strings.
1154: made break and continue illegal outside of loops.
1.1 tholo 1155:
1.7 millert 1156: May 13, 1991:
1157: removed extra arg on gettemp, tempfree. minor error message rewording.
1.1 tholo 1158:
1159: May 6, 1991:
1160: fixed silly bug in hex parsing in hexstr().
1161: removed an apparently unnecessary test in isnumber().
1162: warn about weird printf conversions.
1163: fixed unchecked array overwrite in relex().
1164:
1165: changed for (i in array) to access elements in sorted order.
1166: then unchanged it -- it really does run slower in too many cases.
1167: left the code in place, commented out.
1168:
1.7 millert 1169: Feb 10, 1991:
1170: check error status on all writes, to avoid banging on full disks.
1.1 tholo 1171:
1.7 millert 1172: Jan 28, 1991:
1173: awk -f - reads the program from stdin.
1.1 tholo 1174:
1.7 millert 1175: Jan 11, 1991:
1176: failed to set numeric state on $0 in cmd|getline context in run.c.
1.1 tholo 1177:
1.7 millert 1178: Nov 2, 1990:
1179: fixed sleazy test for integrality in getsval; use modf.
1.1 tholo 1180:
1.7 millert 1181: Oct 29, 1990:
1182: fixed sleazy buggy code in lib.c that looked (incorrectly) for
1183: too long input lines.
1.1 tholo 1184:
1.7 millert 1185: Oct 14, 1990:
1186: fixed the bug on p. 198 in which it couldn't deduce that an
1187: argument was an array in some contexts. replaced the error
1188: message in intest() by code that damn well makes it an array.
1.1 tholo 1189:
1.7 millert 1190: Oct 8, 1990:
1191: fixed horrible bug: types and values were not preserved in
1192: some kinds of self-assignment. (in assign().)
1.1 tholo 1193:
1.7 millert 1194: Aug 24, 1990:
1195: changed NCHARS to 256 to handle 8-bit characters in strings
1196: presented to match(), etc.
1.1 tholo 1197:
1.7 millert 1198: Jun 26, 1990:
1199: changed struct rrow (awk.h) to use long instead of int for lval,
1200: since cfoll() stores a pointer in it. now works better when int's
1201: are smaller than pointers!
1.1 tholo 1202:
1.7 millert 1203: May 6, 1990:
1204: AVA fixed the grammar so that ! is uniformly of the same precedence as
1205: unary + and -. This renders illegal some constructs like !x=y, which
1206: now has to be parenthesized as !(x=y), and makes others work properly:
1207: !x+y is (!x)+y, and x!y is x !y, not two pattern-action statements.
1208: (These problems were pointed out by Bob Lenk of Posix.)
1.1 tholo 1209:
1.7 millert 1210: Added \x to regular expressions (already in strings).
1211: Limited octal to octal digits; \8 and \9 are not octal.
1212: Centralized the code for parsing escapes in regular expressions.
1213: Added a bunch of tests to T.re and T.sub to verify some of this.
1.1 tholo 1214:
1.7 millert 1215: Feb 9, 1990:
1216: fixed null pointer dereference bug in main.c: -F[nothing]. sigh.
1.1 tholo 1217:
1.7 millert 1218: restored srand behavior: it returns the current seed.
1.1 tholo 1219:
1.7 millert 1220: Jan 18, 1990:
1221: srand now returns previous seed value (0 to start).
1.1 tholo 1222:
1.7 millert 1223: Jan 5, 1990:
1224: fix potential problem in tran.c -- something was freed,
1225: then used in freesymtab.
1.1 tholo 1226:
1.7 millert 1227: Oct 18, 1989:
1228: another try to get the max number of open files set with
1229: relatively machine-independent code.
1.1 tholo 1230:
1.7 millert 1231: small fix to input() in case of multiple reads after EOF.
1.1 tholo 1232:
1.7 millert 1233: Oct 11, 1989:
1234: FILENAME is now defined in the BEGIN block -- too many old
1235: programs broke.
1.1 tholo 1236:
1.7 millert 1237: "-" means stdin in getline as well as on the commandline.
1.1 tholo 1238:
1.7 millert 1239: added a bunch of casts to the code to tell the truth about
1240: char * vs. unsigned char *, a right royal pain. added a
1241: setlocale call to the front of main, though probably no one
1242: has it usefully implemented yet.
1.1 tholo 1243:
1.7 millert 1244: Aug 24, 1989:
1245: removed redundant relational tests against nullnode if parse
1246: tree already had a relational at that point.
1.1 tholo 1247:
1.7 millert 1248: Aug 11, 1989:
1249: fixed bug: commandline variable assignment has to look like
1250: var=something. (consider the man page for =, in file =.1)
1.1 tholo 1251:
1.7 millert 1252: changed number of arguments to functions to static arrays
1253: to avoid repeated malloc calls.
1.1 tholo 1254:
1.7 millert 1255: Aug 2, 1989:
1256: restored -F (space) separator
1.1 tholo 1257:
1.7 millert 1258: Jul 30, 1989:
1259: added -v x=1 y=2 ... for immediate commandline variable assignment;
1260: done before the BEGIN block for sure. they have to precede the
1261: program if the program is on the commandline.
1262: Modified Aug 2 to require a separate -v for each assignment.
1.1 tholo 1263:
1.7 millert 1264: Jul 10, 1989:
1265: fixed ref-thru-zero bug in environment code in tran.c
1.1 tholo 1266:
1.7 millert 1267: Jun 23, 1989:
1268: add newline to usage message.
1.1 tholo 1269:
1.7 millert 1270: Jun 14, 1989:
1271: added some missing ansi printf conversion letters: %i %X %E %G.
1272: no sensible meaning for h or L, so they may not do what one expects.
1.1 tholo 1273:
1.7 millert 1274: made %* conversions work.
1.1 tholo 1275:
1.7 millert 1276: changed x^y so that if n is a positive integer, it's done
1277: by explicit multiplication, thus achieving maximum accuracy.
1278: (this should be done by pow() but it seems not to be locally.)
1279: done to x ^= y as well.
1.1 tholo 1280:
1.7 millert 1281: Jun 4, 1989:
1282: ENVIRON array contains environment: if shell variable V=thing,
1283: ENVIRON["V"] is "thing"
1.1 tholo 1284:
1.7 millert 1285: multiple -f arguments permitted. error reporting is naive.
1286: (they were permitted before, but only the last was used.)
1.1 tholo 1287:
1.7 millert 1288: fixed a really stupid botch in the debugging macro dprintf
1.1 tholo 1289:
1.7 millert 1290: fixed order of evaluation of commandline assignments to match
1291: what the book claims: an argument of the form x=e is evaluated
1292: at the time it would have been opened if it were a filename (p 63).
1293: this invalidates the suggested answer to ex 4-1 (p 195).
1.1 tholo 1294:
1.7 millert 1295: removed some code that permitted -F (space) fieldseparator,
1296: since it didn't quite work right anyway. (restored aug 2)
1.1 tholo 1297:
1.7 millert 1298: Apr 27, 1989:
1299: Line number now accumulated correctly for comment lines.
1.1 tholo 1300:
1.7 millert 1301: Apr 26, 1989:
1302: Debugging output now includes a version date,
1303: if one compiles it into the source each time.
1.1 tholo 1304:
1.7 millert 1305: Apr 9, 1989:
1306: Changed grammar to prohibit constants as 3rd arg of sub and gsub;
1307: prevents class of overwriting-a-constant errors. (Last one?)
1308: This invalidates the "banana" example on page 43 of the book.
1.1 tholo 1309:
1.7 millert 1310: Added \a ("alert"), \v (vertical tab), \xhhh (hexadecimal),
1311: as in ANSI, for strings. Rescinded the sloppiness that permitted
1312: non-octal digits in \ooo. Warning: not all compilers and libraries
1313: will be able to deal with \x correctly.
1.1 tholo 1314:
1.7 millert 1315: Jan 9, 1989:
1316: Fixed bug that caused tempcell list to contain a duplicate.
1317: The fix is kludgy.
1.1 tholo 1318:
1.7 millert 1319: Dec 17, 1988:
1320: Catches some more commandline errors in main.
1321: Removed redundant decl of modf in run.c (confuses some compilers).
1322: Warning: there's no single declaration of malloc, etc., in awk.h
1323: that seems to satisfy all compilers.
1.1 tholo 1324:
1.7 millert 1325: Dec 7, 1988:
1326: Added a bit of code to error printing to avoid printing nulls.
1327: (Not clear that it actually would.)
1.1 tholo 1328:
1.7 millert 1329: Nov 27, 1988:
1330: With fear and trembling, modified the grammar to permit
1331: multiple pattern-action statements on one line without
1332: an explicit separator. By definition, this capitulation
1333: to the ghost of ancient implementations remains undefined
1334: and thus subject to change without notice or apology.
1335: DO NOT COUNT ON IT.
1.1 tholo 1336:
1.7 millert 1337: Oct 30, 1988:
1338: Fixed bug in call() that failed to recover storage.
1.1 tholo 1339:
1.7 millert 1340: A warning is now generated if there are more arguments
1341: in the call than in the definition (in lieu of fixing
1342: another storage leak).
1.2 millert 1343:
1.7 millert 1344: Oct 20, 1988:
1345: Fixed %c: if expr is numeric, use numeric value;
1346: otherwise print 1st char of string value. still
1347: doesn't work if the value is 0 -- won't print \0.
1.2 millert 1348:
1.7 millert 1349: Added a few more checks for running out of malloc.
1.2 millert 1350:
1.7 millert 1351: Oct 12, 1988:
1352: Fixed bug in call() that freed local arrays twice.
1.5 kstailey 1353:
1.7 millert 1354: Fixed to handle deletion of non-existent array right;
1355: complains about attempt to delete non-array element.
1.6 kstailey 1356:
1.7 millert 1357: Sep 30, 1988:
1358: Now guarantees to evaluate all arguments of built-in
1359: functions, as in C; the appearance is that arguments
1360: are evaluated before the function is called. Places
1361: affected are sub (gsub was ok), substr, printf, and
1362: all the built-in arithmetic functions in bltin().
1363: A warning is generated if a bltin() is called with
1364: the wrong number of arguments.
1.6 kstailey 1365:
1.7 millert 1366: This requires changing makeprof on p167 of the book.
1.6 kstailey 1367:
1.7 millert 1368: Aug 23, 1988:
1369: setting FILENAME in BEGIN caused core dump, apparently
1370: because it was freeing space not allocated by malloc.
1.6 kstailey 1371:
1.7 millert 1372: July 24, 1988:
1373: fixed egregious error in toupper/tolower functions.
1374: still subject to rescinding, however.
1.6 kstailey 1375:
1.7 millert 1376: July 2, 1988:
1377: flush stdout before opening file or pipe
1.6 kstailey 1378:
1.7 millert 1379: July 2, 1988:
1380: performance bug in b.c/cgoto(): not freeing some sets of states.
1381: partial fix only right now, and the number of states increased
1382: to make it less obvious.
1.6 kstailey 1383:
1.7 millert 1384: June 1, 1988:
1385: check error status on close
1.6 kstailey 1386:
1.7 millert 1387: May 28, 1988:
1388: srand returns seed value it's using.
1389: see 1/18/90
1.6 kstailey 1390:
1.7 millert 1391: May 22, 1988:
1392: Removed limit on depth of function calls.
1.6 kstailey 1393:
1.7 millert 1394: May 10, 1988:
1395: Fixed lib.c to permit _ in commandline variable names.
1.6 kstailey 1396:
1.7 millert 1397: Mar 25, 1988:
1398: main.c fixed to recognize -- as terminator of command-
1399: line options. Illegal options flagged.
1400: Error reporting slightly cleaned up.
1.6 kstailey 1401:
1.7 millert 1402: Dec 2, 1987:
1403: Newer C compilers apply a strict scope rule to extern
1404: declarations within functions. Two extern declarations in
1405: lib.c and tran.c have been moved to obviate this problem.
1.6 kstailey 1406:
1.7 millert 1407: Oct xx, 1987:
1408: Reluctantly added toupper and tolower functions.
1409: Subject to rescinding without notice.
1.6 kstailey 1410:
1.7 millert 1411: Sep 17, 1987:
1412: Error-message printer had printf(s) instead of
1413: printf("%s",s); got core dumps when the message
1414: included a %.
1.6 kstailey 1415:
1.7 millert 1416: Sep 12, 1987:
1417: Very long printf strings caused core dump;
1418: fixed aprintf, asprintf, format to catch them.
1419: Can still get a core dump in printf itself.
1.6 kstailey 1420:
1421: