Annotation of src/usr.bin/awk/FIXES, Revision 1.44
1.44 ! millert 1: /* $OpenBSD: FIXES,v 1.43 2022/01/27 16:58:37 millert Exp $ */
1.1 tholo 2: /****************************************************************
1.6 kstailey 3: Copyright (C) Lucent Technologies 1997
1.1 tholo 4: All Rights Reserved
5:
6: Permission to use, copy, modify, and distribute this software and
7: its documentation for any purpose and without fee is hereby
8: granted, provided that the above copyright notice appear in all
9: copies and that both that the copyright notice and this
10: permission notice and warranty disclaimer appear in supporting
1.6 kstailey 11: documentation, and that the name Lucent Technologies or any of
12: its entities not be used in advertising or publicity pertaining
13: to distribution of the software without specific, written prior
14: permission.
15:
16: LUCENT DISCLAIMS ALL WARRANTIES WITH REGARD TO THIS SOFTWARE,
17: INCLUDING ALL IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS.
18: IN NO EVENT SHALL LUCENT OR ANY OF ITS ENTITIES BE LIABLE FOR ANY
19: SPECIAL, INDIRECT OR CONSEQUENTIAL DAMAGES OR ANY DAMAGES
20: WHATSOEVER RESULTING FROM LOSS OF USE, DATA OR PROFITS, WHETHER
21: IN AN ACTION OF CONTRACT, NEGLIGENCE OR OTHER TORTIOUS ACTION,
22: ARISING OUT OF OR IN CONNECTION WITH THE USE OR PERFORMANCE OF
23: THIS SOFTWARE.
1.1 tholo 24: ****************************************************************/
25:
26: This file lists all bug fixes, changes, etc., made since the AWK book
27: was sent to the printers in August, 1987.
1.44 ! millert 28:
! 29: Mar 3, 2022:
! 30: Fixed file management memory leak that appears to have been
! 31: there since the files array was first initialized with stdin,
! 32: stdout, and stderr (circa 1992). Thanks to Miguel Pineiro Jr.
! 33: <mpj@pineiro.cc>.
1.43 millert 34:
35: December 8, 2021:
36: The error handling in closefile and closeall was mangled. Long
37: standing warnings had been made fatal and some fatal errors went
38: undetected. Thanks to Miguel Pineiro Jr. <mpj@pineiro.cc>.
1.42 millert 39:
40: Nov 03, 2021:
41: getline accesses uninitialized data after getrec()
42: returns 0 on EOF and leaves the contents of buf unchanged.
43: Thanks to Volodymyr Gubarkov, and Todd C Miller.
1.41 millert 44:
45: Oct 12, 2021:
46: The fix for #83 changed the code to insert 2 chars, but the
47: call to adjbuf just above it only allows for 1 char. This can
48: cause a heap buffer overflow.
49:
50: July 27, 2021:
51: As per IEEE Std 1003.1-2008, -F "str" is now consistent with
52: -v FS="str" when str is null. Thanks to Warner Losh.
53:
54: July 24, 2021:
55: Fix readrec's definition of a record. This fixes an issue
56: with NetBSD's RS regular expression support that can cause
57: an infinite read loop. Thanks to Miguel Pineiro Jr.
58:
59: Fix regular expression RS ^-anchoring. RS ^-anchoring needs to
60: know if it is reading the first record of a file. This change
61: restores a missing line that was overlooked when porting NetBSD's
62: RS regex functionality. Thanks to Miguel Pineiro Jr.
63:
64: Fix size computation in replace_repeat() for special case
65: REPEAT_WITH_Q. Thanks to Todd C. Miller.
66:
67: February 15, 2021:
68: Small fix so that awk will compile again with g++. Thanks to
69: Arnold Robbins.
70:
71: January 06, 2021:
72: Fix a decision bug with trailing stuff in lib.c:is_valid_number
73: after recent changes. Thanks to Ozan Yigit.
1.40 millert 74:
75: December 18, 2020:
76: Fix problems converting inf and NaN values in lib.c:is_valid_number.
77: Enhance number to string conversion to do the right thing for
78: NaN and inf values. Things are now pretty much the same as in
79: gawk. (Found a gawk bug while we're at it.) Added a torture
80: test for these values. Thanks to Arnold Robbins. Allows closing
81: of PR #101.
82:
83: December 15, 2020:
84: Merge PR #99, which gets the right header for strcasecmp.
85: Thanks to GitHub user michaelforney.
1.39 millert 86:
87: December 8, 2020:
88: Merge PR #98: Disallow hex data. Allow only +nan, -nan,
89: +inf, -inf (case independent) to give NaN and infinity values.
90: Improve things so that string to double conversion is only
91: done once, yielding something of a speedup. This obviate
92: PR #95. Thanks to Arnold Robbins.
93:
94: December 3, 2020:
95: Fix to argument parsing to avoid printing spurious newlines.
96: Thanks to Todd Miller. Merges PR #97.
97:
98: October 13, 2020:
99: Add casts before all the calls to malloc/calloc/realloc in order
100: to get it to compile with g++. Thanks to Arnold Robbins.
101:
102: August 16, 2020:
103: Additional fixes for DJGPP. Thanks to Eli Zaretskii for
104: the testing.
1.38 millert 105:
106: August 7, 2020:
107: Merge PR #93, which adds casts to (void*) for debug prints
108: using the %p format specifier. Thanks to GitHub user YongHaoWu
109: ("Chris") for the fixes.
110:
111: August 4, 2020:
112: In run.c, use non-restartable multibyte routines to attain
113: portability to DJGPP. Should fix Issue 92. Thanks to Albert Wik
114: for the report and to Todd Miller for the suggested fix.
1.37 millert 115:
116: July 30, 2020:
117: Merge PRs 88-91 which fix small bugs. Thanks to Todd Miller and
118: Tim van der Molen for the fixes.
119:
120: In order to make life easier, we move exclusively to bison
121: as the parser generator.
1.36 millert 122:
123: July 2, 2020:
124: Merge PRs 85 and 86 which fix regressions. Thanks to
125: Tim van der Molen for the fixes.
1.35 millert 126:
127: June 25, 2020:
128: Merge PRs 82 and 84. The latter fixes issue #83. Thanks to
129: Todd Miller and awkfan77.
1.34 millert 130:
131: June 12, 2020:
132: Clear errno before calling errcheck to avoid any spurious errors
133: left over from previous calls that may have set it. Thanks to
134: Todd Miller for the fix, from PR #80.
135:
136: Fix Issue #78 by allowing \r to follow floating point numbers in
137: lib.c:is_number. Thanks to GitHub user ajcarr for the report
138: and to Arnold Robbins for the fix.
1.33 millert 139:
140: June 5, 2020:
141: In fldbld(), make sure that inputFS is set before trying to
142: use it. Thanks to Steffen Nurpmeso <steffen@sdaoden.eu>
143: for the report.
144:
145: May 5, 2020:
146: Fix checks for compilers that can handle noreturn. Thanks to
147: GitHub user enh-google for pointing it out. Closes Issue #79.
148:
149: April 16, 2020:
150: Handle old compilers that don't support C11 (for noreturn).
151: Thanks to Arnold Robbins.
152:
153: April 5, 2020:
154: Use <stdnoreturn.h> and noreturn instead of GCC attributes.
155: Thanks to GitHub user awkfan77. Closes PR #77.
1.30 millert 156:
1.32 millert 157: February 28, 2020:
158: More cleanups from Christos Zoulas: notably backslash continuation
159: inside strings removes the newline and a fix for RS = "^a".
160: Fix for address sanitizer-found problem. Thanks to GitHub user
161: enh-google.
162:
163: February 19, 2020:
164: More small cleanups from Christos Zoulas.
165:
166: February 18, 2020:
167: Additional cleanups from Christos Zoulas. It's no longer necessary
168: to use the -y flag to bison.
169:
170: February 6, 2020:
171: Additional small cleanups from Christos Zoulas. awk is now
172: a little more robust about reporting I/O errors upon exit.
173:
1.31 millert 174: January 31, 2020:
175: Merge PR #70, which avoids use of variable length arrays. Thanks
176: to GitHub user michaelforney. Fix issue #60 ({0} in interval
1.32 millert 177: expressions doesn't work). Also get all tests working again.
178: Thanks to Arnold Robbins.
1.31 millert 179:
180: January 24, 2020:
181: A number of small cleanups from Christos Zoulas. Add the close
182: on exec flag to files/pipes opened for redirection; courtesy of
183: Arnold Robbins.
184:
185: January 19, 2020:
186: If POSIXLY_CORRECT is set in the environment, then sub and gsub
187: use POSIX rules for multiple backslashes. This fixes Issue #66,
188: while maintaining backwards compatibility.
189:
190: January 9, 2020:
191: Input/output errors on closing files are now fatal instead of
192: mere warnings. Thanks to Martijn Dekker <martijn@inlv.org>.
193:
1.30 millert 194: January 5, 2020:
195: Fix a bug in the concatentation of two string constants into
196: one done in the grammar. Fixes GitHub issue #61. Thanks
197: to GitHub user awkfan77 for pointing out the direction for
198: the fix. New test T.concat added to the test suite.
199: Fix a few memory leaks reported by valgrind, as well.
200:
201: December 27, 2019:
202: Fix a bug whereby a{0,3} could match four a's. Thanks to
203: "Anonymous AWK fan" for the report.
204:
205: December 11, 2019:
206: Further printf-related fixes for 32 bit systems.
207: Thanks again to Christos Zoulas.
208:
209: December 8, 2019:
210: Fix the return value of sprintf("%d") on 32 bit systems.
211: Thanks to Jim Lowe for the report and to Christos Zoulas
212: for the fix.
1.29 millert 213:
214: November 10, 2019:
215: Convert a number of Boolean integer variables into
216: actual bools. Convert compile_time variable into an
217: enum and simplify some of the related code. Thanks
218: to Arnold Robbins.
219:
220: November 8, 2019:
221: Fix from Ori Bernstein to get UTF-8 characters instead of
222: bytes when FS = "". This is currently the only bit of
223: the One True Awk that understands multibyte characters.
224: From Arnold Robbins, apply some cleanups in the test suite.
1.28 millert 225:
226: October 25, 2019:
227: More fixes and cleanups from NetBSD, courtesy of Christos
228: Zoulas. Merges PRs 54 and 55.
229:
230: October 24, 2019:
231: Import second round of code cleanups from NetBSD. Much thanks
1.31 millert 232: to Christos Zoulas (GitHub user zoulasc). Merges PR 53.
1.28 millert 233: Add an optimization for string concatenation, also from
234: Christos.
1.27 millert 235:
236: October 17, 2019:
237: Import code cleanups from NetBSD. Much thanks to Christos
1.31 millert 238: Zoulas (GitHub user zoulasc). Merges PR 51.
1.26 millert 239:
240: October 6, 2019:
241: Import code from NetBSD awk that implements RS as a regular
242: expression.
1.23 millert 243:
1.25 millert 244: September 10, 2019:
245: Fixes for various array / memory overruns found via gcc's
1.31 millert 246: -fsanitize=unknown. Thanks to Alexander Richardson (GitHub
1.25 millert 247: user arichardson). Merges PRs 47 and 48.
248:
249: July 28, 2019:
250: Import grammar optimization from NetBSD: Two string constants
251: concatenated together get turned into a single string.
252:
253: July 26, 2019:
254: Support POSIX-specified C-style escape sequences "\a" (alarm)
255: and "\v" (vertical tab) in command line arguments and regular
256: expressions, further to the support for them in strings added on
257: Apr 9, 1989. These now no longer match as literal "a" and "v"
258: characters (as they don't on other awk implementations).
259: Thanks to Martijn Dekker.
260:
261: July 17, 2019:
262: Pull in a number of code cleanups and minor fixes from
263: Warner Losh's bsd-ota branch. The only user visible change
264: is the use of random(3) as the random number generator.
265: Thanks to Warner Losh for collecting all these fixes in
266: one easy place to get them from.
267:
268: July 16, 2019:
269: Fix field splitting to use FS value as of the time a record
270: was read or assigned to. Thanks to GitHub user Cody Mello (melloc)
271: for the fix. (Merged from his branch, via PR #42.) Updated
272: testdir/T.split per said PR as well.
273:
274: June 24, 2019:
275: Extract awktest.tar into testdir directory. Add some very
276: simple mechanics to the makefile for running the tests and
277: for cleaning up. No changes to awk itself.
278:
1.24 millert 279: June 17, 2019:
280: Disallow deleting SYMTAB and its elements, which creates
281: use-after-free bugs. Thanks to GitHub user Cody Mello (melloc)
282: for the fix. (Merged from PR #43.)
283:
284: June 5, 2019:
285: Allow unmatched right parenthesis in a regular expression to
286: be treated literally. Fixes Issue #40. Thanks to GitHub user
287: Warner Losh (bsdimp) for the report. Thanks to Arnold Robbins
288: for the fix.
289:
290: May 29,2019:
291: Fix check for command line arguments to no longer require that
292: first character after '=' not be another '='. Reverts change of
293: August 11, 1989. Thanks to GitHub user Jamie Landeg Jones for
294: pointing out the issue; from Issue #38.
295:
296: Apr 7, 2019:
297: Update awktest.tar(p.50) to use modern options to sort. Needed
298: for Android development. Thanks to GitHub user mohd-akram (Mohamed
299: Akram). From Issue #33.
300:
301: Mar 12, 2019:
302: Added very simplistic support for cross-compiling in the
303: makefile. We are NOT going to go in the direction of the
304: autotools, though. Thanks to GitHub user nee-san for
305: the basic change. (Merged from PR #34.)
306:
1.23 millert 307: Mar 5, 2019:
308: Added support for POSIX-standard interval expressions (a.k.a.
309: bounds, a.k.a. repetition expressions) in regular expressions,
310: backported (via NetBSD) from Apple awk-24 (20070501).
311: Thanks to Martijn Dekker <martijn@inlv.org> for the port.
312: (Merged from PR #30.)
313:
314: Mar 3, 2019:
315: Merge PRs as follows:
316: #12: Avoid undefined behaviour when using ctype(3) functions in
317: relex(). Thanks to GitHub user iamleot.
318: #31: Make getline handle numeric strings, and update FIXES. Thanks
1.24 millert 319: to GitHub user arnoldrobbins.
1.23 millert 320: #32: maketab: support build systems with read-only source. Thanks
321: to GitHub user enh.
1.22 millert 322:
323: Jan 25, 2019:
324: Make getline handle numeric strings properly in all cases.
325: (Thanks, Arnold.)
326:
327: Jan 21, 2019:
328: Merged a number of small fixes from GitHub pull requests.
329: Thanks to GitHub users Arnold Robbins (arnoldrobbins),
330: Cody Mello (melloc) and Christoph Junghans (junghans).
331: PR numbers: 13-21, 23, 24, 27.
1.21 millert 332:
333: Oct 25, 2018:
334: Added test in maketab.c to prevent generating a proctab entry
335: for YYSTYPE_IS_DEFINED. It was harmless but some gcc settings
336: generated a warning message. Thanks to Nan Xiao for report.
1.20 millert 337:
338: Aug 27, 2018:
339: Disallow '$' in printf formats; arguments evaluated in order
340: and printed in order.
341:
342: Added some casts to silence warnings on debugging printfs.
343: (Thanks, Arnold.)
1.18 millert 344:
1.19 millert 345: Aug 23, 2018:
346: A long list of fixes courtesy of Arnold Robbins,
347: to whom profound thanks.
348:
349: 1. ofs-rebuild: OFS value used to rebuild the record was incorrect.
350: Fixed August 19, 2014. Revised fix August 2018.
351:
352: 2. system-status: Instead of a floating-point division by 256, use
353: the wait(2) macros to create a reasonable exit status.
354: Fixed March 12, 2016.
355:
356: 3. space: Use provided xisblank() function instead of ispace() for
357: matching [[:blank:]].
358:
359: 4. a-format: Add POSIX standard %a and %A to supported formats. Check
360: at runtime that this format is available.
361:
362: 5. decr-NF: Decrementing NF did not change $0. This is a decades-old
363: bug. There are interactions with the old and new value of OFS as well.
364: Most of the fix came from the NetBSD awk.
365:
366: 6. string-conv: String conversions of scalars were sticky. Once a
367: conversion to string happened, even with OFMT, that value was used until
368: a new numeric value was assigned, even if OFMT differed from CONVFMT,
369: and also if CONVFMT changed.
370:
371: 7. unary-plus: Unary plus on a string constant returned the string.
372: Instead, it should convert the value to numeric and give that value.
373:
374: Also added Arnold's tests for these to awktest.tar as T.arnold.
375:
376: Aug 15, 2018:
377: fixed mangled awktest.tar (thanks, Arnold), posted all
378: current (very minor) fixes to github / onetrueawk
379:
1.18 millert 380: Jun 7, 2018:
381: (yes, a long layoff)
382: Updated some broken tests (beebe.tar, T.lilly)
383: [thanks to Arnold Robbins]
384:
385: Mar 26, 2015:
386: buffer overflow in error reporting; thanks to tobias ulmer
387: and john-mark gurney for spotting it and the fix.
388:
389: Feb 4, 2013:
390: cleaned up a handful of tests that didn't seem to actually
391: test for correct behavior: T.latin1, T.gawk.
392:
393: Jan 5, 2013:
394: added ,NULL initializer to static Cells in run.c; not really
395: needed but cleaner. Thanks to Michael Bombardieri.
1.17 millert 396:
397: Dec 20, 2012:
398: fiddled makefile to get correct yacc and bison flags. pick yacc
399: (linux) or bison (mac) as necessary.
400:
401: added __attribute__((__noreturn__)) to a couple of lines in
402: proto.h, to silence someone's enthusiastic checker.
403:
404: fixed obscure call by value bug in split(a[1],a) reported on
405: 9fans. the management of temporary values is just a mess; i
406: took a shortcut by making an extra string copy. thanks
407: to paul patience and arnold robbins for passing it on and for
408: proposed patches.
409:
410: tiny fiddle in setfval to eliminate -0 results in T.expr, which
411: has irritated me for 20+ years.
1.16 millert 412:
413: Aug 10, 2011:
414: another fix to avoid core dump with delete(ARGV); again, many thanks
415: to ruslan ermilov.
416:
417: Aug 7, 2011:
418: split(s, a, //) now behaves the same as split(s, a, "")
419:
420: Jun 12, 2011:
421: /pat/, \n /pat/ {...} is now legal, though bad style to use.
422:
423: added checks to new -v code that permits -vnospace; thanks to
1.25 millert 424: ruslan ermilov for spotting this and providing the patch.
1.16 millert 425:
426: removed fixed limit on number of open files; thanks to aleksey
1.25 millert 427: cheusov and christos zoulos.
1.16 millert 428:
429: fixed day 1 bug that resurrected deleted elements of ARGV when
430: used as filenames (in lib.c).
431:
432: minor type fiddles to make gcc -Wall -pedantic happier (but not
433: totally so); turned on -fno-strict-aliasing in makefile.
434:
435: May 6, 2011:
436: added #ifdef for isblank.
437: now allows -ffoo as well as -f foo arguments.
438: (thanks, ruslan)
439:
440: May 1, 2011:
441: after advice from todd miller, kevin lo, ruslan ermilov,
442: and arnold robbins, changed srand() to return the previous
443: seed (which is 1 on the first call of srand). the seed is
444: an Awkfloat internally though converted to unsigned int to
1.25 millert 445: pass to the library srand(). thanks, everyone.
1.16 millert 446:
447: fixed a subtle (and i hope low-probability) overflow error
1.25 millert 448: in fldbld, by adding space for one extra \0. thanks to
1.16 millert 449: robert bassett for spotting this one and providing a fix.
450:
451: removed the files related to compilation on windows. i no
452: longer have anything like a current windows environment, so
453: i can't test any of it.
1.15 millert 454:
455: May 23, 2010:
456: fixed long-standing overflow bug in run.c; many thanks to
457: nelson beebe for spotting it and providing the fix.
458:
459: fixed bug that didn't parse -vd=1 properly; thanks to santiago
460: vila for spotting it.
461:
462: Feb 8, 2010:
463: i give up. replaced isblank with isspace in b.c; there are
464: no consistent header files.
465:
466: Nov 26, 2009:
467: fixed a long-standing issue with when FS takes effect. a
468: change to FS is now noticed immediately for subsequent splits.
469:
470: changed the name getline() to awkgetline() to avoid yet another
471: name conflict somewhere.
472:
473: Feb 11, 2009:
474: temporarily for now defined HAS_ISBLANK, since that seems to
475: be the best way through the thicket. isblank arrived in C99,
476: but seems to be arriving at different systems at different
477: times.
478:
479: Oct 8, 2008:
480: fixed typo in b.c that set tmpvec wrongly. no one had ever
481: run into the problem, apparently. thanks to alistair crooks.
1.14 millert 482:
483: Oct 23, 2007:
484: minor fix in lib.c: increase inputFS to 100, change malloc
1.25 millert 485: for fields to n+1.
1.14 millert 486:
487: fixed memory fault caused by out of order test in setsval.
488:
489: thanks to david o'brien, freebsd, for both fixes.
490:
491: May 1, 2007:
492: fiddle in makefile to fix for BSD make; thanks to igor sobrado.
493:
494: Mar 31, 2007:
495: fixed some null pointer refs calling adjbuf.
496:
497: Feb 21, 2007:
498: fixed a bug in matching the null RE in sub and gsub. thanks to al aho
499: who actually did the fix (in b.c), and to wolfgang seeberg for finding
500: it and providing a very compact test case.
501:
502: fixed quotation in b.c; thanks to Hal Pratt and the Princeton Dante
503: Project.
504:
505: removed some no-effect asserts in run.c.
506:
507: fiddled maketab.c to not complain about bison-generated values.
508:
509: removed the obsolete -V argument; fixed --version to print the
510: version and exit.
511:
512: fixed wording and an outright error in the usage message; thanks to igor
513: sobrado and jason mcintyre.
514:
515: fixed a bug in -d that caused core dump if no program followed.
516:
517: Jan 1, 2007:
518: dropped mac.code from makefile; there are few non-MacOSX
519: mac's these days.
520:
521: Jan 17, 2006:
522: system() not flagged as unsafe in the unadvertised -safe option.
523: found it while enhancing tests before shipping the ;login: article.
524: practice what you preach.
525:
526: removed the 9-years-obsolete -mr and -mf flags.
527:
528: added -version and --version options.
529:
530: core dump on linux with BEGIN {nextfile}, now fixed.
531:
1.25 millert 532: removed some #ifdef's in run.c and lex.c that appear to no
1.14 millert 533: longer be necessary.
534:
535: Apr 24, 2005:
536: modified lib.c so that values of $0 et al are preserved in the END
537: block, apparently as required by posix. thanks to havard eidnes
538: for the report and code.
539:
540: Jan 14, 2005:
541: fixed infinite loop in parsing, originally found by brian tsang.
542: thanks to arnold robbins for a suggestion that started me
543: rethinking it.
544:
545: Dec 31, 2004:
1.25 millert 546: prevent overflow of -f array in main, head off potential error in
547: call of SYNTAX(), test malloc return in lib.c, all with thanks to
1.14 millert 548: todd miller.
1.13 millert 549:
550: Dec 22, 2004:
551: cranked up size of NCHARS; coverity thinks it can be overrun with
552: smaller size, and i think that's right. added some assertions to b.c
553: to catch places where it might overrun. the RE code is still fragile.
554:
555: Dec 5, 2004:
556: fixed a couple of overflow problems with ridiculous field numbers:
557: e.g., print $(2^32-1). thanks to ruslan ermilov, giorgos keramidas
558: and david o'brien at freebsd.org for patches. this really should
559: be re-done from scratch.
560:
561: Nov 21, 2004:
562: fixed another 25-year-old RE bug, in split. it's another failure
563: to (re-)initialize. thanks to steve fisher for spotting this and
564: providing a good test case.
565:
566: Nov 22, 2003:
567: fixed a bug in regular expressions that dates (so help me) from 1977;
568: it's been there from the beginning. an anchored longest match that
569: was longer than the number of states triggered a failure to initialize
570: the machine properly. many thanks to moinak ghosh for not only finding
571: this one but for providing a fix, in some of the most mysterious
572: code known to man.
573:
574: fixed a storage leak in call() that appears to have been there since
1.25 millert 575: 1983 or so -- a function without an explicit return that assigns a
576: string to a parameter leaked a Cell. thanks to moinak ghosh for
1.13 millert 577: spotting this very subtle one.
578:
579: Jul 31, 2003:
580: fixed, thanks to andrey chernov and ruslan ermilov, a bug in lex.c
581: that mis-handled the character 255 in input. (it was being compared
582: to EOF with a signed comparison.)
583:
584: Jul 29, 2003:
585: fixed (i think) the long-standing botch that included the beginning of
586: line state ^ for RE's in the set of valid characters; this led to a
587: variety of odd problems, including failure to properly match certain
588: regular expressions in non-US locales. thanks to ruslan for keeping
589: at this one.
590:
591: Jul 28, 2003:
592: n-th try at getting internationalization right, with thanks to volker
593: kiefel, arnold robbins and ruslan ermilov for advice, though they
594: should not be blamed for the outcome. according to posix, "." is the
595: radix character in programs and command line arguments regardless of
596: the locale; otherwise, the locale should prevail for input and output
597: of numbers. so it's intended to work that way.
1.25 millert 598:
1.13 millert 599: i have rescinded the attempt to use strcoll in expanding shorthands in
600: regular expressions (cclenter). its properties are much too
601: surprising; for example [a-c] matches aAbBc in locale en_US but abBcC
602: in locale fr_CA. i can see how this might arise by implementation
603: but i cannot explain it to a human user. (this behavior can be seen
604: in gawk as well; we're leaning on the same library.)
605:
606: the issue appears to be that strcoll is meant for sorting, where
607: merging upper and lower case may make sense (though note that unix
608: sort does not do this by default either). it is not appropriate
609: for regular expressions, where the goal is to match specific
610: patterns of characters. in any case, the notations [:lower:], etc.,
611: are available in awk, and they are more likely to work correctly in
612: most locales.
613:
614: a moratorium is hereby declared on internationalization changes.
615: i apologize to friends and colleagues in other parts of the world.
616: i would truly like to get this "right", but i don't know what
617: that is, and i do not want to keep making changes until it's clear.
618:
619: Jul 4, 2003:
620: fixed bug that permitted non-terminated RE, as in "awk /x".
621:
622: Jun 1, 2003:
623: subtle change to split: if source is empty, number of elems
624: is always 0 and the array is not set.
625:
626: Mar 21, 2003:
627: added some parens to isblank, in another attempt to make things
628: internationally portable.
629:
630: Mar 14, 2003:
631: the internationalization changes, somewhat modified, are now
632: reinstated. in theory awk will now do character comparisons
633: and case conversions in national language, but "." will always
634: be the decimal point separator on input and output regardless
635: of national language. isblank(){} has an #ifndef.
636:
637: this no longer compiles on windows: LC_MESSAGES isn't defined
638: in vc6++.
639:
640: fixed subtle behavior in field and record splitting: if FS is
641: a single character and RS is not empty, \n is NOT a separator.
642: this tortuous reading is found in the awk book; behavior now
643: matches gawk and mawk.
1.11 millert 644:
645: Dec 13, 2002:
646: for the moment, the internationalization changes of nov 29 are
647: rolled back -- programs like x = 1.2 don't work in some locales,
648: because the parser is expecting x = 1,2. until i understand this
649: better, this will have to wait.
650:
651: Nov 29, 2002:
652: modified b.c (with tiny changes in main and run) to support
653: locales, using strcoll and iswhatever tests for posix character
654: classes. thanks to ruslan ermilov (ru@freebsd.org) for code.
655: the function isblank doesn't seem to have propagated to any
656: header file near me, so it's there explicitly. not properly
657: tested on non-ascii character sets by me.
658:
659: Jun 28, 2002:
660: modified run/format() and tran/getsval() to do a slightly better
661: job on using OFMT for output from print and CONVFMT for other
1.25 millert 662: number->string conversions, as promised by posix and done by
1.11 millert 663: gawk and mawk. there are still places where it doesn't work
664: right if CONVFMT is changed; by then the STR attribute of the
665: variable has been irrevocably set. thanks to arnold robbins for
666: code and examples.
667:
668: fixed subtle bug in format that could get core dump. thanks to
669: Jaromir Dolecek <jdolecek@NetBSD.org> for finding and fixing.
670: minor cleanup in run.c / format() at the same time.
671:
672: added some tests for null pointers to debugging printf's, which
673: were never intended for external consumption. thanks to dave
674: kerns (dkerns@lucent.com) for pointing this out.
675:
676: GNU compatibility: an empty regexp matches anything (thanks to
677: dag-erling smorgrav, des@ofug.org). subject to reversion if
678: this does more harm than good.
679:
680: pervasive small changes to make things more const-correct, as
681: reported by gcc's -Wwrite-strings. as it says in the gcc manual,
682: this may be more nuisance than useful. provoked by a suggestion
683: and code from arnaud desitter, arnaud@nimbus.geog.ox.ac.uk
684:
685: minor documentation changes to note that this now compiles out
686: of the box on Mac OS X.
687:
688: Feb 10, 2002:
689: changed types in posix chars structure to quiet solaris cc.
690:
691: Jan 1, 2002:
692: fflush() or fflush("") flushes all files and pipes.
693:
1.25 millert 694: length(arrayname) returns number of elements; thanks to
1.11 millert 695: arnold robbins for suggestion.
696:
697: added a makefile.win to make it easier to build on windows.
698: based on dan allen's buildwin.bat.
699:
700: Nov 16, 2001:
701: added support for posix character class names like [:digit:],
702: which are not exactly shorter than [0-9] and perhaps no more
703: portable. thanks to dag-erling smorgrav for code.
704:
705: Feb 16, 2001:
706: removed -m option; no longer needed, and it was actually
707: broken (noted thanks to volker kiefel).
708:
709: Feb 10, 2001:
710: fixed an appalling bug in gettok: any sequence of digits, +,-, E, e,
711: and period was accepted as a valid number if it started with a period.
712: this would never have happened with the lex version.
713:
714: other 1-character botches, now fixed, include a bare $ and a
715: bare " at the end of the input.
716:
717: Feb 7, 2001:
718: more (const char *) casts in b.c and tran.c to silence warnings.
1.8 millert 719:
1.10 millert 720: Nov 15, 2000:
721: fixed a bug introduced in august 1997 that caused expressions
722: like $f[1] to be syntax errors. thanks to arnold robbins for
723: noticing this and providing a fix.
724:
725: Oct 30, 2000:
726: fixed some nextfile bugs: not handling all cases. thanks to
727: arnold robbins for pointing this out. new regressions added.
728:
729: close() is now a function. it returns whatever the library
730: fclose returns, and -1 for closing a file or pipe that wasn't
731: opened.
732:
733: Sep 24, 2000:
734: permit \n explicitly in character classes; won't work right
735: if comes in as "[\n]" but ok as /[\n]/, because of multiple
736: processing of \'s. thanks to arnold robbins.
737:
738: July 5, 2000:
739: minor fiddles in tran.c to keep compilers happy about uschar.
740: thanks to norman wilson.
741:
742: May 25, 2000:
743: yet another attempt at making 8-bit input work, with another
1.25 millert 744: band-aid in b.c (member()), and some (uschar) casts to head
1.10 millert 745: off potential errors in subscripts (like isdigit). also
746: changed HAT to NCHARS-2. thanks again to santiago vila.
747:
748: changed maketab.c to ignore apparently out of range definitions
749: instead of halting; new freeBSD generates one. thanks to
750: jon snader <jsnader@ix.netcom.com> for pointing out the problem.
751:
752: May 2, 2000:
753: fixed an 8-bit problem in b.c by making several char*'s into
754: unsigned char*'s. not clear i have them all yet. thanks to
755: Santiago Vila <sanvila@unex.es> for the bug report.
756:
757: Apr 21, 2000:
758: finally found and fixed a memory leak in function call; it's
759: been there since functions were added ~1983. thanks to
760: jon bentley for the test case that found it.
761:
762: added test in envinit to catch environment "variables" with
1.12 otto 763: names beginning with '='; thanks to Berend Hasselman.
1.10 millert 764:
765: Jul 28, 1999:
766: added test in defn() to catch function foo(foo), which
767: otherwise recurses until core dump. thanks to arnold
768: robbins for noticing this.
769:
1.9 millert 770: Jun 20, 1999:
771: added *bp in gettok in lex.c; appears possible to exit function
772: without terminating the string. thanks to russ cox.
773:
774: Jun 2, 1999:
775: added function stdinit() to run to initialize files[] array,
776: in case stdin, etc., are not constants; some compilers care.
777:
778: May 10, 1999:
779: replaced the ERROR ... FATAL, etc., macros with functions
780: based on vprintf, to avoid problems caused by overrunning
781: fixed-size errbuf array. thanks to ralph corderoy for the
782: impetus, and for pointing out a string termination bug in
783: qstring as well.
784:
785: Apr 21, 1999:
786: fixed bug that caused occasional core dumps with commandline
787: variable with value ending in \. (thanks to nelson beebe for
788: the test case.)
789:
1.8 millert 790: Apr 16, 1999:
1.25 millert 791: with code kindly provided by Bruce Lilly, awk now parses
1.8 millert 792: /=/ and similar constructs more sensibly in more places.
1.10 millert 793: Bruce also provided some helpful test cases.
1.8 millert 794:
795: Apr 5, 1999:
796: changed true/false to True/False in run.c to make it
797: easier to compile with C++. Added some casts on malloc
798: and realloc to be honest about casts; ditto. changed
799: ltype int to long in struct rrow to reduce some 64-bit
800: complaints; other changes scattered throughout for the
801: same purpose. thanks to Nelson Beebe for these portability
802: improvements.
803:
804: removed some horrible pointer-int casting in b.c and elsewhere
805: by adding ptoi and itonp to localize the casts, which are
806: all benign. fixed one incipient bug that showed up on sgi
807: in 64-bit mode.
808:
809: reset lineno for new source file; include filename in error
810: message. also fixed line number error in continuation lines.
811: (thanks to Nelson Beebe for both of these.)
812:
813: Mar 24, 1999:
814: Nelson Beebe notes that irix 5.3 yacc dies with a bogus
815: error; use a newer version or switch to bison, since sgi
816: is unlikely to fix it.
1.1 tholo 817:
1.7 millert 818: Mar 5, 1999:
1.9 millert 819: changed isnumber to is_number to avoid the problem caused by
820: versions of ctype.h that include the name isnumber.
1.7 millert 821:
822: distribution now includes a script for building on a Mac,
823: thanks to Dan Allen.
824:
825: Feb 20, 1999:
826: fixed memory leaks in run.c (call) and tran.c (setfval).
827: thanks to Stephen Nutt for finding these and providing the fixes.
828:
829: Jan 13, 1999:
830: replaced srand argument by (unsigned int) in run.c;
831: avoids problem on Mac and potentially on Unix & Windows.
832: thanks to Dan Allen.
833:
834: added a few (int) casts to silence useless compiler warnings.
835: e.g., errorflag= in run.c jump().
836:
837: added proctab.c to the bundle outout; one less thing
838: to have to compile out of the box.
839:
840: added calls to _popen and _pclose to the win95 stub for
841: pipes (thanks to Steve Adams for this helpful suggestion).
842: seems to work, though properties are not well understood
843: by me, and it appears that under some circumstances the
844: pipe output is truncated. Be careful.
845:
846: Oct 19, 1998:
847: fixed a couple of bugs in getrec: could fail to update $0
1.25 millert 848: after a getline var; because inputFS wasn't initialized,
1.7 millert 849: could split $0 on every character, a misleading diversion.
850:
851: fixed caching bug in makedfa: LRU was actually removing
852: least often used.
853:
854: thanks to ross ridge for finding these, and for providing
855: great bug reports.
856:
857: May 12, 1998:
858: fixed potential bug in readrec: might fail to update record
859: pointer after growing. thanks to dan levy for spotting this
860: and suggesting the fix.
861:
862: Mar 12, 1998:
863: added -V to print version number and die.
1.19 millert 864:
865: [notify dave kerns, dkerns@dacsoup.ih.lucent.com]
1.7 millert 866:
867: Feb 11, 1998:
868: subtle silent bug in lex.c: if the program ended with a number
869: longer than 1 digit, part of the input would be pushed back and
870: parsed again because token buffer wasn't terminated right.
871: example: awk 'length($0) > 10'. blush. at least i found it
872: myself.
873:
874: Aug 31, 1997:
875: s/adelete/awkdelete/: SGI uses this in malloc.h.
876: thanks to nelson beebe for pointing this one out.
877:
878: Aug 21, 1997:
879: fixed some bugs in sub and gsub when replacement includes \\.
880: this is a dark, horrible corner, but at least now i believe that
881: the behavior is the same as gawk and the intended posix standard.
882: thanks to arnold robbins for advice here.
883:
884: Aug 9, 1997:
885: somewhat regretfully, replaced the ancient lex-based lexical
886: analyzer with one written in C. it's longer, generates less code,
887: and more portable; the old one depended too much on mysterious
888: properties of lex that were not preserved in other environments.
889: in theory these recognize the same language.
890:
891: now using strtod to test whether a string is a number, instead of
892: the convoluted original function. should be more portable and
893: reliable if strtod is implemented right.
894:
895: removed now-pointless optimization in makefile that tries to avoid
896: recompilation when awkgram.y is changed but symbols are not.
897:
898: removed most fixed-size arrays, though a handful remain, some
899: of which are unchecked. you have been warned.
900:
901: Aug 4, 1997:
902: with some trepidation, replaced the ancient code that managed
903: fields and $0 in fixed-size arrays with arrays that grow on
904: demand. there is still some tension between trying to make this
905: run fast and making it clean; not sure it's right yet.
906:
907: the ill-conceived -mr and -mf arguments are now useful only
908: for debugging. previous dynamic string code removed.
909:
910: numerous other minor cleanups along the way.
1.1 tholo 911:
1.7 millert 912: Jul 30, 1997:
913: using code provided by dan levy (to whom profuse thanks), replaced
914: fixed-size arrays and awkward kludges by a fairly uniform mechanism
915: to grow arrays as needed for printf, sub, gsub, etc.
1.1 tholo 916:
1.7 millert 917: Jul 23, 1997:
918: falling off the end of a function returns "" and 0, not 0.
919: thanks to arnold robbins.
1.1 tholo 920:
1.7 millert 921: Jun 17, 1997:
922: replaced several fixed-size arrays by dynamically-created ones
923: in run.c; added overflow tests to some previously unchecked cases.
924: getline, toupper, tolower.
1.1 tholo 925:
1.7 millert 926: getline code is still broken in that recursive calls may wind
927: up using the same space. [fixed later]
1.1 tholo 928:
1.7 millert 929: increased RECSIZE to 8192 to push problems further over the horizon.
1.1 tholo 930:
1.7 millert 931: added \r to \n as input line separator for programs, not data.
932: damn CRLFs.
1.1 tholo 933:
1.7 millert 934: modified format() to permit explicit printf("%c", 0) to include
935: a null byte in output. thanks to ken stailey for the fix.
1.1 tholo 936:
1.7 millert 937: added a "-safe" argument that disables file output (print >,
938: print >>), process creation (cmd|getline, print |, system), and
939: access to the environment (ENVIRON). this is a first approximation
940: to a "safe" version of awk, but don't rely on it too much. thanks
941: to joan feigenbaum and matt blaze for the inspiration long ago.
1.1 tholo 942:
1.7 millert 943: Jul 8, 1996:
944: fixed long-standing bug in sub, gsub(/a/, "\\\\&"); thanks to
945: ralph corderoy.
1.1 tholo 946:
1.7 millert 947: Jun 29, 1996:
948: fixed awful bug in new field splitting; didn't get all the places
949: where input was done.
1.1 tholo 950:
1.7 millert 951: Jun 28, 1996:
952: changed field-splitting to conform to posix definition: fields are
953: split using the value of FS at the time of input; it used to be
954: the value when the field or NF was first referred to, a much less
955: predictable definition. thanks to arnold robbins for encouragement
956: to do the right thing.
1.1 tholo 957:
1.7 millert 958: May 28, 1996:
959: fixed appalling but apparently unimportant bug in parsing octal
960: numbers in reg exprs.
1.1 tholo 961:
1.7 millert 962: explicit hex in reg exprs now limited to 2 chars: \xa, \xaa.
1.1 tholo 963:
1.7 millert 964: May 27, 1996:
965: cleaned up some declarations so gcc -Wall is now almost silent.
1.1 tholo 966:
1.7 millert 967: makefile now includes backup copies of ytab.c and lexyy.c in case
968: one makes before looking; it also avoids recreating lexyy.c unless
969: really needed.
1.1 tholo 970:
1.7 millert 971: s/aprintf/awkprint, s/asprintf/awksprintf/ to avoid some name clashes
972: with unwisely-written header files.
1.1 tholo 973:
1.7 millert 974: thanks to jeffrey friedl for several of these.
1.1 tholo 975:
1.7 millert 976: May 26, 1996:
977: an attempt to rationalize the (unsigned) char issue. almost all
978: instances of unsigned char have been removed; the handful of places
979: in b.c where chars are used as table indices have been hand-crafted.
980: added some latin-1 tests to the regression, but i'm not confident;
981: none of my compilers seem to care much. thanks to nelson beebe for
982: pointing out some others that do care.
1.1 tholo 983:
1.7 millert 984: May 2, 1996:
985: removed all register declarations.
1.1 tholo 986:
1.7 millert 987: enhanced split(), as in gawk, etc: split(s, a, "") splits s into
988: a[1]...a[length(s)] with each character a single element.
1.1 tholo 989:
1.7 millert 990: made the same changes for field-splitting if FS is "".
1.1 tholo 991:
1.7 millert 992: added nextfile, as in gawk: causes immediate advance to next
993: input file. (thanks to arnold robbins for inspiration and code).
1.1 tholo 994:
1.7 millert 995: small fixes to regexpr code: can now handle []], [[], and
1.25 millert 996: variants; [] is now a syntax error, rather than matching
1.7 millert 997: everything; [z-a] is now empty, not z. far from complete
998: or correct, however. (thanks to jeffrey friedl for pointing out
999: some awful behaviors.)
1.1 tholo 1000:
1.7 millert 1001: Apr 29, 1996:
1.12 otto 1002: replaced uchar by uschar everywhere; apparently some compilers
1.7 millert 1003: usurp this name and this causes conflicts.
1.1 tholo 1004:
1.7 millert 1005: fixed call to time in run.c (bltin); arg is time_t *.
1.1 tholo 1006:
1.7 millert 1007: replaced horrible pointer/long punning in b.c by a legitimate
1008: union. should be safer on 64-bit machines and cleaner everywhere.
1009: (thanks to nelson beebe for pointing out some of these problems.)
1.1 tholo 1010:
1.7 millert 1011: replaced nested comments by #if 0...#endif in run.c, lib.c.
1.1 tholo 1012:
1.7 millert 1013: removed getsval, setsval, execute macros from run.c and lib.c.
1014: machines are 100x faster than they were when these macros were
1015: first used.
1.1 tholo 1016:
1.7 millert 1017: revised filenames: awk.g.y => awkgram.y, awk.lx.l => awklex.l,
1018: y.tab.[ch] => ytab.[ch], lex.yy.c => lexyy.c, all in the aid of
1019: portability to nameless systems.
1.1 tholo 1020:
1.7 millert 1021: "make bundle" now includes yacc and lex output files for recipients
1022: who don't have yacc or lex.
1.1 tholo 1023:
1.7 millert 1024: Aug 15, 1995:
1025: initialized Cells in setsymtab more carefully; some fields
1026: were not set. (thanks to purify, all of whose complaints i
1027: think i now understand.)
1.1 tholo 1028:
1.7 millert 1029: fixed at least one error in gsub that looked at -1-th element
1030: of an array when substituting for a null match (e.g., $).
1.1 tholo 1031:
1.7 millert 1032: delete arrayname is now legal; it clears the elements but leaves
1033: the array, which may not be the right behavior.
1.1 tholo 1034:
1.7 millert 1035: modified makefile: my current make can't cope with the test used
1036: to avoid unnecessary yacc invocations.
1.1 tholo 1037:
1.7 millert 1038: Jul 17, 1995:
1039: added dynamically growing strings to awk.lx.l and b.c
1040: to permit regular expressions to be much bigger.
1041: the state arrays can still overflow.
1.1 tholo 1042:
1.7 millert 1043: Aug 24, 1994:
1044: detect duplicate arguments in function definitions (mdm).
1.1 tholo 1045:
1.7 millert 1046: May 11, 1994:
1047: trivial fix to printf to limit string size in sub().
1.1 tholo 1048:
1.7 millert 1049: Apr 22, 1994:
1050: fixed yet another subtle self-assignment problem:
1051: $1 = $2; $1 = $1 clobbered $1.
1.1 tholo 1052:
1.7 millert 1053: Regression tests now use private echo, to avoid quoting problems.
1.1 tholo 1054:
1.7 millert 1055: Feb 2, 1994:
1056: changed error() to print line number as %d, not %g.
1.1 tholo 1057:
1.7 millert 1058: Jul 23, 1993:
1059: cosmetic changes: increased sizes of some arrays,
1060: reworded some error messages.
1.1 tholo 1061:
1.7 millert 1062: added CONVFMT as in posix (just replaced OFMT in getsval)
1.1 tholo 1063:
1.7 millert 1064: FILENAME is now "" until the first thing that causes a file
1065: to be opened.
1.1 tholo 1066:
1.7 millert 1067: Nov 28, 1992:
1068: deleted yyunput and yyoutput from proto.h;
1069: different versions of lex give these different declarations.
1.1 tholo 1070:
1.7 millert 1071: May 31, 1992:
1072: added -mr N and -mf N options: more record and fields.
1073: these really ought to adjust automatically.
1.1 tholo 1074:
1.7 millert 1075: cleaned up some error messages; "out of space" now means
1076: malloc returned NULL in all cases.
1.1 tholo 1077:
1.7 millert 1078: changed rehash so that if it runs out, it just returns;
1079: things will continue to run slow, but maybe a bit longer.
1.1 tholo 1080:
1.7 millert 1081: Apr 24, 1992:
1082: remove redundant close of stdin when using -f -.
1.1 tholo 1083:
1.7 millert 1084: got rid of core dump with -d; awk -d just prints date.
1.1 tholo 1085:
1.7 millert 1086: Apr 12, 1992:
1087: added explicit check for /dev/std(in,out,err) in redirection.
1088: unlike gawk, no /dev/fd/n yet.
1.1 tholo 1089:
1.7 millert 1090: added (file/pipe) builtin. hard to test satisfactorily.
1091: not posix.
1.1 tholo 1092:
1.7 millert 1093: Feb 20, 1992:
1094: recompile after abortive changes; should be unchanged.
1.1 tholo 1095:
1.7 millert 1096: Dec 2, 1991:
1097: die-casting time: converted to ansi C, installed that.
1.1 tholo 1098:
1.7 millert 1099: Nov 30, 1991:
1100: fixed storage leak in freefa, failing to recover [N]CCL.
1101: thanks to Bill Jones (jones@cs.usask.ca)
1.1 tholo 1102:
1.7 millert 1103: Nov 19, 1991:
1104: use RAND_MAX instead of literal in builtin().
1.1 tholo 1105:
1.7 millert 1106: Nov 12, 1991:
1107: cranked up some fixed-size arrays in b.c, and added a test for
1108: overflow in penter. thanks to mark larsen.
1.1 tholo 1109:
1.7 millert 1110: Sep 24, 1991:
1111: increased buffer in gsub. a very crude fix to a general problem.
1112: and again on Sep 26.
1.1 tholo 1113:
1.7 millert 1114: Aug 18, 1991:
1115: enforce variable name syntax for commandline variables: has to
1116: start with letter or _.
1.1 tholo 1117:
1.7 millert 1118: Jul 27, 1991:
1119: allow newline after ; in for statements.
1.1 tholo 1120:
1.7 millert 1121: Jul 21, 1991:
1122: fixed so that in self-assignment like $1=$1, side effects
1123: like recomputing $0 take place. (this is getting subtle.)
1.1 tholo 1124:
1.7 millert 1125: Jun 30, 1991:
1126: better test for detecting too-long output record.
1.1 tholo 1127:
1.7 millert 1128: Jun 2, 1991:
1129: better defense against very long printf strings.
1130: made break and continue illegal outside of loops.
1.1 tholo 1131:
1.7 millert 1132: May 13, 1991:
1133: removed extra arg on gettemp, tempfree. minor error message rewording.
1.1 tholo 1134:
1135: May 6, 1991:
1136: fixed silly bug in hex parsing in hexstr().
1137: removed an apparently unnecessary test in isnumber().
1138: warn about weird printf conversions.
1139: fixed unchecked array overwrite in relex().
1140:
1141: changed for (i in array) to access elements in sorted order.
1142: then unchanged it -- it really does run slower in too many cases.
1143: left the code in place, commented out.
1144:
1.7 millert 1145: Feb 10, 1991:
1146: check error status on all writes, to avoid banging on full disks.
1.1 tholo 1147:
1.7 millert 1148: Jan 28, 1991:
1149: awk -f - reads the program from stdin.
1.1 tholo 1150:
1.7 millert 1151: Jan 11, 1991:
1152: failed to set numeric state on $0 in cmd|getline context in run.c.
1.1 tholo 1153:
1.7 millert 1154: Nov 2, 1990:
1155: fixed sleazy test for integrality in getsval; use modf.
1.1 tholo 1156:
1.7 millert 1157: Oct 29, 1990:
1158: fixed sleazy buggy code in lib.c that looked (incorrectly) for
1159: too long input lines.
1.1 tholo 1160:
1.7 millert 1161: Oct 14, 1990:
1162: fixed the bug on p. 198 in which it couldn't deduce that an
1163: argument was an array in some contexts. replaced the error
1164: message in intest() by code that damn well makes it an array.
1.1 tholo 1165:
1.7 millert 1166: Oct 8, 1990:
1167: fixed horrible bug: types and values were not preserved in
1168: some kinds of self-assignment. (in assign().)
1.1 tholo 1169:
1.7 millert 1170: Aug 24, 1990:
1171: changed NCHARS to 256 to handle 8-bit characters in strings
1172: presented to match(), etc.
1.1 tholo 1173:
1.7 millert 1174: Jun 26, 1990:
1175: changed struct rrow (awk.h) to use long instead of int for lval,
1176: since cfoll() stores a pointer in it. now works better when int's
1177: are smaller than pointers!
1.1 tholo 1178:
1.7 millert 1179: May 6, 1990:
1180: AVA fixed the grammar so that ! is uniformly of the same precedence as
1181: unary + and -. This renders illegal some constructs like !x=y, which
1182: now has to be parenthesized as !(x=y), and makes others work properly:
1183: !x+y is (!x)+y, and x!y is x !y, not two pattern-action statements.
1184: (These problems were pointed out by Bob Lenk of Posix.)
1.1 tholo 1185:
1.7 millert 1186: Added \x to regular expressions (already in strings).
1187: Limited octal to octal digits; \8 and \9 are not octal.
1188: Centralized the code for parsing escapes in regular expressions.
1189: Added a bunch of tests to T.re and T.sub to verify some of this.
1.1 tholo 1190:
1.7 millert 1191: Feb 9, 1990:
1192: fixed null pointer dereference bug in main.c: -F[nothing]. sigh.
1.1 tholo 1193:
1.7 millert 1194: restored srand behavior: it returns the current seed.
1.1 tholo 1195:
1.7 millert 1196: Jan 18, 1990:
1197: srand now returns previous seed value (0 to start).
1.1 tholo 1198:
1.7 millert 1199: Jan 5, 1990:
1200: fix potential problem in tran.c -- something was freed,
1201: then used in freesymtab.
1.1 tholo 1202:
1.7 millert 1203: Oct 18, 1989:
1204: another try to get the max number of open files set with
1205: relatively machine-independent code.
1.1 tholo 1206:
1.7 millert 1207: small fix to input() in case of multiple reads after EOF.
1.1 tholo 1208:
1.7 millert 1209: Oct 11, 1989:
1210: FILENAME is now defined in the BEGIN block -- too many old
1211: programs broke.
1.1 tholo 1212:
1.7 millert 1213: "-" means stdin in getline as well as on the commandline.
1.1 tholo 1214:
1.7 millert 1215: added a bunch of casts to the code to tell the truth about
1216: char * vs. unsigned char *, a right royal pain. added a
1217: setlocale call to the front of main, though probably no one
1218: has it usefully implemented yet.
1.1 tholo 1219:
1.7 millert 1220: Aug 24, 1989:
1221: removed redundant relational tests against nullnode if parse
1222: tree already had a relational at that point.
1.1 tholo 1223:
1.7 millert 1224: Aug 11, 1989:
1225: fixed bug: commandline variable assignment has to look like
1226: var=something. (consider the man page for =, in file =.1)
1.1 tholo 1227:
1.7 millert 1228: changed number of arguments to functions to static arrays
1229: to avoid repeated malloc calls.
1.1 tholo 1230:
1.7 millert 1231: Aug 2, 1989:
1232: restored -F (space) separator
1.1 tholo 1233:
1.7 millert 1234: Jul 30, 1989:
1235: added -v x=1 y=2 ... for immediate commandline variable assignment;
1236: done before the BEGIN block for sure. they have to precede the
1237: program if the program is on the commandline.
1238: Modified Aug 2 to require a separate -v for each assignment.
1.1 tholo 1239:
1.7 millert 1240: Jul 10, 1989:
1241: fixed ref-thru-zero bug in environment code in tran.c
1.1 tholo 1242:
1.7 millert 1243: Jun 23, 1989:
1244: add newline to usage message.
1.1 tholo 1245:
1.7 millert 1246: Jun 14, 1989:
1247: added some missing ansi printf conversion letters: %i %X %E %G.
1248: no sensible meaning for h or L, so they may not do what one expects.
1.1 tholo 1249:
1.7 millert 1250: made %* conversions work.
1.1 tholo 1251:
1.7 millert 1252: changed x^y so that if n is a positive integer, it's done
1253: by explicit multiplication, thus achieving maximum accuracy.
1254: (this should be done by pow() but it seems not to be locally.)
1255: done to x ^= y as well.
1.1 tholo 1256:
1.7 millert 1257: Jun 4, 1989:
1258: ENVIRON array contains environment: if shell variable V=thing,
1259: ENVIRON["V"] is "thing"
1.1 tholo 1260:
1.7 millert 1261: multiple -f arguments permitted. error reporting is naive.
1262: (they were permitted before, but only the last was used.)
1.1 tholo 1263:
1.7 millert 1264: fixed a really stupid botch in the debugging macro dprintf
1.1 tholo 1265:
1.7 millert 1266: fixed order of evaluation of commandline assignments to match
1267: what the book claims: an argument of the form x=e is evaluated
1268: at the time it would have been opened if it were a filename (p 63).
1269: this invalidates the suggested answer to ex 4-1 (p 195).
1.1 tholo 1270:
1.7 millert 1271: removed some code that permitted -F (space) fieldseparator,
1272: since it didn't quite work right anyway. (restored aug 2)
1.1 tholo 1273:
1.7 millert 1274: Apr 27, 1989:
1275: Line number now accumulated correctly for comment lines.
1.1 tholo 1276:
1.7 millert 1277: Apr 26, 1989:
1278: Debugging output now includes a version date,
1279: if one compiles it into the source each time.
1.1 tholo 1280:
1.7 millert 1281: Apr 9, 1989:
1282: Changed grammar to prohibit constants as 3rd arg of sub and gsub;
1283: prevents class of overwriting-a-constant errors. (Last one?)
1284: This invalidates the "banana" example on page 43 of the book.
1.1 tholo 1285:
1.7 millert 1286: Added \a ("alert"), \v (vertical tab), \xhhh (hexadecimal),
1287: as in ANSI, for strings. Rescinded the sloppiness that permitted
1288: non-octal digits in \ooo. Warning: not all compilers and libraries
1289: will be able to deal with \x correctly.
1.1 tholo 1290:
1.7 millert 1291: Jan 9, 1989:
1292: Fixed bug that caused tempcell list to contain a duplicate.
1293: The fix is kludgy.
1.1 tholo 1294:
1.7 millert 1295: Dec 17, 1988:
1296: Catches some more commandline errors in main.
1297: Removed redundant decl of modf in run.c (confuses some compilers).
1298: Warning: there's no single declaration of malloc, etc., in awk.h
1299: that seems to satisfy all compilers.
1.1 tholo 1300:
1.7 millert 1301: Dec 7, 1988:
1302: Added a bit of code to error printing to avoid printing nulls.
1303: (Not clear that it actually would.)
1.1 tholo 1304:
1.7 millert 1305: Nov 27, 1988:
1306: With fear and trembling, modified the grammar to permit
1307: multiple pattern-action statements on one line without
1308: an explicit separator. By definition, this capitulation
1309: to the ghost of ancient implementations remains undefined
1310: and thus subject to change without notice or apology.
1311: DO NOT COUNT ON IT.
1.1 tholo 1312:
1.7 millert 1313: Oct 30, 1988:
1314: Fixed bug in call() that failed to recover storage.
1.1 tholo 1315:
1.7 millert 1316: A warning is now generated if there are more arguments
1317: in the call than in the definition (in lieu of fixing
1318: another storage leak).
1.2 millert 1319:
1.7 millert 1320: Oct 20, 1988:
1321: Fixed %c: if expr is numeric, use numeric value;
1322: otherwise print 1st char of string value. still
1323: doesn't work if the value is 0 -- won't print \0.
1.2 millert 1324:
1.7 millert 1325: Added a few more checks for running out of malloc.
1.2 millert 1326:
1.7 millert 1327: Oct 12, 1988:
1328: Fixed bug in call() that freed local arrays twice.
1.5 kstailey 1329:
1.7 millert 1330: Fixed to handle deletion of non-existent array right;
1331: complains about attempt to delete non-array element.
1.6 kstailey 1332:
1.7 millert 1333: Sep 30, 1988:
1334: Now guarantees to evaluate all arguments of built-in
1335: functions, as in C; the appearance is that arguments
1336: are evaluated before the function is called. Places
1337: affected are sub (gsub was ok), substr, printf, and
1338: all the built-in arithmetic functions in bltin().
1339: A warning is generated if a bltin() is called with
1340: the wrong number of arguments.
1.6 kstailey 1341:
1.7 millert 1342: This requires changing makeprof on p167 of the book.
1.6 kstailey 1343:
1.7 millert 1344: Aug 23, 1988:
1345: setting FILENAME in BEGIN caused core dump, apparently
1346: because it was freeing space not allocated by malloc.
1.6 kstailey 1347:
1.7 millert 1348: July 24, 1988:
1349: fixed egregious error in toupper/tolower functions.
1350: still subject to rescinding, however.
1.6 kstailey 1351:
1.7 millert 1352: July 2, 1988:
1353: flush stdout before opening file or pipe
1.6 kstailey 1354:
1.7 millert 1355: July 2, 1988:
1356: performance bug in b.c/cgoto(): not freeing some sets of states.
1357: partial fix only right now, and the number of states increased
1358: to make it less obvious.
1.6 kstailey 1359:
1.7 millert 1360: June 1, 1988:
1361: check error status on close
1.6 kstailey 1362:
1.7 millert 1363: May 28, 1988:
1364: srand returns seed value it's using.
1365: see 1/18/90
1.6 kstailey 1366:
1.7 millert 1367: May 22, 1988:
1368: Removed limit on depth of function calls.
1.6 kstailey 1369:
1.7 millert 1370: May 10, 1988:
1371: Fixed lib.c to permit _ in commandline variable names.
1.6 kstailey 1372:
1.7 millert 1373: Mar 25, 1988:
1374: main.c fixed to recognize -- as terminator of command-
1375: line options. Illegal options flagged.
1376: Error reporting slightly cleaned up.
1.6 kstailey 1377:
1.7 millert 1378: Dec 2, 1987:
1379: Newer C compilers apply a strict scope rule to extern
1380: declarations within functions. Two extern declarations in
1381: lib.c and tran.c have been moved to obviate this problem.
1.6 kstailey 1382:
1.7 millert 1383: Oct xx, 1987:
1384: Reluctantly added toupper and tolower functions.
1385: Subject to rescinding without notice.
1.6 kstailey 1386:
1.7 millert 1387: Sep 17, 1987:
1388: Error-message printer had printf(s) instead of
1389: printf("%s",s); got core dumps when the message
1390: included a %.
1.6 kstailey 1391:
1.7 millert 1392: Sep 12, 1987:
1393: Very long printf strings caused core dump;
1394: fixed aprintf, asprintf, format to catch them.
1395: Can still get a core dump in printf itself.
1.6 kstailey 1396:
1397: