Annotation of src/usr.bin/awk/FIXES, Revision 1.41
1.41 ! millert 1: /* $OpenBSD: FIXES,v 1.40 2020/12/18 21:36:24 millert Exp $ */
1.1 tholo 2: /****************************************************************
1.6 kstailey 3: Copyright (C) Lucent Technologies 1997
1.1 tholo 4: All Rights Reserved
5:
6: Permission to use, copy, modify, and distribute this software and
7: its documentation for any purpose and without fee is hereby
8: granted, provided that the above copyright notice appear in all
9: copies and that both that the copyright notice and this
10: permission notice and warranty disclaimer appear in supporting
1.6 kstailey 11: documentation, and that the name Lucent Technologies or any of
12: its entities not be used in advertising or publicity pertaining
13: to distribution of the software without specific, written prior
14: permission.
15:
16: LUCENT DISCLAIMS ALL WARRANTIES WITH REGARD TO THIS SOFTWARE,
17: INCLUDING ALL IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS.
18: IN NO EVENT SHALL LUCENT OR ANY OF ITS ENTITIES BE LIABLE FOR ANY
19: SPECIAL, INDIRECT OR CONSEQUENTIAL DAMAGES OR ANY DAMAGES
20: WHATSOEVER RESULTING FROM LOSS OF USE, DATA OR PROFITS, WHETHER
21: IN AN ACTION OF CONTRACT, NEGLIGENCE OR OTHER TORTIOUS ACTION,
22: ARISING OUT OF OR IN CONNECTION WITH THE USE OR PERFORMANCE OF
23: THIS SOFTWARE.
1.1 tholo 24: ****************************************************************/
25:
26: This file lists all bug fixes, changes, etc., made since the AWK book
27: was sent to the printers in August, 1987.
1.41 ! millert 28:
! 29: Oct 12, 2021:
! 30: The fix for #83 changed the code to insert 2 chars, but the
! 31: call to adjbuf just above it only allows for 1 char. This can
! 32: cause a heap buffer overflow.
! 33:
! 34: July 27, 2021:
! 35: As per IEEE Std 1003.1-2008, -F "str" is now consistent with
! 36: -v FS="str" when str is null. Thanks to Warner Losh.
! 37:
! 38: July 24, 2021:
! 39: Fix readrec's definition of a record. This fixes an issue
! 40: with NetBSD's RS regular expression support that can cause
! 41: an infinite read loop. Thanks to Miguel Pineiro Jr.
! 42:
! 43: Fix regular expression RS ^-anchoring. RS ^-anchoring needs to
! 44: know if it is reading the first record of a file. This change
! 45: restores a missing line that was overlooked when porting NetBSD's
! 46: RS regex functionality. Thanks to Miguel Pineiro Jr.
! 47:
! 48: Fix size computation in replace_repeat() for special case
! 49: REPEAT_WITH_Q. Thanks to Todd C. Miller.
! 50:
! 51: February 15, 2021:
! 52: Small fix so that awk will compile again with g++. Thanks to
! 53: Arnold Robbins.
! 54:
! 55: January 06, 2021:
! 56: Fix a decision bug with trailing stuff in lib.c:is_valid_number
! 57: after recent changes. Thanks to Ozan Yigit.
1.40 millert 58:
59: December 18, 2020:
60: Fix problems converting inf and NaN values in lib.c:is_valid_number.
61: Enhance number to string conversion to do the right thing for
62: NaN and inf values. Things are now pretty much the same as in
63: gawk. (Found a gawk bug while we're at it.) Added a torture
64: test for these values. Thanks to Arnold Robbins. Allows closing
65: of PR #101.
66:
67: December 15, 2020:
68: Merge PR #99, which gets the right header for strcasecmp.
69: Thanks to GitHub user michaelforney.
1.39 millert 70:
71: December 8, 2020:
72: Merge PR #98: Disallow hex data. Allow only +nan, -nan,
73: +inf, -inf (case independent) to give NaN and infinity values.
74: Improve things so that string to double conversion is only
75: done once, yielding something of a speedup. This obviate
76: PR #95. Thanks to Arnold Robbins.
77:
78: December 3, 2020:
79: Fix to argument parsing to avoid printing spurious newlines.
80: Thanks to Todd Miller. Merges PR #97.
81:
82: October 13, 2020:
83: Add casts before all the calls to malloc/calloc/realloc in order
84: to get it to compile with g++. Thanks to Arnold Robbins.
85:
86: August 16, 2020:
87: Additional fixes for DJGPP. Thanks to Eli Zaretskii for
88: the testing.
1.38 millert 89:
90: August 7, 2020:
91: Merge PR #93, which adds casts to (void*) for debug prints
92: using the %p format specifier. Thanks to GitHub user YongHaoWu
93: ("Chris") for the fixes.
94:
95: August 4, 2020:
96: In run.c, use non-restartable multibyte routines to attain
97: portability to DJGPP. Should fix Issue 92. Thanks to Albert Wik
98: for the report and to Todd Miller for the suggested fix.
1.37 millert 99:
100: July 30, 2020:
101: Merge PRs 88-91 which fix small bugs. Thanks to Todd Miller and
102: Tim van der Molen for the fixes.
103:
104: In order to make life easier, we move exclusively to bison
105: as the parser generator.
1.36 millert 106:
107: July 2, 2020:
108: Merge PRs 85 and 86 which fix regressions. Thanks to
109: Tim van der Molen for the fixes.
1.35 millert 110:
111: June 25, 2020:
112: Merge PRs 82 and 84. The latter fixes issue #83. Thanks to
113: Todd Miller and awkfan77.
1.34 millert 114:
115: June 12, 2020:
116: Clear errno before calling errcheck to avoid any spurious errors
117: left over from previous calls that may have set it. Thanks to
118: Todd Miller for the fix, from PR #80.
119:
120: Fix Issue #78 by allowing \r to follow floating point numbers in
121: lib.c:is_number. Thanks to GitHub user ajcarr for the report
122: and to Arnold Robbins for the fix.
1.33 millert 123:
124: June 5, 2020:
125: In fldbld(), make sure that inputFS is set before trying to
126: use it. Thanks to Steffen Nurpmeso <steffen@sdaoden.eu>
127: for the report.
128:
129: May 5, 2020:
130: Fix checks for compilers that can handle noreturn. Thanks to
131: GitHub user enh-google for pointing it out. Closes Issue #79.
132:
133: April 16, 2020:
134: Handle old compilers that don't support C11 (for noreturn).
135: Thanks to Arnold Robbins.
136:
137: April 5, 2020:
138: Use <stdnoreturn.h> and noreturn instead of GCC attributes.
139: Thanks to GitHub user awkfan77. Closes PR #77.
1.30 millert 140:
1.32 millert 141: February 28, 2020:
142: More cleanups from Christos Zoulas: notably backslash continuation
143: inside strings removes the newline and a fix for RS = "^a".
144: Fix for address sanitizer-found problem. Thanks to GitHub user
145: enh-google.
146:
147: February 19, 2020:
148: More small cleanups from Christos Zoulas.
149:
150: February 18, 2020:
151: Additional cleanups from Christos Zoulas. It's no longer necessary
152: to use the -y flag to bison.
153:
154: February 6, 2020:
155: Additional small cleanups from Christos Zoulas. awk is now
156: a little more robust about reporting I/O errors upon exit.
157:
1.31 millert 158: January 31, 2020:
159: Merge PR #70, which avoids use of variable length arrays. Thanks
160: to GitHub user michaelforney. Fix issue #60 ({0} in interval
1.32 millert 161: expressions doesn't work). Also get all tests working again.
162: Thanks to Arnold Robbins.
1.31 millert 163:
164: January 24, 2020:
165: A number of small cleanups from Christos Zoulas. Add the close
166: on exec flag to files/pipes opened for redirection; courtesy of
167: Arnold Robbins.
168:
169: January 19, 2020:
170: If POSIXLY_CORRECT is set in the environment, then sub and gsub
171: use POSIX rules for multiple backslashes. This fixes Issue #66,
172: while maintaining backwards compatibility.
173:
174: January 9, 2020:
175: Input/output errors on closing files are now fatal instead of
176: mere warnings. Thanks to Martijn Dekker <martijn@inlv.org>.
177:
1.30 millert 178: January 5, 2020:
179: Fix a bug in the concatentation of two string constants into
180: one done in the grammar. Fixes GitHub issue #61. Thanks
181: to GitHub user awkfan77 for pointing out the direction for
182: the fix. New test T.concat added to the test suite.
183: Fix a few memory leaks reported by valgrind, as well.
184:
185: December 27, 2019:
186: Fix a bug whereby a{0,3} could match four a's. Thanks to
187: "Anonymous AWK fan" for the report.
188:
189: December 11, 2019:
190: Further printf-related fixes for 32 bit systems.
191: Thanks again to Christos Zoulas.
192:
193: December 8, 2019:
194: Fix the return value of sprintf("%d") on 32 bit systems.
195: Thanks to Jim Lowe for the report and to Christos Zoulas
196: for the fix.
1.29 millert 197:
198: November 10, 2019:
199: Convert a number of Boolean integer variables into
200: actual bools. Convert compile_time variable into an
201: enum and simplify some of the related code. Thanks
202: to Arnold Robbins.
203:
204: November 8, 2019:
205: Fix from Ori Bernstein to get UTF-8 characters instead of
206: bytes when FS = "". This is currently the only bit of
207: the One True Awk that understands multibyte characters.
208: From Arnold Robbins, apply some cleanups in the test suite.
1.28 millert 209:
210: October 25, 2019:
211: More fixes and cleanups from NetBSD, courtesy of Christos
212: Zoulas. Merges PRs 54 and 55.
213:
214: October 24, 2019:
215: Import second round of code cleanups from NetBSD. Much thanks
1.31 millert 216: to Christos Zoulas (GitHub user zoulasc). Merges PR 53.
1.28 millert 217: Add an optimization for string concatenation, also from
218: Christos.
1.27 millert 219:
220: October 17, 2019:
221: Import code cleanups from NetBSD. Much thanks to Christos
1.31 millert 222: Zoulas (GitHub user zoulasc). Merges PR 51.
1.26 millert 223:
224: October 6, 2019:
225: Import code from NetBSD awk that implements RS as a regular
226: expression.
1.23 millert 227:
1.25 millert 228: September 10, 2019:
229: Fixes for various array / memory overruns found via gcc's
1.31 millert 230: -fsanitize=unknown. Thanks to Alexander Richardson (GitHub
1.25 millert 231: user arichardson). Merges PRs 47 and 48.
232:
233: July 28, 2019:
234: Import grammar optimization from NetBSD: Two string constants
235: concatenated together get turned into a single string.
236:
237: July 26, 2019:
238: Support POSIX-specified C-style escape sequences "\a" (alarm)
239: and "\v" (vertical tab) in command line arguments and regular
240: expressions, further to the support for them in strings added on
241: Apr 9, 1989. These now no longer match as literal "a" and "v"
242: characters (as they don't on other awk implementations).
243: Thanks to Martijn Dekker.
244:
245: July 17, 2019:
246: Pull in a number of code cleanups and minor fixes from
247: Warner Losh's bsd-ota branch. The only user visible change
248: is the use of random(3) as the random number generator.
249: Thanks to Warner Losh for collecting all these fixes in
250: one easy place to get them from.
251:
252: July 16, 2019:
253: Fix field splitting to use FS value as of the time a record
254: was read or assigned to. Thanks to GitHub user Cody Mello (melloc)
255: for the fix. (Merged from his branch, via PR #42.) Updated
256: testdir/T.split per said PR as well.
257:
258: June 24, 2019:
259: Extract awktest.tar into testdir directory. Add some very
260: simple mechanics to the makefile for running the tests and
261: for cleaning up. No changes to awk itself.
262:
1.24 millert 263: June 17, 2019:
264: Disallow deleting SYMTAB and its elements, which creates
265: use-after-free bugs. Thanks to GitHub user Cody Mello (melloc)
266: for the fix. (Merged from PR #43.)
267:
268: June 5, 2019:
269: Allow unmatched right parenthesis in a regular expression to
270: be treated literally. Fixes Issue #40. Thanks to GitHub user
271: Warner Losh (bsdimp) for the report. Thanks to Arnold Robbins
272: for the fix.
273:
274: May 29,2019:
275: Fix check for command line arguments to no longer require that
276: first character after '=' not be another '='. Reverts change of
277: August 11, 1989. Thanks to GitHub user Jamie Landeg Jones for
278: pointing out the issue; from Issue #38.
279:
280: Apr 7, 2019:
281: Update awktest.tar(p.50) to use modern options to sort. Needed
282: for Android development. Thanks to GitHub user mohd-akram (Mohamed
283: Akram). From Issue #33.
284:
285: Mar 12, 2019:
286: Added very simplistic support for cross-compiling in the
287: makefile. We are NOT going to go in the direction of the
288: autotools, though. Thanks to GitHub user nee-san for
289: the basic change. (Merged from PR #34.)
290:
1.23 millert 291: Mar 5, 2019:
292: Added support for POSIX-standard interval expressions (a.k.a.
293: bounds, a.k.a. repetition expressions) in regular expressions,
294: backported (via NetBSD) from Apple awk-24 (20070501).
295: Thanks to Martijn Dekker <martijn@inlv.org> for the port.
296: (Merged from PR #30.)
297:
298: Mar 3, 2019:
299: Merge PRs as follows:
300: #12: Avoid undefined behaviour when using ctype(3) functions in
301: relex(). Thanks to GitHub user iamleot.
302: #31: Make getline handle numeric strings, and update FIXES. Thanks
1.24 millert 303: to GitHub user arnoldrobbins.
1.23 millert 304: #32: maketab: support build systems with read-only source. Thanks
305: to GitHub user enh.
1.22 millert 306:
307: Jan 25, 2019:
308: Make getline handle numeric strings properly in all cases.
309: (Thanks, Arnold.)
310:
311: Jan 21, 2019:
312: Merged a number of small fixes from GitHub pull requests.
313: Thanks to GitHub users Arnold Robbins (arnoldrobbins),
314: Cody Mello (melloc) and Christoph Junghans (junghans).
315: PR numbers: 13-21, 23, 24, 27.
1.21 millert 316:
317: Oct 25, 2018:
318: Added test in maketab.c to prevent generating a proctab entry
319: for YYSTYPE_IS_DEFINED. It was harmless but some gcc settings
320: generated a warning message. Thanks to Nan Xiao for report.
1.20 millert 321:
322: Aug 27, 2018:
323: Disallow '$' in printf formats; arguments evaluated in order
324: and printed in order.
325:
326: Added some casts to silence warnings on debugging printfs.
327: (Thanks, Arnold.)
1.18 millert 328:
1.19 millert 329: Aug 23, 2018:
330: A long list of fixes courtesy of Arnold Robbins,
331: to whom profound thanks.
332:
333: 1. ofs-rebuild: OFS value used to rebuild the record was incorrect.
334: Fixed August 19, 2014. Revised fix August 2018.
335:
336: 2. system-status: Instead of a floating-point division by 256, use
337: the wait(2) macros to create a reasonable exit status.
338: Fixed March 12, 2016.
339:
340: 3. space: Use provided xisblank() function instead of ispace() for
341: matching [[:blank:]].
342:
343: 4. a-format: Add POSIX standard %a and %A to supported formats. Check
344: at runtime that this format is available.
345:
346: 5. decr-NF: Decrementing NF did not change $0. This is a decades-old
347: bug. There are interactions with the old and new value of OFS as well.
348: Most of the fix came from the NetBSD awk.
349:
350: 6. string-conv: String conversions of scalars were sticky. Once a
351: conversion to string happened, even with OFMT, that value was used until
352: a new numeric value was assigned, even if OFMT differed from CONVFMT,
353: and also if CONVFMT changed.
354:
355: 7. unary-plus: Unary plus on a string constant returned the string.
356: Instead, it should convert the value to numeric and give that value.
357:
358: Also added Arnold's tests for these to awktest.tar as T.arnold.
359:
360: Aug 15, 2018:
361: fixed mangled awktest.tar (thanks, Arnold), posted all
362: current (very minor) fixes to github / onetrueawk
363:
1.18 millert 364: Jun 7, 2018:
365: (yes, a long layoff)
366: Updated some broken tests (beebe.tar, T.lilly)
367: [thanks to Arnold Robbins]
368:
369: Mar 26, 2015:
370: buffer overflow in error reporting; thanks to tobias ulmer
371: and john-mark gurney for spotting it and the fix.
372:
373: Feb 4, 2013:
374: cleaned up a handful of tests that didn't seem to actually
375: test for correct behavior: T.latin1, T.gawk.
376:
377: Jan 5, 2013:
378: added ,NULL initializer to static Cells in run.c; not really
379: needed but cleaner. Thanks to Michael Bombardieri.
1.17 millert 380:
381: Dec 20, 2012:
382: fiddled makefile to get correct yacc and bison flags. pick yacc
383: (linux) or bison (mac) as necessary.
384:
385: added __attribute__((__noreturn__)) to a couple of lines in
386: proto.h, to silence someone's enthusiastic checker.
387:
388: fixed obscure call by value bug in split(a[1],a) reported on
389: 9fans. the management of temporary values is just a mess; i
390: took a shortcut by making an extra string copy. thanks
391: to paul patience and arnold robbins for passing it on and for
392: proposed patches.
393:
394: tiny fiddle in setfval to eliminate -0 results in T.expr, which
395: has irritated me for 20+ years.
1.16 millert 396:
397: Aug 10, 2011:
398: another fix to avoid core dump with delete(ARGV); again, many thanks
399: to ruslan ermilov.
400:
401: Aug 7, 2011:
402: split(s, a, //) now behaves the same as split(s, a, "")
403:
404: Jun 12, 2011:
405: /pat/, \n /pat/ {...} is now legal, though bad style to use.
406:
407: added checks to new -v code that permits -vnospace; thanks to
1.25 millert 408: ruslan ermilov for spotting this and providing the patch.
1.16 millert 409:
410: removed fixed limit on number of open files; thanks to aleksey
1.25 millert 411: cheusov and christos zoulos.
1.16 millert 412:
413: fixed day 1 bug that resurrected deleted elements of ARGV when
414: used as filenames (in lib.c).
415:
416: minor type fiddles to make gcc -Wall -pedantic happier (but not
417: totally so); turned on -fno-strict-aliasing in makefile.
418:
419: May 6, 2011:
420: added #ifdef for isblank.
421: now allows -ffoo as well as -f foo arguments.
422: (thanks, ruslan)
423:
424: May 1, 2011:
425: after advice from todd miller, kevin lo, ruslan ermilov,
426: and arnold robbins, changed srand() to return the previous
427: seed (which is 1 on the first call of srand). the seed is
428: an Awkfloat internally though converted to unsigned int to
1.25 millert 429: pass to the library srand(). thanks, everyone.
1.16 millert 430:
431: fixed a subtle (and i hope low-probability) overflow error
1.25 millert 432: in fldbld, by adding space for one extra \0. thanks to
1.16 millert 433: robert bassett for spotting this one and providing a fix.
434:
435: removed the files related to compilation on windows. i no
436: longer have anything like a current windows environment, so
437: i can't test any of it.
1.15 millert 438:
439: May 23, 2010:
440: fixed long-standing overflow bug in run.c; many thanks to
441: nelson beebe for spotting it and providing the fix.
442:
443: fixed bug that didn't parse -vd=1 properly; thanks to santiago
444: vila for spotting it.
445:
446: Feb 8, 2010:
447: i give up. replaced isblank with isspace in b.c; there are
448: no consistent header files.
449:
450: Nov 26, 2009:
451: fixed a long-standing issue with when FS takes effect. a
452: change to FS is now noticed immediately for subsequent splits.
453:
454: changed the name getline() to awkgetline() to avoid yet another
455: name conflict somewhere.
456:
457: Feb 11, 2009:
458: temporarily for now defined HAS_ISBLANK, since that seems to
459: be the best way through the thicket. isblank arrived in C99,
460: but seems to be arriving at different systems at different
461: times.
462:
463: Oct 8, 2008:
464: fixed typo in b.c that set tmpvec wrongly. no one had ever
465: run into the problem, apparently. thanks to alistair crooks.
1.14 millert 466:
467: Oct 23, 2007:
468: minor fix in lib.c: increase inputFS to 100, change malloc
1.25 millert 469: for fields to n+1.
1.14 millert 470:
471: fixed memory fault caused by out of order test in setsval.
472:
473: thanks to david o'brien, freebsd, for both fixes.
474:
475: May 1, 2007:
476: fiddle in makefile to fix for BSD make; thanks to igor sobrado.
477:
478: Mar 31, 2007:
479: fixed some null pointer refs calling adjbuf.
480:
481: Feb 21, 2007:
482: fixed a bug in matching the null RE in sub and gsub. thanks to al aho
483: who actually did the fix (in b.c), and to wolfgang seeberg for finding
484: it and providing a very compact test case.
485:
486: fixed quotation in b.c; thanks to Hal Pratt and the Princeton Dante
487: Project.
488:
489: removed some no-effect asserts in run.c.
490:
491: fiddled maketab.c to not complain about bison-generated values.
492:
493: removed the obsolete -V argument; fixed --version to print the
494: version and exit.
495:
496: fixed wording and an outright error in the usage message; thanks to igor
497: sobrado and jason mcintyre.
498:
499: fixed a bug in -d that caused core dump if no program followed.
500:
501: Jan 1, 2007:
502: dropped mac.code from makefile; there are few non-MacOSX
503: mac's these days.
504:
505: Jan 17, 2006:
506: system() not flagged as unsafe in the unadvertised -safe option.
507: found it while enhancing tests before shipping the ;login: article.
508: practice what you preach.
509:
510: removed the 9-years-obsolete -mr and -mf flags.
511:
512: added -version and --version options.
513:
514: core dump on linux with BEGIN {nextfile}, now fixed.
515:
1.25 millert 516: removed some #ifdef's in run.c and lex.c that appear to no
1.14 millert 517: longer be necessary.
518:
519: Apr 24, 2005:
520: modified lib.c so that values of $0 et al are preserved in the END
521: block, apparently as required by posix. thanks to havard eidnes
522: for the report and code.
523:
524: Jan 14, 2005:
525: fixed infinite loop in parsing, originally found by brian tsang.
526: thanks to arnold robbins for a suggestion that started me
527: rethinking it.
528:
529: Dec 31, 2004:
1.25 millert 530: prevent overflow of -f array in main, head off potential error in
531: call of SYNTAX(), test malloc return in lib.c, all with thanks to
1.14 millert 532: todd miller.
1.13 millert 533:
534: Dec 22, 2004:
535: cranked up size of NCHARS; coverity thinks it can be overrun with
536: smaller size, and i think that's right. added some assertions to b.c
537: to catch places where it might overrun. the RE code is still fragile.
538:
539: Dec 5, 2004:
540: fixed a couple of overflow problems with ridiculous field numbers:
541: e.g., print $(2^32-1). thanks to ruslan ermilov, giorgos keramidas
542: and david o'brien at freebsd.org for patches. this really should
543: be re-done from scratch.
544:
545: Nov 21, 2004:
546: fixed another 25-year-old RE bug, in split. it's another failure
547: to (re-)initialize. thanks to steve fisher for spotting this and
548: providing a good test case.
549:
550: Nov 22, 2003:
551: fixed a bug in regular expressions that dates (so help me) from 1977;
552: it's been there from the beginning. an anchored longest match that
553: was longer than the number of states triggered a failure to initialize
554: the machine properly. many thanks to moinak ghosh for not only finding
555: this one but for providing a fix, in some of the most mysterious
556: code known to man.
557:
558: fixed a storage leak in call() that appears to have been there since
1.25 millert 559: 1983 or so -- a function without an explicit return that assigns a
560: string to a parameter leaked a Cell. thanks to moinak ghosh for
1.13 millert 561: spotting this very subtle one.
562:
563: Jul 31, 2003:
564: fixed, thanks to andrey chernov and ruslan ermilov, a bug in lex.c
565: that mis-handled the character 255 in input. (it was being compared
566: to EOF with a signed comparison.)
567:
568: Jul 29, 2003:
569: fixed (i think) the long-standing botch that included the beginning of
570: line state ^ for RE's in the set of valid characters; this led to a
571: variety of odd problems, including failure to properly match certain
572: regular expressions in non-US locales. thanks to ruslan for keeping
573: at this one.
574:
575: Jul 28, 2003:
576: n-th try at getting internationalization right, with thanks to volker
577: kiefel, arnold robbins and ruslan ermilov for advice, though they
578: should not be blamed for the outcome. according to posix, "." is the
579: radix character in programs and command line arguments regardless of
580: the locale; otherwise, the locale should prevail for input and output
581: of numbers. so it's intended to work that way.
1.25 millert 582:
1.13 millert 583: i have rescinded the attempt to use strcoll in expanding shorthands in
584: regular expressions (cclenter). its properties are much too
585: surprising; for example [a-c] matches aAbBc in locale en_US but abBcC
586: in locale fr_CA. i can see how this might arise by implementation
587: but i cannot explain it to a human user. (this behavior can be seen
588: in gawk as well; we're leaning on the same library.)
589:
590: the issue appears to be that strcoll is meant for sorting, where
591: merging upper and lower case may make sense (though note that unix
592: sort does not do this by default either). it is not appropriate
593: for regular expressions, where the goal is to match specific
594: patterns of characters. in any case, the notations [:lower:], etc.,
595: are available in awk, and they are more likely to work correctly in
596: most locales.
597:
598: a moratorium is hereby declared on internationalization changes.
599: i apologize to friends and colleagues in other parts of the world.
600: i would truly like to get this "right", but i don't know what
601: that is, and i do not want to keep making changes until it's clear.
602:
603: Jul 4, 2003:
604: fixed bug that permitted non-terminated RE, as in "awk /x".
605:
606: Jun 1, 2003:
607: subtle change to split: if source is empty, number of elems
608: is always 0 and the array is not set.
609:
610: Mar 21, 2003:
611: added some parens to isblank, in another attempt to make things
612: internationally portable.
613:
614: Mar 14, 2003:
615: the internationalization changes, somewhat modified, are now
616: reinstated. in theory awk will now do character comparisons
617: and case conversions in national language, but "." will always
618: be the decimal point separator on input and output regardless
619: of national language. isblank(){} has an #ifndef.
620:
621: this no longer compiles on windows: LC_MESSAGES isn't defined
622: in vc6++.
623:
624: fixed subtle behavior in field and record splitting: if FS is
625: a single character and RS is not empty, \n is NOT a separator.
626: this tortuous reading is found in the awk book; behavior now
627: matches gawk and mawk.
1.11 millert 628:
629: Dec 13, 2002:
630: for the moment, the internationalization changes of nov 29 are
631: rolled back -- programs like x = 1.2 don't work in some locales,
632: because the parser is expecting x = 1,2. until i understand this
633: better, this will have to wait.
634:
635: Nov 29, 2002:
636: modified b.c (with tiny changes in main and run) to support
637: locales, using strcoll and iswhatever tests for posix character
638: classes. thanks to ruslan ermilov (ru@freebsd.org) for code.
639: the function isblank doesn't seem to have propagated to any
640: header file near me, so it's there explicitly. not properly
641: tested on non-ascii character sets by me.
642:
643: Jun 28, 2002:
644: modified run/format() and tran/getsval() to do a slightly better
645: job on using OFMT for output from print and CONVFMT for other
1.25 millert 646: number->string conversions, as promised by posix and done by
1.11 millert 647: gawk and mawk. there are still places where it doesn't work
648: right if CONVFMT is changed; by then the STR attribute of the
649: variable has been irrevocably set. thanks to arnold robbins for
650: code and examples.
651:
652: fixed subtle bug in format that could get core dump. thanks to
653: Jaromir Dolecek <jdolecek@NetBSD.org> for finding and fixing.
654: minor cleanup in run.c / format() at the same time.
655:
656: added some tests for null pointers to debugging printf's, which
657: were never intended for external consumption. thanks to dave
658: kerns (dkerns@lucent.com) for pointing this out.
659:
660: GNU compatibility: an empty regexp matches anything (thanks to
661: dag-erling smorgrav, des@ofug.org). subject to reversion if
662: this does more harm than good.
663:
664: pervasive small changes to make things more const-correct, as
665: reported by gcc's -Wwrite-strings. as it says in the gcc manual,
666: this may be more nuisance than useful. provoked by a suggestion
667: and code from arnaud desitter, arnaud@nimbus.geog.ox.ac.uk
668:
669: minor documentation changes to note that this now compiles out
670: of the box on Mac OS X.
671:
672: Feb 10, 2002:
673: changed types in posix chars structure to quiet solaris cc.
674:
675: Jan 1, 2002:
676: fflush() or fflush("") flushes all files and pipes.
677:
1.25 millert 678: length(arrayname) returns number of elements; thanks to
1.11 millert 679: arnold robbins for suggestion.
680:
681: added a makefile.win to make it easier to build on windows.
682: based on dan allen's buildwin.bat.
683:
684: Nov 16, 2001:
685: added support for posix character class names like [:digit:],
686: which are not exactly shorter than [0-9] and perhaps no more
687: portable. thanks to dag-erling smorgrav for code.
688:
689: Feb 16, 2001:
690: removed -m option; no longer needed, and it was actually
691: broken (noted thanks to volker kiefel).
692:
693: Feb 10, 2001:
694: fixed an appalling bug in gettok: any sequence of digits, +,-, E, e,
695: and period was accepted as a valid number if it started with a period.
696: this would never have happened with the lex version.
697:
698: other 1-character botches, now fixed, include a bare $ and a
699: bare " at the end of the input.
700:
701: Feb 7, 2001:
702: more (const char *) casts in b.c and tran.c to silence warnings.
1.8 millert 703:
1.10 millert 704: Nov 15, 2000:
705: fixed a bug introduced in august 1997 that caused expressions
706: like $f[1] to be syntax errors. thanks to arnold robbins for
707: noticing this and providing a fix.
708:
709: Oct 30, 2000:
710: fixed some nextfile bugs: not handling all cases. thanks to
711: arnold robbins for pointing this out. new regressions added.
712:
713: close() is now a function. it returns whatever the library
714: fclose returns, and -1 for closing a file or pipe that wasn't
715: opened.
716:
717: Sep 24, 2000:
718: permit \n explicitly in character classes; won't work right
719: if comes in as "[\n]" but ok as /[\n]/, because of multiple
720: processing of \'s. thanks to arnold robbins.
721:
722: July 5, 2000:
723: minor fiddles in tran.c to keep compilers happy about uschar.
724: thanks to norman wilson.
725:
726: May 25, 2000:
727: yet another attempt at making 8-bit input work, with another
1.25 millert 728: band-aid in b.c (member()), and some (uschar) casts to head
1.10 millert 729: off potential errors in subscripts (like isdigit). also
730: changed HAT to NCHARS-2. thanks again to santiago vila.
731:
732: changed maketab.c to ignore apparently out of range definitions
733: instead of halting; new freeBSD generates one. thanks to
734: jon snader <jsnader@ix.netcom.com> for pointing out the problem.
735:
736: May 2, 2000:
737: fixed an 8-bit problem in b.c by making several char*'s into
738: unsigned char*'s. not clear i have them all yet. thanks to
739: Santiago Vila <sanvila@unex.es> for the bug report.
740:
741: Apr 21, 2000:
742: finally found and fixed a memory leak in function call; it's
743: been there since functions were added ~1983. thanks to
744: jon bentley for the test case that found it.
745:
746: added test in envinit to catch environment "variables" with
1.12 otto 747: names beginning with '='; thanks to Berend Hasselman.
1.10 millert 748:
749: Jul 28, 1999:
750: added test in defn() to catch function foo(foo), which
751: otherwise recurses until core dump. thanks to arnold
752: robbins for noticing this.
753:
1.9 millert 754: Jun 20, 1999:
755: added *bp in gettok in lex.c; appears possible to exit function
756: without terminating the string. thanks to russ cox.
757:
758: Jun 2, 1999:
759: added function stdinit() to run to initialize files[] array,
760: in case stdin, etc., are not constants; some compilers care.
761:
762: May 10, 1999:
763: replaced the ERROR ... FATAL, etc., macros with functions
764: based on vprintf, to avoid problems caused by overrunning
765: fixed-size errbuf array. thanks to ralph corderoy for the
766: impetus, and for pointing out a string termination bug in
767: qstring as well.
768:
769: Apr 21, 1999:
770: fixed bug that caused occasional core dumps with commandline
771: variable with value ending in \. (thanks to nelson beebe for
772: the test case.)
773:
1.8 millert 774: Apr 16, 1999:
1.25 millert 775: with code kindly provided by Bruce Lilly, awk now parses
1.8 millert 776: /=/ and similar constructs more sensibly in more places.
1.10 millert 777: Bruce also provided some helpful test cases.
1.8 millert 778:
779: Apr 5, 1999:
780: changed true/false to True/False in run.c to make it
781: easier to compile with C++. Added some casts on malloc
782: and realloc to be honest about casts; ditto. changed
783: ltype int to long in struct rrow to reduce some 64-bit
784: complaints; other changes scattered throughout for the
785: same purpose. thanks to Nelson Beebe for these portability
786: improvements.
787:
788: removed some horrible pointer-int casting in b.c and elsewhere
789: by adding ptoi and itonp to localize the casts, which are
790: all benign. fixed one incipient bug that showed up on sgi
791: in 64-bit mode.
792:
793: reset lineno for new source file; include filename in error
794: message. also fixed line number error in continuation lines.
795: (thanks to Nelson Beebe for both of these.)
796:
797: Mar 24, 1999:
798: Nelson Beebe notes that irix 5.3 yacc dies with a bogus
799: error; use a newer version or switch to bison, since sgi
800: is unlikely to fix it.
1.1 tholo 801:
1.7 millert 802: Mar 5, 1999:
1.9 millert 803: changed isnumber to is_number to avoid the problem caused by
804: versions of ctype.h that include the name isnumber.
1.7 millert 805:
806: distribution now includes a script for building on a Mac,
807: thanks to Dan Allen.
808:
809: Feb 20, 1999:
810: fixed memory leaks in run.c (call) and tran.c (setfval).
811: thanks to Stephen Nutt for finding these and providing the fixes.
812:
813: Jan 13, 1999:
814: replaced srand argument by (unsigned int) in run.c;
815: avoids problem on Mac and potentially on Unix & Windows.
816: thanks to Dan Allen.
817:
818: added a few (int) casts to silence useless compiler warnings.
819: e.g., errorflag= in run.c jump().
820:
821: added proctab.c to the bundle outout; one less thing
822: to have to compile out of the box.
823:
824: added calls to _popen and _pclose to the win95 stub for
825: pipes (thanks to Steve Adams for this helpful suggestion).
826: seems to work, though properties are not well understood
827: by me, and it appears that under some circumstances the
828: pipe output is truncated. Be careful.
829:
830: Oct 19, 1998:
831: fixed a couple of bugs in getrec: could fail to update $0
1.25 millert 832: after a getline var; because inputFS wasn't initialized,
1.7 millert 833: could split $0 on every character, a misleading diversion.
834:
835: fixed caching bug in makedfa: LRU was actually removing
836: least often used.
837:
838: thanks to ross ridge for finding these, and for providing
839: great bug reports.
840:
841: May 12, 1998:
842: fixed potential bug in readrec: might fail to update record
843: pointer after growing. thanks to dan levy for spotting this
844: and suggesting the fix.
845:
846: Mar 12, 1998:
847: added -V to print version number and die.
1.19 millert 848:
849: [notify dave kerns, dkerns@dacsoup.ih.lucent.com]
1.7 millert 850:
851: Feb 11, 1998:
852: subtle silent bug in lex.c: if the program ended with a number
853: longer than 1 digit, part of the input would be pushed back and
854: parsed again because token buffer wasn't terminated right.
855: example: awk 'length($0) > 10'. blush. at least i found it
856: myself.
857:
858: Aug 31, 1997:
859: s/adelete/awkdelete/: SGI uses this in malloc.h.
860: thanks to nelson beebe for pointing this one out.
861:
862: Aug 21, 1997:
863: fixed some bugs in sub and gsub when replacement includes \\.
864: this is a dark, horrible corner, but at least now i believe that
865: the behavior is the same as gawk and the intended posix standard.
866: thanks to arnold robbins for advice here.
867:
868: Aug 9, 1997:
869: somewhat regretfully, replaced the ancient lex-based lexical
870: analyzer with one written in C. it's longer, generates less code,
871: and more portable; the old one depended too much on mysterious
872: properties of lex that were not preserved in other environments.
873: in theory these recognize the same language.
874:
875: now using strtod to test whether a string is a number, instead of
876: the convoluted original function. should be more portable and
877: reliable if strtod is implemented right.
878:
879: removed now-pointless optimization in makefile that tries to avoid
880: recompilation when awkgram.y is changed but symbols are not.
881:
882: removed most fixed-size arrays, though a handful remain, some
883: of which are unchecked. you have been warned.
884:
885: Aug 4, 1997:
886: with some trepidation, replaced the ancient code that managed
887: fields and $0 in fixed-size arrays with arrays that grow on
888: demand. there is still some tension between trying to make this
889: run fast and making it clean; not sure it's right yet.
890:
891: the ill-conceived -mr and -mf arguments are now useful only
892: for debugging. previous dynamic string code removed.
893:
894: numerous other minor cleanups along the way.
1.1 tholo 895:
1.7 millert 896: Jul 30, 1997:
897: using code provided by dan levy (to whom profuse thanks), replaced
898: fixed-size arrays and awkward kludges by a fairly uniform mechanism
899: to grow arrays as needed for printf, sub, gsub, etc.
1.1 tholo 900:
1.7 millert 901: Jul 23, 1997:
902: falling off the end of a function returns "" and 0, not 0.
903: thanks to arnold robbins.
1.1 tholo 904:
1.7 millert 905: Jun 17, 1997:
906: replaced several fixed-size arrays by dynamically-created ones
907: in run.c; added overflow tests to some previously unchecked cases.
908: getline, toupper, tolower.
1.1 tholo 909:
1.7 millert 910: getline code is still broken in that recursive calls may wind
911: up using the same space. [fixed later]
1.1 tholo 912:
1.7 millert 913: increased RECSIZE to 8192 to push problems further over the horizon.
1.1 tholo 914:
1.7 millert 915: added \r to \n as input line separator for programs, not data.
916: damn CRLFs.
1.1 tholo 917:
1.7 millert 918: modified format() to permit explicit printf("%c", 0) to include
919: a null byte in output. thanks to ken stailey for the fix.
1.1 tholo 920:
1.7 millert 921: added a "-safe" argument that disables file output (print >,
922: print >>), process creation (cmd|getline, print |, system), and
923: access to the environment (ENVIRON). this is a first approximation
924: to a "safe" version of awk, but don't rely on it too much. thanks
925: to joan feigenbaum and matt blaze for the inspiration long ago.
1.1 tholo 926:
1.7 millert 927: Jul 8, 1996:
928: fixed long-standing bug in sub, gsub(/a/, "\\\\&"); thanks to
929: ralph corderoy.
1.1 tholo 930:
1.7 millert 931: Jun 29, 1996:
932: fixed awful bug in new field splitting; didn't get all the places
933: where input was done.
1.1 tholo 934:
1.7 millert 935: Jun 28, 1996:
936: changed field-splitting to conform to posix definition: fields are
937: split using the value of FS at the time of input; it used to be
938: the value when the field or NF was first referred to, a much less
939: predictable definition. thanks to arnold robbins for encouragement
940: to do the right thing.
1.1 tholo 941:
1.7 millert 942: May 28, 1996:
943: fixed appalling but apparently unimportant bug in parsing octal
944: numbers in reg exprs.
1.1 tholo 945:
1.7 millert 946: explicit hex in reg exprs now limited to 2 chars: \xa, \xaa.
1.1 tholo 947:
1.7 millert 948: May 27, 1996:
949: cleaned up some declarations so gcc -Wall is now almost silent.
1.1 tholo 950:
1.7 millert 951: makefile now includes backup copies of ytab.c and lexyy.c in case
952: one makes before looking; it also avoids recreating lexyy.c unless
953: really needed.
1.1 tholo 954:
1.7 millert 955: s/aprintf/awkprint, s/asprintf/awksprintf/ to avoid some name clashes
956: with unwisely-written header files.
1.1 tholo 957:
1.7 millert 958: thanks to jeffrey friedl for several of these.
1.1 tholo 959:
1.7 millert 960: May 26, 1996:
961: an attempt to rationalize the (unsigned) char issue. almost all
962: instances of unsigned char have been removed; the handful of places
963: in b.c where chars are used as table indices have been hand-crafted.
964: added some latin-1 tests to the regression, but i'm not confident;
965: none of my compilers seem to care much. thanks to nelson beebe for
966: pointing out some others that do care.
1.1 tholo 967:
1.7 millert 968: May 2, 1996:
969: removed all register declarations.
1.1 tholo 970:
1.7 millert 971: enhanced split(), as in gawk, etc: split(s, a, "") splits s into
972: a[1]...a[length(s)] with each character a single element.
1.1 tholo 973:
1.7 millert 974: made the same changes for field-splitting if FS is "".
1.1 tholo 975:
1.7 millert 976: added nextfile, as in gawk: causes immediate advance to next
977: input file. (thanks to arnold robbins for inspiration and code).
1.1 tholo 978:
1.7 millert 979: small fixes to regexpr code: can now handle []], [[], and
1.25 millert 980: variants; [] is now a syntax error, rather than matching
1.7 millert 981: everything; [z-a] is now empty, not z. far from complete
982: or correct, however. (thanks to jeffrey friedl for pointing out
983: some awful behaviors.)
1.1 tholo 984:
1.7 millert 985: Apr 29, 1996:
1.12 otto 986: replaced uchar by uschar everywhere; apparently some compilers
1.7 millert 987: usurp this name and this causes conflicts.
1.1 tholo 988:
1.7 millert 989: fixed call to time in run.c (bltin); arg is time_t *.
1.1 tholo 990:
1.7 millert 991: replaced horrible pointer/long punning in b.c by a legitimate
992: union. should be safer on 64-bit machines and cleaner everywhere.
993: (thanks to nelson beebe for pointing out some of these problems.)
1.1 tholo 994:
1.7 millert 995: replaced nested comments by #if 0...#endif in run.c, lib.c.
1.1 tholo 996:
1.7 millert 997: removed getsval, setsval, execute macros from run.c and lib.c.
998: machines are 100x faster than they were when these macros were
999: first used.
1.1 tholo 1000:
1.7 millert 1001: revised filenames: awk.g.y => awkgram.y, awk.lx.l => awklex.l,
1002: y.tab.[ch] => ytab.[ch], lex.yy.c => lexyy.c, all in the aid of
1003: portability to nameless systems.
1.1 tholo 1004:
1.7 millert 1005: "make bundle" now includes yacc and lex output files for recipients
1006: who don't have yacc or lex.
1.1 tholo 1007:
1.7 millert 1008: Aug 15, 1995:
1009: initialized Cells in setsymtab more carefully; some fields
1010: were not set. (thanks to purify, all of whose complaints i
1011: think i now understand.)
1.1 tholo 1012:
1.7 millert 1013: fixed at least one error in gsub that looked at -1-th element
1014: of an array when substituting for a null match (e.g., $).
1.1 tholo 1015:
1.7 millert 1016: delete arrayname is now legal; it clears the elements but leaves
1017: the array, which may not be the right behavior.
1.1 tholo 1018:
1.7 millert 1019: modified makefile: my current make can't cope with the test used
1020: to avoid unnecessary yacc invocations.
1.1 tholo 1021:
1.7 millert 1022: Jul 17, 1995:
1023: added dynamically growing strings to awk.lx.l and b.c
1024: to permit regular expressions to be much bigger.
1025: the state arrays can still overflow.
1.1 tholo 1026:
1.7 millert 1027: Aug 24, 1994:
1028: detect duplicate arguments in function definitions (mdm).
1.1 tholo 1029:
1.7 millert 1030: May 11, 1994:
1031: trivial fix to printf to limit string size in sub().
1.1 tholo 1032:
1.7 millert 1033: Apr 22, 1994:
1034: fixed yet another subtle self-assignment problem:
1035: $1 = $2; $1 = $1 clobbered $1.
1.1 tholo 1036:
1.7 millert 1037: Regression tests now use private echo, to avoid quoting problems.
1.1 tholo 1038:
1.7 millert 1039: Feb 2, 1994:
1040: changed error() to print line number as %d, not %g.
1.1 tholo 1041:
1.7 millert 1042: Jul 23, 1993:
1043: cosmetic changes: increased sizes of some arrays,
1044: reworded some error messages.
1.1 tholo 1045:
1.7 millert 1046: added CONVFMT as in posix (just replaced OFMT in getsval)
1.1 tholo 1047:
1.7 millert 1048: FILENAME is now "" until the first thing that causes a file
1049: to be opened.
1.1 tholo 1050:
1.7 millert 1051: Nov 28, 1992:
1052: deleted yyunput and yyoutput from proto.h;
1053: different versions of lex give these different declarations.
1.1 tholo 1054:
1.7 millert 1055: May 31, 1992:
1056: added -mr N and -mf N options: more record and fields.
1057: these really ought to adjust automatically.
1.1 tholo 1058:
1.7 millert 1059: cleaned up some error messages; "out of space" now means
1060: malloc returned NULL in all cases.
1.1 tholo 1061:
1.7 millert 1062: changed rehash so that if it runs out, it just returns;
1063: things will continue to run slow, but maybe a bit longer.
1.1 tholo 1064:
1.7 millert 1065: Apr 24, 1992:
1066: remove redundant close of stdin when using -f -.
1.1 tholo 1067:
1.7 millert 1068: got rid of core dump with -d; awk -d just prints date.
1.1 tholo 1069:
1.7 millert 1070: Apr 12, 1992:
1071: added explicit check for /dev/std(in,out,err) in redirection.
1072: unlike gawk, no /dev/fd/n yet.
1.1 tholo 1073:
1.7 millert 1074: added (file/pipe) builtin. hard to test satisfactorily.
1075: not posix.
1.1 tholo 1076:
1.7 millert 1077: Feb 20, 1992:
1078: recompile after abortive changes; should be unchanged.
1.1 tholo 1079:
1.7 millert 1080: Dec 2, 1991:
1081: die-casting time: converted to ansi C, installed that.
1.1 tholo 1082:
1.7 millert 1083: Nov 30, 1991:
1084: fixed storage leak in freefa, failing to recover [N]CCL.
1085: thanks to Bill Jones (jones@cs.usask.ca)
1.1 tholo 1086:
1.7 millert 1087: Nov 19, 1991:
1088: use RAND_MAX instead of literal in builtin().
1.1 tholo 1089:
1.7 millert 1090: Nov 12, 1991:
1091: cranked up some fixed-size arrays in b.c, and added a test for
1092: overflow in penter. thanks to mark larsen.
1.1 tholo 1093:
1.7 millert 1094: Sep 24, 1991:
1095: increased buffer in gsub. a very crude fix to a general problem.
1096: and again on Sep 26.
1.1 tholo 1097:
1.7 millert 1098: Aug 18, 1991:
1099: enforce variable name syntax for commandline variables: has to
1100: start with letter or _.
1.1 tholo 1101:
1.7 millert 1102: Jul 27, 1991:
1103: allow newline after ; in for statements.
1.1 tholo 1104:
1.7 millert 1105: Jul 21, 1991:
1106: fixed so that in self-assignment like $1=$1, side effects
1107: like recomputing $0 take place. (this is getting subtle.)
1.1 tholo 1108:
1.7 millert 1109: Jun 30, 1991:
1110: better test for detecting too-long output record.
1.1 tholo 1111:
1.7 millert 1112: Jun 2, 1991:
1113: better defense against very long printf strings.
1114: made break and continue illegal outside of loops.
1.1 tholo 1115:
1.7 millert 1116: May 13, 1991:
1117: removed extra arg on gettemp, tempfree. minor error message rewording.
1.1 tholo 1118:
1119: May 6, 1991:
1120: fixed silly bug in hex parsing in hexstr().
1121: removed an apparently unnecessary test in isnumber().
1122: warn about weird printf conversions.
1123: fixed unchecked array overwrite in relex().
1124:
1125: changed for (i in array) to access elements in sorted order.
1126: then unchanged it -- it really does run slower in too many cases.
1127: left the code in place, commented out.
1128:
1.7 millert 1129: Feb 10, 1991:
1130: check error status on all writes, to avoid banging on full disks.
1.1 tholo 1131:
1.7 millert 1132: Jan 28, 1991:
1133: awk -f - reads the program from stdin.
1.1 tholo 1134:
1.7 millert 1135: Jan 11, 1991:
1136: failed to set numeric state on $0 in cmd|getline context in run.c.
1.1 tholo 1137:
1.7 millert 1138: Nov 2, 1990:
1139: fixed sleazy test for integrality in getsval; use modf.
1.1 tholo 1140:
1.7 millert 1141: Oct 29, 1990:
1142: fixed sleazy buggy code in lib.c that looked (incorrectly) for
1143: too long input lines.
1.1 tholo 1144:
1.7 millert 1145: Oct 14, 1990:
1146: fixed the bug on p. 198 in which it couldn't deduce that an
1147: argument was an array in some contexts. replaced the error
1148: message in intest() by code that damn well makes it an array.
1.1 tholo 1149:
1.7 millert 1150: Oct 8, 1990:
1151: fixed horrible bug: types and values were not preserved in
1152: some kinds of self-assignment. (in assign().)
1.1 tholo 1153:
1.7 millert 1154: Aug 24, 1990:
1155: changed NCHARS to 256 to handle 8-bit characters in strings
1156: presented to match(), etc.
1.1 tholo 1157:
1.7 millert 1158: Jun 26, 1990:
1159: changed struct rrow (awk.h) to use long instead of int for lval,
1160: since cfoll() stores a pointer in it. now works better when int's
1161: are smaller than pointers!
1.1 tholo 1162:
1.7 millert 1163: May 6, 1990:
1164: AVA fixed the grammar so that ! is uniformly of the same precedence as
1165: unary + and -. This renders illegal some constructs like !x=y, which
1166: now has to be parenthesized as !(x=y), and makes others work properly:
1167: !x+y is (!x)+y, and x!y is x !y, not two pattern-action statements.
1168: (These problems were pointed out by Bob Lenk of Posix.)
1.1 tholo 1169:
1.7 millert 1170: Added \x to regular expressions (already in strings).
1171: Limited octal to octal digits; \8 and \9 are not octal.
1172: Centralized the code for parsing escapes in regular expressions.
1173: Added a bunch of tests to T.re and T.sub to verify some of this.
1.1 tholo 1174:
1.7 millert 1175: Feb 9, 1990:
1176: fixed null pointer dereference bug in main.c: -F[nothing]. sigh.
1.1 tholo 1177:
1.7 millert 1178: restored srand behavior: it returns the current seed.
1.1 tholo 1179:
1.7 millert 1180: Jan 18, 1990:
1181: srand now returns previous seed value (0 to start).
1.1 tholo 1182:
1.7 millert 1183: Jan 5, 1990:
1184: fix potential problem in tran.c -- something was freed,
1185: then used in freesymtab.
1.1 tholo 1186:
1.7 millert 1187: Oct 18, 1989:
1188: another try to get the max number of open files set with
1189: relatively machine-independent code.
1.1 tholo 1190:
1.7 millert 1191: small fix to input() in case of multiple reads after EOF.
1.1 tholo 1192:
1.7 millert 1193: Oct 11, 1989:
1194: FILENAME is now defined in the BEGIN block -- too many old
1195: programs broke.
1.1 tholo 1196:
1.7 millert 1197: "-" means stdin in getline as well as on the commandline.
1.1 tholo 1198:
1.7 millert 1199: added a bunch of casts to the code to tell the truth about
1200: char * vs. unsigned char *, a right royal pain. added a
1201: setlocale call to the front of main, though probably no one
1202: has it usefully implemented yet.
1.1 tholo 1203:
1.7 millert 1204: Aug 24, 1989:
1205: removed redundant relational tests against nullnode if parse
1206: tree already had a relational at that point.
1.1 tholo 1207:
1.7 millert 1208: Aug 11, 1989:
1209: fixed bug: commandline variable assignment has to look like
1210: var=something. (consider the man page for =, in file =.1)
1.1 tholo 1211:
1.7 millert 1212: changed number of arguments to functions to static arrays
1213: to avoid repeated malloc calls.
1.1 tholo 1214:
1.7 millert 1215: Aug 2, 1989:
1216: restored -F (space) separator
1.1 tholo 1217:
1.7 millert 1218: Jul 30, 1989:
1219: added -v x=1 y=2 ... for immediate commandline variable assignment;
1220: done before the BEGIN block for sure. they have to precede the
1221: program if the program is on the commandline.
1222: Modified Aug 2 to require a separate -v for each assignment.
1.1 tholo 1223:
1.7 millert 1224: Jul 10, 1989:
1225: fixed ref-thru-zero bug in environment code in tran.c
1.1 tholo 1226:
1.7 millert 1227: Jun 23, 1989:
1228: add newline to usage message.
1.1 tholo 1229:
1.7 millert 1230: Jun 14, 1989:
1231: added some missing ansi printf conversion letters: %i %X %E %G.
1232: no sensible meaning for h or L, so they may not do what one expects.
1.1 tholo 1233:
1.7 millert 1234: made %* conversions work.
1.1 tholo 1235:
1.7 millert 1236: changed x^y so that if n is a positive integer, it's done
1237: by explicit multiplication, thus achieving maximum accuracy.
1238: (this should be done by pow() but it seems not to be locally.)
1239: done to x ^= y as well.
1.1 tholo 1240:
1.7 millert 1241: Jun 4, 1989:
1242: ENVIRON array contains environment: if shell variable V=thing,
1243: ENVIRON["V"] is "thing"
1.1 tholo 1244:
1.7 millert 1245: multiple -f arguments permitted. error reporting is naive.
1246: (they were permitted before, but only the last was used.)
1.1 tholo 1247:
1.7 millert 1248: fixed a really stupid botch in the debugging macro dprintf
1.1 tholo 1249:
1.7 millert 1250: fixed order of evaluation of commandline assignments to match
1251: what the book claims: an argument of the form x=e is evaluated
1252: at the time it would have been opened if it were a filename (p 63).
1253: this invalidates the suggested answer to ex 4-1 (p 195).
1.1 tholo 1254:
1.7 millert 1255: removed some code that permitted -F (space) fieldseparator,
1256: since it didn't quite work right anyway. (restored aug 2)
1.1 tholo 1257:
1.7 millert 1258: Apr 27, 1989:
1259: Line number now accumulated correctly for comment lines.
1.1 tholo 1260:
1.7 millert 1261: Apr 26, 1989:
1262: Debugging output now includes a version date,
1263: if one compiles it into the source each time.
1.1 tholo 1264:
1.7 millert 1265: Apr 9, 1989:
1266: Changed grammar to prohibit constants as 3rd arg of sub and gsub;
1267: prevents class of overwriting-a-constant errors. (Last one?)
1268: This invalidates the "banana" example on page 43 of the book.
1.1 tholo 1269:
1.7 millert 1270: Added \a ("alert"), \v (vertical tab), \xhhh (hexadecimal),
1271: as in ANSI, for strings. Rescinded the sloppiness that permitted
1272: non-octal digits in \ooo. Warning: not all compilers and libraries
1273: will be able to deal with \x correctly.
1.1 tholo 1274:
1.7 millert 1275: Jan 9, 1989:
1276: Fixed bug that caused tempcell list to contain a duplicate.
1277: The fix is kludgy.
1.1 tholo 1278:
1.7 millert 1279: Dec 17, 1988:
1280: Catches some more commandline errors in main.
1281: Removed redundant decl of modf in run.c (confuses some compilers).
1282: Warning: there's no single declaration of malloc, etc., in awk.h
1283: that seems to satisfy all compilers.
1.1 tholo 1284:
1.7 millert 1285: Dec 7, 1988:
1286: Added a bit of code to error printing to avoid printing nulls.
1287: (Not clear that it actually would.)
1.1 tholo 1288:
1.7 millert 1289: Nov 27, 1988:
1290: With fear and trembling, modified the grammar to permit
1291: multiple pattern-action statements on one line without
1292: an explicit separator. By definition, this capitulation
1293: to the ghost of ancient implementations remains undefined
1294: and thus subject to change without notice or apology.
1295: DO NOT COUNT ON IT.
1.1 tholo 1296:
1.7 millert 1297: Oct 30, 1988:
1298: Fixed bug in call() that failed to recover storage.
1.1 tholo 1299:
1.7 millert 1300: A warning is now generated if there are more arguments
1301: in the call than in the definition (in lieu of fixing
1302: another storage leak).
1.2 millert 1303:
1.7 millert 1304: Oct 20, 1988:
1305: Fixed %c: if expr is numeric, use numeric value;
1306: otherwise print 1st char of string value. still
1307: doesn't work if the value is 0 -- won't print \0.
1.2 millert 1308:
1.7 millert 1309: Added a few more checks for running out of malloc.
1.2 millert 1310:
1.7 millert 1311: Oct 12, 1988:
1312: Fixed bug in call() that freed local arrays twice.
1.5 kstailey 1313:
1.7 millert 1314: Fixed to handle deletion of non-existent array right;
1315: complains about attempt to delete non-array element.
1.6 kstailey 1316:
1.7 millert 1317: Sep 30, 1988:
1318: Now guarantees to evaluate all arguments of built-in
1319: functions, as in C; the appearance is that arguments
1320: are evaluated before the function is called. Places
1321: affected are sub (gsub was ok), substr, printf, and
1322: all the built-in arithmetic functions in bltin().
1323: A warning is generated if a bltin() is called with
1324: the wrong number of arguments.
1.6 kstailey 1325:
1.7 millert 1326: This requires changing makeprof on p167 of the book.
1.6 kstailey 1327:
1.7 millert 1328: Aug 23, 1988:
1329: setting FILENAME in BEGIN caused core dump, apparently
1330: because it was freeing space not allocated by malloc.
1.6 kstailey 1331:
1.7 millert 1332: July 24, 1988:
1333: fixed egregious error in toupper/tolower functions.
1334: still subject to rescinding, however.
1.6 kstailey 1335:
1.7 millert 1336: July 2, 1988:
1337: flush stdout before opening file or pipe
1.6 kstailey 1338:
1.7 millert 1339: July 2, 1988:
1340: performance bug in b.c/cgoto(): not freeing some sets of states.
1341: partial fix only right now, and the number of states increased
1342: to make it less obvious.
1.6 kstailey 1343:
1.7 millert 1344: June 1, 1988:
1345: check error status on close
1.6 kstailey 1346:
1.7 millert 1347: May 28, 1988:
1348: srand returns seed value it's using.
1349: see 1/18/90
1.6 kstailey 1350:
1.7 millert 1351: May 22, 1988:
1352: Removed limit on depth of function calls.
1.6 kstailey 1353:
1.7 millert 1354: May 10, 1988:
1355: Fixed lib.c to permit _ in commandline variable names.
1.6 kstailey 1356:
1.7 millert 1357: Mar 25, 1988:
1358: main.c fixed to recognize -- as terminator of command-
1359: line options. Illegal options flagged.
1360: Error reporting slightly cleaned up.
1.6 kstailey 1361:
1.7 millert 1362: Dec 2, 1987:
1363: Newer C compilers apply a strict scope rule to extern
1364: declarations within functions. Two extern declarations in
1365: lib.c and tran.c have been moved to obviate this problem.
1.6 kstailey 1366:
1.7 millert 1367: Oct xx, 1987:
1368: Reluctantly added toupper and tolower functions.
1369: Subject to rescinding without notice.
1.6 kstailey 1370:
1.7 millert 1371: Sep 17, 1987:
1372: Error-message printer had printf(s) instead of
1373: printf("%s",s); got core dumps when the message
1374: included a %.
1.6 kstailey 1375:
1.7 millert 1376: Sep 12, 1987:
1377: Very long printf strings caused core dump;
1378: fixed aprintf, asprintf, format to catch them.
1379: Can still get a core dump in printf itself.
1.6 kstailey 1380:
1381:
![[BACK]](/icons/back.gif){kind=icon}
Return to FIXES CVS log ![[TXT]](/icons/text.gif){kind=icon}
![[DIR]](/icons/dir.gif){kind=icon}
Up to [local] / src / usr.bin / awk