Annotation of src/usr.bin/awk/FIXES, Revision 1.14
1.14 ! millert 1: /* $OpenBSD: FIXES,v 1.13 2004/12/30 01:52:48 millert Exp $ */
1.1 tholo 2: /****************************************************************
1.6 kstailey 3: Copyright (C) Lucent Technologies 1997
1.1 tholo 4: All Rights Reserved
5:
6: Permission to use, copy, modify, and distribute this software and
7: its documentation for any purpose and without fee is hereby
8: granted, provided that the above copyright notice appear in all
9: copies and that both that the copyright notice and this
10: permission notice and warranty disclaimer appear in supporting
1.6 kstailey 11: documentation, and that the name Lucent Technologies or any of
12: its entities not be used in advertising or publicity pertaining
13: to distribution of the software without specific, written prior
14: permission.
15:
16: LUCENT DISCLAIMS ALL WARRANTIES WITH REGARD TO THIS SOFTWARE,
17: INCLUDING ALL IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS.
18: IN NO EVENT SHALL LUCENT OR ANY OF ITS ENTITIES BE LIABLE FOR ANY
19: SPECIAL, INDIRECT OR CONSEQUENTIAL DAMAGES OR ANY DAMAGES
20: WHATSOEVER RESULTING FROM LOSS OF USE, DATA OR PROFITS, WHETHER
21: IN AN ACTION OF CONTRACT, NEGLIGENCE OR OTHER TORTIOUS ACTION,
22: ARISING OUT OF OR IN CONNECTION WITH THE USE OR PERFORMANCE OF
23: THIS SOFTWARE.
1.1 tholo 24: ****************************************************************/
25:
26: This file lists all bug fixes, changes, etc., made since the AWK book
27: was sent to the printers in August, 1987.
1.14 ! millert 28:
! 29: Oct 23, 2007:
! 30: minor fix in lib.c: increase inputFS to 100, change malloc
! 31: for fields to n+1.
! 32:
! 33: fixed memory fault caused by out of order test in setsval.
! 34:
! 35: thanks to david o'brien, freebsd, for both fixes.
! 36:
! 37: May 1, 2007:
! 38: fiddle in makefile to fix for BSD make; thanks to igor sobrado.
! 39:
! 40: Mar 31, 2007:
! 41: fixed some null pointer refs calling adjbuf.
! 42:
! 43: Feb 21, 2007:
! 44: fixed a bug in matching the null RE in sub and gsub. thanks to al aho
! 45: who actually did the fix (in b.c), and to wolfgang seeberg for finding
! 46: it and providing a very compact test case.
! 47:
! 48: fixed quotation in b.c; thanks to Hal Pratt and the Princeton Dante
! 49: Project.
! 50:
! 51: removed some no-effect asserts in run.c.
! 52:
! 53: fiddled maketab.c to not complain about bison-generated values.
! 54:
! 55: removed the obsolete -V argument; fixed --version to print the
! 56: version and exit.
! 57:
! 58: fixed wording and an outright error in the usage message; thanks to igor
! 59: sobrado and jason mcintyre.
! 60:
! 61: fixed a bug in -d that caused core dump if no program followed.
! 62:
! 63: Jan 1, 2007:
! 64: dropped mac.code from makefile; there are few non-MacOSX
! 65: mac's these days.
! 66:
! 67: Jan 17, 2006:
! 68: system() not flagged as unsafe in the unadvertised -safe option.
! 69: found it while enhancing tests before shipping the ;login: article.
! 70: practice what you preach.
! 71:
! 72: removed the 9-years-obsolete -mr and -mf flags.
! 73:
! 74: added -version and --version options.
! 75:
! 76: core dump on linux with BEGIN {nextfile}, now fixed.
! 77:
! 78: removed some #ifdef's in run.c and lex.c that appear to no
! 79: longer be necessary.
! 80:
! 81: Apr 24, 2005:
! 82: modified lib.c so that values of $0 et al are preserved in the END
! 83: block, apparently as required by posix. thanks to havard eidnes
! 84: for the report and code.
! 85:
! 86: Jan 14, 2005:
! 87: fixed infinite loop in parsing, originally found by brian tsang.
! 88: thanks to arnold robbins for a suggestion that started me
! 89: rethinking it.
! 90:
! 91: Dec 31, 2004:
! 92: prevent overflow of -f array in main, head off potential error in
! 93: call of SYNTAX(), test malloc return in lib.c, all with thanks to
! 94: todd miller.
1.13 millert 95:
96: Dec 22, 2004:
97: cranked up size of NCHARS; coverity thinks it can be overrun with
98: smaller size, and i think that's right. added some assertions to b.c
99: to catch places where it might overrun. the RE code is still fragile.
100:
101: Dec 5, 2004:
102: fixed a couple of overflow problems with ridiculous field numbers:
103: e.g., print $(2^32-1). thanks to ruslan ermilov, giorgos keramidas
104: and david o'brien at freebsd.org for patches. this really should
105: be re-done from scratch.
106:
107: Nov 21, 2004:
108: fixed another 25-year-old RE bug, in split. it's another failure
109: to (re-)initialize. thanks to steve fisher for spotting this and
110: providing a good test case.
111:
112: Nov 22, 2003:
113: fixed a bug in regular expressions that dates (so help me) from 1977;
114: it's been there from the beginning. an anchored longest match that
115: was longer than the number of states triggered a failure to initialize
116: the machine properly. many thanks to moinak ghosh for not only finding
117: this one but for providing a fix, in some of the most mysterious
118: code known to man.
119:
120: fixed a storage leak in call() that appears to have been there since
121: 1983 or so -- a function without an explicit return that assigns a
122: string to a parameter leaked a Cell. thanks to moinak ghosh for
123: spotting this very subtle one.
124:
125: Jul 31, 2003:
126: fixed, thanks to andrey chernov and ruslan ermilov, a bug in lex.c
127: that mis-handled the character 255 in input. (it was being compared
128: to EOF with a signed comparison.)
129:
130: Jul 29, 2003:
131: fixed (i think) the long-standing botch that included the beginning of
132: line state ^ for RE's in the set of valid characters; this led to a
133: variety of odd problems, including failure to properly match certain
134: regular expressions in non-US locales. thanks to ruslan for keeping
135: at this one.
136:
137: Jul 28, 2003:
138: n-th try at getting internationalization right, with thanks to volker
139: kiefel, arnold robbins and ruslan ermilov for advice, though they
140: should not be blamed for the outcome. according to posix, "." is the
141: radix character in programs and command line arguments regardless of
142: the locale; otherwise, the locale should prevail for input and output
143: of numbers. so it's intended to work that way.
144:
145: i have rescinded the attempt to use strcoll in expanding shorthands in
146: regular expressions (cclenter). its properties are much too
147: surprising; for example [a-c] matches aAbBc in locale en_US but abBcC
148: in locale fr_CA. i can see how this might arise by implementation
149: but i cannot explain it to a human user. (this behavior can be seen
150: in gawk as well; we're leaning on the same library.)
151:
152: the issue appears to be that strcoll is meant for sorting, where
153: merging upper and lower case may make sense (though note that unix
154: sort does not do this by default either). it is not appropriate
155: for regular expressions, where the goal is to match specific
156: patterns of characters. in any case, the notations [:lower:], etc.,
157: are available in awk, and they are more likely to work correctly in
158: most locales.
159:
160: a moratorium is hereby declared on internationalization changes.
161: i apologize to friends and colleagues in other parts of the world.
162: i would truly like to get this "right", but i don't know what
163: that is, and i do not want to keep making changes until it's clear.
164:
165: Jul 4, 2003:
166: fixed bug that permitted non-terminated RE, as in "awk /x".
167:
168: Jun 1, 2003:
169: subtle change to split: if source is empty, number of elems
170: is always 0 and the array is not set.
171:
172: Mar 21, 2003:
173: added some parens to isblank, in another attempt to make things
174: internationally portable.
175:
176: Mar 14, 2003:
177: the internationalization changes, somewhat modified, are now
178: reinstated. in theory awk will now do character comparisons
179: and case conversions in national language, but "." will always
180: be the decimal point separator on input and output regardless
181: of national language. isblank(){} has an #ifndef.
182:
183: this no longer compiles on windows: LC_MESSAGES isn't defined
184: in vc6++.
185:
186: fixed subtle behavior in field and record splitting: if FS is
187: a single character and RS is not empty, \n is NOT a separator.
188: this tortuous reading is found in the awk book; behavior now
189: matches gawk and mawk.
1.11 millert 190:
191: Dec 13, 2002:
192: for the moment, the internationalization changes of nov 29 are
193: rolled back -- programs like x = 1.2 don't work in some locales,
194: because the parser is expecting x = 1,2. until i understand this
195: better, this will have to wait.
196:
197: Nov 29, 2002:
198: modified b.c (with tiny changes in main and run) to support
199: locales, using strcoll and iswhatever tests for posix character
200: classes. thanks to ruslan ermilov (ru@freebsd.org) for code.
201: the function isblank doesn't seem to have propagated to any
202: header file near me, so it's there explicitly. not properly
203: tested on non-ascii character sets by me.
204:
205: Jun 28, 2002:
206: modified run/format() and tran/getsval() to do a slightly better
207: job on using OFMT for output from print and CONVFMT for other
208: number->string conversions, as promised by posix and done by
209: gawk and mawk. there are still places where it doesn't work
210: right if CONVFMT is changed; by then the STR attribute of the
211: variable has been irrevocably set. thanks to arnold robbins for
212: code and examples.
213:
214: fixed subtle bug in format that could get core dump. thanks to
215: Jaromir Dolecek <jdolecek@NetBSD.org> for finding and fixing.
216: minor cleanup in run.c / format() at the same time.
217:
218: added some tests for null pointers to debugging printf's, which
219: were never intended for external consumption. thanks to dave
220: kerns (dkerns@lucent.com) for pointing this out.
221:
222: GNU compatibility: an empty regexp matches anything (thanks to
223: dag-erling smorgrav, des@ofug.org). subject to reversion if
224: this does more harm than good.
225:
226: pervasive small changes to make things more const-correct, as
227: reported by gcc's -Wwrite-strings. as it says in the gcc manual,
228: this may be more nuisance than useful. provoked by a suggestion
229: and code from arnaud desitter, arnaud@nimbus.geog.ox.ac.uk
230:
231: minor documentation changes to note that this now compiles out
232: of the box on Mac OS X.
233:
234: Feb 10, 2002:
235: changed types in posix chars structure to quiet solaris cc.
236:
237: Jan 1, 2002:
238: fflush() or fflush("") flushes all files and pipes.
239:
240: length(arrayname) returns number of elements; thanks to
241: arnold robbins for suggestion.
242:
243: added a makefile.win to make it easier to build on windows.
244: based on dan allen's buildwin.bat.
245:
246: Nov 16, 2001:
247: added support for posix character class names like [:digit:],
248: which are not exactly shorter than [0-9] and perhaps no more
249: portable. thanks to dag-erling smorgrav for code.
250:
251: Feb 16, 2001:
252: removed -m option; no longer needed, and it was actually
253: broken (noted thanks to volker kiefel).
254:
255: Feb 10, 2001:
256: fixed an appalling bug in gettok: any sequence of digits, +,-, E, e,
257: and period was accepted as a valid number if it started with a period.
258: this would never have happened with the lex version.
259:
260: other 1-character botches, now fixed, include a bare $ and a
261: bare " at the end of the input.
262:
263: Feb 7, 2001:
264: more (const char *) casts in b.c and tran.c to silence warnings.
1.8 millert 265:
1.10 millert 266: Nov 15, 2000:
267: fixed a bug introduced in august 1997 that caused expressions
268: like $f[1] to be syntax errors. thanks to arnold robbins for
269: noticing this and providing a fix.
270:
271: Oct 30, 2000:
272: fixed some nextfile bugs: not handling all cases. thanks to
273: arnold robbins for pointing this out. new regressions added.
274:
275: close() is now a function. it returns whatever the library
276: fclose returns, and -1 for closing a file or pipe that wasn't
277: opened.
278:
279: Sep 24, 2000:
280: permit \n explicitly in character classes; won't work right
281: if comes in as "[\n]" but ok as /[\n]/, because of multiple
282: processing of \'s. thanks to arnold robbins.
283:
284: July 5, 2000:
285: minor fiddles in tran.c to keep compilers happy about uschar.
286: thanks to norman wilson.
287:
288: May 25, 2000:
289: yet another attempt at making 8-bit input work, with another
290: band-aid in b.c (member()), and some (uschar) casts to head
291: off potential errors in subscripts (like isdigit). also
292: changed HAT to NCHARS-2. thanks again to santiago vila.
293:
294: changed maketab.c to ignore apparently out of range definitions
295: instead of halting; new freeBSD generates one. thanks to
296: jon snader <jsnader@ix.netcom.com> for pointing out the problem.
297:
298: May 2, 2000:
299: fixed an 8-bit problem in b.c by making several char*'s into
300: unsigned char*'s. not clear i have them all yet. thanks to
301: Santiago Vila <sanvila@unex.es> for the bug report.
302:
303: Apr 21, 2000:
304: finally found and fixed a memory leak in function call; it's
305: been there since functions were added ~1983. thanks to
306: jon bentley for the test case that found it.
307:
308: added test in envinit to catch environment "variables" with
1.12 otto 309: names beginning with '='; thanks to Berend Hasselman.
1.10 millert 310:
311: Jul 28, 1999:
312: added test in defn() to catch function foo(foo), which
313: otherwise recurses until core dump. thanks to arnold
314: robbins for noticing this.
315:
1.9 millert 316: Jun 20, 1999:
317: added *bp in gettok in lex.c; appears possible to exit function
318: without terminating the string. thanks to russ cox.
319:
320: Jun 2, 1999:
321: added function stdinit() to run to initialize files[] array,
322: in case stdin, etc., are not constants; some compilers care.
323:
324: May 10, 1999:
325: replaced the ERROR ... FATAL, etc., macros with functions
326: based on vprintf, to avoid problems caused by overrunning
327: fixed-size errbuf array. thanks to ralph corderoy for the
328: impetus, and for pointing out a string termination bug in
329: qstring as well.
330:
331: Apr 21, 1999:
332: fixed bug that caused occasional core dumps with commandline
333: variable with value ending in \. (thanks to nelson beebe for
334: the test case.)
335:
1.8 millert 336: Apr 16, 1999:
337: with code kindly provided by Bruce Lilly, awk now parses
338: /=/ and similar constructs more sensibly in more places.
1.10 millert 339: Bruce also provided some helpful test cases.
1.8 millert 340:
341: Apr 5, 1999:
342: changed true/false to True/False in run.c to make it
343: easier to compile with C++. Added some casts on malloc
344: and realloc to be honest about casts; ditto. changed
345: ltype int to long in struct rrow to reduce some 64-bit
346: complaints; other changes scattered throughout for the
347: same purpose. thanks to Nelson Beebe for these portability
348: improvements.
349:
350: removed some horrible pointer-int casting in b.c and elsewhere
351: by adding ptoi and itonp to localize the casts, which are
352: all benign. fixed one incipient bug that showed up on sgi
353: in 64-bit mode.
354:
355: reset lineno for new source file; include filename in error
356: message. also fixed line number error in continuation lines.
357: (thanks to Nelson Beebe for both of these.)
358:
359: Mar 24, 1999:
360: Nelson Beebe notes that irix 5.3 yacc dies with a bogus
361: error; use a newer version or switch to bison, since sgi
362: is unlikely to fix it.
1.1 tholo 363:
1.7 millert 364: Mar 5, 1999:
1.9 millert 365: changed isnumber to is_number to avoid the problem caused by
366: versions of ctype.h that include the name isnumber.
1.7 millert 367:
368: distribution now includes a script for building on a Mac,
369: thanks to Dan Allen.
370:
371: Feb 20, 1999:
372: fixed memory leaks in run.c (call) and tran.c (setfval).
373: thanks to Stephen Nutt for finding these and providing the fixes.
374:
375: Jan 13, 1999:
376: replaced srand argument by (unsigned int) in run.c;
377: avoids problem on Mac and potentially on Unix & Windows.
378: thanks to Dan Allen.
379:
380: added a few (int) casts to silence useless compiler warnings.
381: e.g., errorflag= in run.c jump().
382:
383: added proctab.c to the bundle outout; one less thing
384: to have to compile out of the box.
385:
386: added calls to _popen and _pclose to the win95 stub for
387: pipes (thanks to Steve Adams for this helpful suggestion).
388: seems to work, though properties are not well understood
389: by me, and it appears that under some circumstances the
390: pipe output is truncated. Be careful.
391:
392: Oct 19, 1998:
393: fixed a couple of bugs in getrec: could fail to update $0
394: after a getline var; because inputFS wasn't initialized,
395: could split $0 on every character, a misleading diversion.
396:
397: fixed caching bug in makedfa: LRU was actually removing
398: least often used.
399:
400: thanks to ross ridge for finding these, and for providing
401: great bug reports.
402:
403: May 12, 1998:
404: fixed potential bug in readrec: might fail to update record
405: pointer after growing. thanks to dan levy for spotting this
406: and suggesting the fix.
407:
408: Mar 12, 1998:
409: added -V to print version number and die.
410:
411: Feb 11, 1998:
412: subtle silent bug in lex.c: if the program ended with a number
413: longer than 1 digit, part of the input would be pushed back and
414: parsed again because token buffer wasn't terminated right.
415: example: awk 'length($0) > 10'. blush. at least i found it
416: myself.
417:
418: Aug 31, 1997:
419: s/adelete/awkdelete/: SGI uses this in malloc.h.
420: thanks to nelson beebe for pointing this one out.
421:
422: Aug 21, 1997:
423: fixed some bugs in sub and gsub when replacement includes \\.
424: this is a dark, horrible corner, but at least now i believe that
425: the behavior is the same as gawk and the intended posix standard.
426: thanks to arnold robbins for advice here.
427:
428: Aug 9, 1997:
429: somewhat regretfully, replaced the ancient lex-based lexical
430: analyzer with one written in C. it's longer, generates less code,
431: and more portable; the old one depended too much on mysterious
432: properties of lex that were not preserved in other environments.
433: in theory these recognize the same language.
434:
435: now using strtod to test whether a string is a number, instead of
436: the convoluted original function. should be more portable and
437: reliable if strtod is implemented right.
438:
439: removed now-pointless optimization in makefile that tries to avoid
440: recompilation when awkgram.y is changed but symbols are not.
441:
442: removed most fixed-size arrays, though a handful remain, some
443: of which are unchecked. you have been warned.
444:
445: Aug 4, 1997:
446: with some trepidation, replaced the ancient code that managed
447: fields and $0 in fixed-size arrays with arrays that grow on
448: demand. there is still some tension between trying to make this
449: run fast and making it clean; not sure it's right yet.
450:
451: the ill-conceived -mr and -mf arguments are now useful only
452: for debugging. previous dynamic string code removed.
453:
454: numerous other minor cleanups along the way.
1.1 tholo 455:
1.7 millert 456: Jul 30, 1997:
457: using code provided by dan levy (to whom profuse thanks), replaced
458: fixed-size arrays and awkward kludges by a fairly uniform mechanism
459: to grow arrays as needed for printf, sub, gsub, etc.
1.1 tholo 460:
1.7 millert 461: Jul 23, 1997:
462: falling off the end of a function returns "" and 0, not 0.
463: thanks to arnold robbins.
1.1 tholo 464:
1.7 millert 465: Jun 17, 1997:
466: replaced several fixed-size arrays by dynamically-created ones
467: in run.c; added overflow tests to some previously unchecked cases.
468: getline, toupper, tolower.
1.1 tholo 469:
1.7 millert 470: getline code is still broken in that recursive calls may wind
471: up using the same space. [fixed later]
1.1 tholo 472:
1.7 millert 473: increased RECSIZE to 8192 to push problems further over the horizon.
1.1 tholo 474:
1.7 millert 475: added \r to \n as input line separator for programs, not data.
476: damn CRLFs.
1.1 tholo 477:
1.7 millert 478: modified format() to permit explicit printf("%c", 0) to include
479: a null byte in output. thanks to ken stailey for the fix.
1.1 tholo 480:
1.7 millert 481: added a "-safe" argument that disables file output (print >,
482: print >>), process creation (cmd|getline, print |, system), and
483: access to the environment (ENVIRON). this is a first approximation
484: to a "safe" version of awk, but don't rely on it too much. thanks
485: to joan feigenbaum and matt blaze for the inspiration long ago.
1.1 tholo 486:
1.7 millert 487: Jul 8, 1996:
488: fixed long-standing bug in sub, gsub(/a/, "\\\\&"); thanks to
489: ralph corderoy.
1.1 tholo 490:
1.7 millert 491: Jun 29, 1996:
492: fixed awful bug in new field splitting; didn't get all the places
493: where input was done.
1.1 tholo 494:
1.7 millert 495: Jun 28, 1996:
496: changed field-splitting to conform to posix definition: fields are
497: split using the value of FS at the time of input; it used to be
498: the value when the field or NF was first referred to, a much less
499: predictable definition. thanks to arnold robbins for encouragement
500: to do the right thing.
1.1 tholo 501:
1.7 millert 502: May 28, 1996:
503: fixed appalling but apparently unimportant bug in parsing octal
504: numbers in reg exprs.
1.1 tholo 505:
1.7 millert 506: explicit hex in reg exprs now limited to 2 chars: \xa, \xaa.
1.1 tholo 507:
1.7 millert 508: May 27, 1996:
509: cleaned up some declarations so gcc -Wall is now almost silent.
1.1 tholo 510:
1.7 millert 511: makefile now includes backup copies of ytab.c and lexyy.c in case
512: one makes before looking; it also avoids recreating lexyy.c unless
513: really needed.
1.1 tholo 514:
1.7 millert 515: s/aprintf/awkprint, s/asprintf/awksprintf/ to avoid some name clashes
516: with unwisely-written header files.
1.1 tholo 517:
1.7 millert 518: thanks to jeffrey friedl for several of these.
1.1 tholo 519:
1.7 millert 520: May 26, 1996:
521: an attempt to rationalize the (unsigned) char issue. almost all
522: instances of unsigned char have been removed; the handful of places
523: in b.c where chars are used as table indices have been hand-crafted.
524: added some latin-1 tests to the regression, but i'm not confident;
525: none of my compilers seem to care much. thanks to nelson beebe for
526: pointing out some others that do care.
1.1 tholo 527:
1.7 millert 528: May 2, 1996:
529: removed all register declarations.
1.1 tholo 530:
1.7 millert 531: enhanced split(), as in gawk, etc: split(s, a, "") splits s into
532: a[1]...a[length(s)] with each character a single element.
1.1 tholo 533:
1.7 millert 534: made the same changes for field-splitting if FS is "".
1.1 tholo 535:
1.7 millert 536: added nextfile, as in gawk: causes immediate advance to next
537: input file. (thanks to arnold robbins for inspiration and code).
1.1 tholo 538:
1.7 millert 539: small fixes to regexpr code: can now handle []], [[], and
540: variants; [] is now a syntax error, rather than matching
541: everything; [z-a] is now empty, not z. far from complete
542: or correct, however. (thanks to jeffrey friedl for pointing out
543: some awful behaviors.)
1.1 tholo 544:
1.7 millert 545: Apr 29, 1996:
1.12 otto 546: replaced uchar by uschar everywhere; apparently some compilers
1.7 millert 547: usurp this name and this causes conflicts.
1.1 tholo 548:
1.7 millert 549: fixed call to time in run.c (bltin); arg is time_t *.
1.1 tholo 550:
1.7 millert 551: replaced horrible pointer/long punning in b.c by a legitimate
552: union. should be safer on 64-bit machines and cleaner everywhere.
553: (thanks to nelson beebe for pointing out some of these problems.)
1.1 tholo 554:
1.7 millert 555: replaced nested comments by #if 0...#endif in run.c, lib.c.
1.1 tholo 556:
1.7 millert 557: removed getsval, setsval, execute macros from run.c and lib.c.
558: machines are 100x faster than they were when these macros were
559: first used.
1.1 tholo 560:
1.7 millert 561: revised filenames: awk.g.y => awkgram.y, awk.lx.l => awklex.l,
562: y.tab.[ch] => ytab.[ch], lex.yy.c => lexyy.c, all in the aid of
563: portability to nameless systems.
1.1 tholo 564:
1.7 millert 565: "make bundle" now includes yacc and lex output files for recipients
566: who don't have yacc or lex.
1.1 tholo 567:
1.7 millert 568: Aug 15, 1995:
569: initialized Cells in setsymtab more carefully; some fields
570: were not set. (thanks to purify, all of whose complaints i
571: think i now understand.)
1.1 tholo 572:
1.7 millert 573: fixed at least one error in gsub that looked at -1-th element
574: of an array when substituting for a null match (e.g., $).
1.1 tholo 575:
1.7 millert 576: delete arrayname is now legal; it clears the elements but leaves
577: the array, which may not be the right behavior.
1.1 tholo 578:
1.7 millert 579: modified makefile: my current make can't cope with the test used
580: to avoid unnecessary yacc invocations.
1.1 tholo 581:
1.7 millert 582: Jul 17, 1995:
583: added dynamically growing strings to awk.lx.l and b.c
584: to permit regular expressions to be much bigger.
585: the state arrays can still overflow.
1.1 tholo 586:
1.7 millert 587: Aug 24, 1994:
588: detect duplicate arguments in function definitions (mdm).
1.1 tholo 589:
1.7 millert 590: May 11, 1994:
591: trivial fix to printf to limit string size in sub().
1.1 tholo 592:
1.7 millert 593: Apr 22, 1994:
594: fixed yet another subtle self-assignment problem:
595: $1 = $2; $1 = $1 clobbered $1.
1.1 tholo 596:
1.7 millert 597: Regression tests now use private echo, to avoid quoting problems.
1.1 tholo 598:
1.7 millert 599: Feb 2, 1994:
600: changed error() to print line number as %d, not %g.
1.1 tholo 601:
1.7 millert 602: Jul 23, 1993:
603: cosmetic changes: increased sizes of some arrays,
604: reworded some error messages.
1.1 tholo 605:
1.7 millert 606: added CONVFMT as in posix (just replaced OFMT in getsval)
1.1 tholo 607:
1.7 millert 608: FILENAME is now "" until the first thing that causes a file
609: to be opened.
1.1 tholo 610:
1.7 millert 611: Nov 28, 1992:
612: deleted yyunput and yyoutput from proto.h;
613: different versions of lex give these different declarations.
1.1 tholo 614:
1.7 millert 615: May 31, 1992:
616: added -mr N and -mf N options: more record and fields.
617: these really ought to adjust automatically.
1.1 tholo 618:
1.7 millert 619: cleaned up some error messages; "out of space" now means
620: malloc returned NULL in all cases.
1.1 tholo 621:
1.7 millert 622: changed rehash so that if it runs out, it just returns;
623: things will continue to run slow, but maybe a bit longer.
1.1 tholo 624:
1.7 millert 625: Apr 24, 1992:
626: remove redundant close of stdin when using -f -.
1.1 tholo 627:
1.7 millert 628: got rid of core dump with -d; awk -d just prints date.
1.1 tholo 629:
1.7 millert 630: Apr 12, 1992:
631: added explicit check for /dev/std(in,out,err) in redirection.
632: unlike gawk, no /dev/fd/n yet.
1.1 tholo 633:
1.7 millert 634: added (file/pipe) builtin. hard to test satisfactorily.
635: not posix.
1.1 tholo 636:
1.7 millert 637: Feb 20, 1992:
638: recompile after abortive changes; should be unchanged.
1.1 tholo 639:
1.7 millert 640: Dec 2, 1991:
641: die-casting time: converted to ansi C, installed that.
1.1 tholo 642:
1.7 millert 643: Nov 30, 1991:
644: fixed storage leak in freefa, failing to recover [N]CCL.
645: thanks to Bill Jones (jones@cs.usask.ca)
1.1 tholo 646:
1.7 millert 647: Nov 19, 1991:
648: use RAND_MAX instead of literal in builtin().
1.1 tholo 649:
1.7 millert 650: Nov 12, 1991:
651: cranked up some fixed-size arrays in b.c, and added a test for
652: overflow in penter. thanks to mark larsen.
1.1 tholo 653:
1.7 millert 654: Sep 24, 1991:
655: increased buffer in gsub. a very crude fix to a general problem.
656: and again on Sep 26.
1.1 tholo 657:
1.7 millert 658: Aug 18, 1991:
659: enforce variable name syntax for commandline variables: has to
660: start with letter or _.
1.1 tholo 661:
1.7 millert 662: Jul 27, 1991:
663: allow newline after ; in for statements.
1.1 tholo 664:
1.7 millert 665: Jul 21, 1991:
666: fixed so that in self-assignment like $1=$1, side effects
667: like recomputing $0 take place. (this is getting subtle.)
1.1 tholo 668:
1.7 millert 669: Jun 30, 1991:
670: better test for detecting too-long output record.
1.1 tholo 671:
1.7 millert 672: Jun 2, 1991:
673: better defense against very long printf strings.
674: made break and continue illegal outside of loops.
1.1 tholo 675:
1.7 millert 676: May 13, 1991:
677: removed extra arg on gettemp, tempfree. minor error message rewording.
1.1 tholo 678:
679: May 6, 1991:
680: fixed silly bug in hex parsing in hexstr().
681: removed an apparently unnecessary test in isnumber().
682: warn about weird printf conversions.
683: fixed unchecked array overwrite in relex().
684:
685: changed for (i in array) to access elements in sorted order.
686: then unchanged it -- it really does run slower in too many cases.
687: left the code in place, commented out.
688:
1.7 millert 689: Feb 10, 1991:
690: check error status on all writes, to avoid banging on full disks.
1.1 tholo 691:
1.7 millert 692: Jan 28, 1991:
693: awk -f - reads the program from stdin.
1.1 tholo 694:
1.7 millert 695: Jan 11, 1991:
696: failed to set numeric state on $0 in cmd|getline context in run.c.
1.1 tholo 697:
1.7 millert 698: Nov 2, 1990:
699: fixed sleazy test for integrality in getsval; use modf.
1.1 tholo 700:
1.7 millert 701: Oct 29, 1990:
702: fixed sleazy buggy code in lib.c that looked (incorrectly) for
703: too long input lines.
1.1 tholo 704:
1.7 millert 705: Oct 14, 1990:
706: fixed the bug on p. 198 in which it couldn't deduce that an
707: argument was an array in some contexts. replaced the error
708: message in intest() by code that damn well makes it an array.
1.1 tholo 709:
1.7 millert 710: Oct 8, 1990:
711: fixed horrible bug: types and values were not preserved in
712: some kinds of self-assignment. (in assign().)
1.1 tholo 713:
1.7 millert 714: Aug 24, 1990:
715: changed NCHARS to 256 to handle 8-bit characters in strings
716: presented to match(), etc.
1.1 tholo 717:
1.7 millert 718: Jun 26, 1990:
719: changed struct rrow (awk.h) to use long instead of int for lval,
720: since cfoll() stores a pointer in it. now works better when int's
721: are smaller than pointers!
1.1 tholo 722:
1.7 millert 723: May 6, 1990:
724: AVA fixed the grammar so that ! is uniformly of the same precedence as
725: unary + and -. This renders illegal some constructs like !x=y, which
726: now has to be parenthesized as !(x=y), and makes others work properly:
727: !x+y is (!x)+y, and x!y is x !y, not two pattern-action statements.
728: (These problems were pointed out by Bob Lenk of Posix.)
1.1 tholo 729:
1.7 millert 730: Added \x to regular expressions (already in strings).
731: Limited octal to octal digits; \8 and \9 are not octal.
732: Centralized the code for parsing escapes in regular expressions.
733: Added a bunch of tests to T.re and T.sub to verify some of this.
1.1 tholo 734:
1.7 millert 735: Feb 9, 1990:
736: fixed null pointer dereference bug in main.c: -F[nothing]. sigh.
1.1 tholo 737:
1.7 millert 738: restored srand behavior: it returns the current seed.
1.1 tholo 739:
1.7 millert 740: Jan 18, 1990:
741: srand now returns previous seed value (0 to start).
1.1 tholo 742:
1.7 millert 743: Jan 5, 1990:
744: fix potential problem in tran.c -- something was freed,
745: then used in freesymtab.
1.1 tholo 746:
1.7 millert 747: Oct 18, 1989:
748: another try to get the max number of open files set with
749: relatively machine-independent code.
1.1 tholo 750:
1.7 millert 751: small fix to input() in case of multiple reads after EOF.
1.1 tholo 752:
1.7 millert 753: Oct 11, 1989:
754: FILENAME is now defined in the BEGIN block -- too many old
755: programs broke.
1.1 tholo 756:
1.7 millert 757: "-" means stdin in getline as well as on the commandline.
1.1 tholo 758:
1.7 millert 759: added a bunch of casts to the code to tell the truth about
760: char * vs. unsigned char *, a right royal pain. added a
761: setlocale call to the front of main, though probably no one
762: has it usefully implemented yet.
1.1 tholo 763:
1.7 millert 764: Aug 24, 1989:
765: removed redundant relational tests against nullnode if parse
766: tree already had a relational at that point.
1.1 tholo 767:
1.7 millert 768: Aug 11, 1989:
769: fixed bug: commandline variable assignment has to look like
770: var=something. (consider the man page for =, in file =.1)
1.1 tholo 771:
1.7 millert 772: changed number of arguments to functions to static arrays
773: to avoid repeated malloc calls.
1.1 tholo 774:
1.7 millert 775: Aug 2, 1989:
776: restored -F (space) separator
1.1 tholo 777:
1.7 millert 778: Jul 30, 1989:
779: added -v x=1 y=2 ... for immediate commandline variable assignment;
780: done before the BEGIN block for sure. they have to precede the
781: program if the program is on the commandline.
782: Modified Aug 2 to require a separate -v for each assignment.
1.1 tholo 783:
1.7 millert 784: Jul 10, 1989:
785: fixed ref-thru-zero bug in environment code in tran.c
1.1 tholo 786:
1.7 millert 787: Jun 23, 1989:
788: add newline to usage message.
1.1 tholo 789:
1.7 millert 790: Jun 14, 1989:
791: added some missing ansi printf conversion letters: %i %X %E %G.
792: no sensible meaning for h or L, so they may not do what one expects.
1.1 tholo 793:
1.7 millert 794: made %* conversions work.
1.1 tholo 795:
1.7 millert 796: changed x^y so that if n is a positive integer, it's done
797: by explicit multiplication, thus achieving maximum accuracy.
798: (this should be done by pow() but it seems not to be locally.)
799: done to x ^= y as well.
1.1 tholo 800:
1.7 millert 801: Jun 4, 1989:
802: ENVIRON array contains environment: if shell variable V=thing,
803: ENVIRON["V"] is "thing"
1.1 tholo 804:
1.7 millert 805: multiple -f arguments permitted. error reporting is naive.
806: (they were permitted before, but only the last was used.)
1.1 tholo 807:
1.7 millert 808: fixed a really stupid botch in the debugging macro dprintf
1.1 tholo 809:
1.7 millert 810: fixed order of evaluation of commandline assignments to match
811: what the book claims: an argument of the form x=e is evaluated
812: at the time it would have been opened if it were a filename (p 63).
813: this invalidates the suggested answer to ex 4-1 (p 195).
1.1 tholo 814:
1.7 millert 815: removed some code that permitted -F (space) fieldseparator,
816: since it didn't quite work right anyway. (restored aug 2)
1.1 tholo 817:
1.7 millert 818: Apr 27, 1989:
819: Line number now accumulated correctly for comment lines.
1.1 tholo 820:
1.7 millert 821: Apr 26, 1989:
822: Debugging output now includes a version date,
823: if one compiles it into the source each time.
1.1 tholo 824:
1.7 millert 825: Apr 9, 1989:
826: Changed grammar to prohibit constants as 3rd arg of sub and gsub;
827: prevents class of overwriting-a-constant errors. (Last one?)
828: This invalidates the "banana" example on page 43 of the book.
1.1 tholo 829:
1.7 millert 830: Added \a ("alert"), \v (vertical tab), \xhhh (hexadecimal),
831: as in ANSI, for strings. Rescinded the sloppiness that permitted
832: non-octal digits in \ooo. Warning: not all compilers and libraries
833: will be able to deal with \x correctly.
1.1 tholo 834:
1.7 millert 835: Jan 9, 1989:
836: Fixed bug that caused tempcell list to contain a duplicate.
837: The fix is kludgy.
1.1 tholo 838:
1.7 millert 839: Dec 17, 1988:
840: Catches some more commandline errors in main.
841: Removed redundant decl of modf in run.c (confuses some compilers).
842: Warning: there's no single declaration of malloc, etc., in awk.h
843: that seems to satisfy all compilers.
1.1 tholo 844:
1.7 millert 845: Dec 7, 1988:
846: Added a bit of code to error printing to avoid printing nulls.
847: (Not clear that it actually would.)
1.1 tholo 848:
1.7 millert 849: Nov 27, 1988:
850: With fear and trembling, modified the grammar to permit
851: multiple pattern-action statements on one line without
852: an explicit separator. By definition, this capitulation
853: to the ghost of ancient implementations remains undefined
854: and thus subject to change without notice or apology.
855: DO NOT COUNT ON IT.
1.1 tholo 856:
1.7 millert 857: Oct 30, 1988:
858: Fixed bug in call() that failed to recover storage.
1.1 tholo 859:
1.7 millert 860: A warning is now generated if there are more arguments
861: in the call than in the definition (in lieu of fixing
862: another storage leak).
1.2 millert 863:
1.7 millert 864: Oct 20, 1988:
865: Fixed %c: if expr is numeric, use numeric value;
866: otherwise print 1st char of string value. still
867: doesn't work if the value is 0 -- won't print \0.
1.2 millert 868:
1.7 millert 869: Added a few more checks for running out of malloc.
1.2 millert 870:
1.7 millert 871: Oct 12, 1988:
872: Fixed bug in call() that freed local arrays twice.
1.5 kstailey 873:
1.7 millert 874: Fixed to handle deletion of non-existent array right;
875: complains about attempt to delete non-array element.
1.6 kstailey 876:
1.7 millert 877: Sep 30, 1988:
878: Now guarantees to evaluate all arguments of built-in
879: functions, as in C; the appearance is that arguments
880: are evaluated before the function is called. Places
881: affected are sub (gsub was ok), substr, printf, and
882: all the built-in arithmetic functions in bltin().
883: A warning is generated if a bltin() is called with
884: the wrong number of arguments.
1.6 kstailey 885:
1.7 millert 886: This requires changing makeprof on p167 of the book.
1.6 kstailey 887:
1.7 millert 888: Aug 23, 1988:
889: setting FILENAME in BEGIN caused core dump, apparently
890: because it was freeing space not allocated by malloc.
1.6 kstailey 891:
1.7 millert 892: July 24, 1988:
893: fixed egregious error in toupper/tolower functions.
894: still subject to rescinding, however.
1.6 kstailey 895:
1.7 millert 896: July 2, 1988:
897: flush stdout before opening file or pipe
1.6 kstailey 898:
1.7 millert 899: July 2, 1988:
900: performance bug in b.c/cgoto(): not freeing some sets of states.
901: partial fix only right now, and the number of states increased
902: to make it less obvious.
1.6 kstailey 903:
1.7 millert 904: June 1, 1988:
905: check error status on close
1.6 kstailey 906:
1.7 millert 907: May 28, 1988:
908: srand returns seed value it's using.
909: see 1/18/90
1.6 kstailey 910:
1.7 millert 911: May 22, 1988:
912: Removed limit on depth of function calls.
1.6 kstailey 913:
1.7 millert 914: May 10, 1988:
915: Fixed lib.c to permit _ in commandline variable names.
1.6 kstailey 916:
1.7 millert 917: Mar 25, 1988:
918: main.c fixed to recognize -- as terminator of command-
919: line options. Illegal options flagged.
920: Error reporting slightly cleaned up.
1.6 kstailey 921:
1.7 millert 922: Dec 2, 1987:
923: Newer C compilers apply a strict scope rule to extern
924: declarations within functions. Two extern declarations in
925: lib.c and tran.c have been moved to obviate this problem.
1.6 kstailey 926:
1.7 millert 927: Oct xx, 1987:
928: Reluctantly added toupper and tolower functions.
929: Subject to rescinding without notice.
1.6 kstailey 930:
1.7 millert 931: Sep 17, 1987:
932: Error-message printer had printf(s) instead of
933: printf("%s",s); got core dumps when the message
934: included a %.
1.6 kstailey 935:
1.7 millert 936: Sep 12, 1987:
937: Very long printf strings caused core dump;
938: fixed aprintf, asprintf, format to catch them.
939: Can still get a core dump in printf itself.
1.6 kstailey 940:
941: