Annotation of src/usr.bin/awk/FIXES, Revision 1.58
1.1 tholo 1: /****************************************************************
1.6 kstailey 2: Copyright (C) Lucent Technologies 1997
1.1 tholo 3: All Rights Reserved
4:
5: Permission to use, copy, modify, and distribute this software and
6: its documentation for any purpose and without fee is hereby
7: granted, provided that the above copyright notice appear in all
8: copies and that both that the copyright notice and this
9: permission notice and warranty disclaimer appear in supporting
1.6 kstailey 10: documentation, and that the name Lucent Technologies or any of
11: its entities not be used in advertising or publicity pertaining
12: to distribution of the software without specific, written prior
13: permission.
14:
15: LUCENT DISCLAIMS ALL WARRANTIES WITH REGARD TO THIS SOFTWARE,
16: INCLUDING ALL IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS.
17: IN NO EVENT SHALL LUCENT OR ANY OF ITS ENTITIES BE LIABLE FOR ANY
18: SPECIAL, INDIRECT OR CONSEQUENTIAL DAMAGES OR ANY DAMAGES
19: WHATSOEVER RESULTING FROM LOSS OF USE, DATA OR PROFITS, WHETHER
20: IN AN ACTION OF CONTRACT, NEGLIGENCE OR OTHER TORTIOUS ACTION,
21: ARISING OUT OF OR IN CONNECTION WITH THE USE OR PERFORMANCE OF
22: THIS SOFTWARE.
1.1 tholo 23: ****************************************************************/
24:
1.51 millert 25: This file lists all bug fixes, changes, etc., made since the
26: second edition of the AWK book was published in September 2023.
1.45 millert 27:
1.58 ! millert 28: Apr 22, 2024:
! 29: fixed regex engine gototab reallocation issue that was
! 30: introduced during the Nov 24 rewrite. Thanks to Arnold Robbins.
! 31: Fixed a scan bug in split in the case the separator is a single
! 32: character. thanks to Oguz Ismail for spotting the issue.
! 33:
! 34: Mar 10, 2024:
! 35: fixed use-after-free bug in fnematch due to adjbuf invalidating
! 36: the pointers to buf. thanks to github user caffe3 for spotting
! 37: the issue and providing a fix, and to Miguel Pineiro Jr.
! 38: for the alternative fix.
! 39: MAX_UTF_BYTES in fnematch has been replaced with awk_mb_cur_max.
! 40: thanks to Miguel Pineiro Jr.
! 41:
1.57 millert 42: Jan 22, 2024:
43: Restore the ability to compile with g++. Thanks to
44: Arnold Robbins.
45:
46: Dec 24, 2023:
1.58 ! millert 47: Matchop dereference after free problem fix when the first
! 48: argument is a function call. Thanks to Oguz Ismail Uysal.
1.57 millert 49: Fix inconsistent handling of --csv and FS set in the
50: command line. Thanks to Wilbert van der Poel.
1.58 ! millert 51: Casting changes to int for is* functions.
1.57 millert 52:
1.56 millert 53: Nov 27, 2023:
1.58 ! millert 54: Fix exit status of system on MacOS. Update to REGRESS.
1.56 millert 55: Thanks to Arnold Robbins.
56: Fix inconsistent handling of -F and --csv, and loss of csv
1.57 millert 57: mode when FS is set.
1.56 millert 58:
1.55 millert 59: Nov 24, 2023:
60: Fix issue #199: gototab improvements to dynamically resize the
61: table, qsort and bsearch to improve the lookup speed as the
1.58 ! millert 62: table gets larger for multibyte input. Thanks to Arnold Robbins.
1.55 millert 63:
64: Nov 23, 2023:
65: Fix Issue #169, related to escape sequences in strings.
66: Thanks to Github user rajeevvp.
67: Fix Issue #147, reported by Github user drawkula, and fixed
68: by Miguel Pineiro Jr.
69:
70: Nov 20, 2023:
1.58 ! millert 71: Rewrite of fnematch to fix a number of issues, including
1.54 millert 72: extraneous output, out-of-bounds access, number of bytes
73: to push back after a failed match etc.
1.58 ! millert 74: Thanks to Miguel Pineiro Jr.
1.54 millert 75:
1.55 millert 76: Nov 15, 2023:
1.58 ! millert 77: Man page edit, regression test fixes. Thanks to Arnold Robbins
! 78: Consolidation of sub and gsub into dosub, removing duplicate
! 79: code. Thanks to Miguel Pineiro Jr.
1.54 millert 80: gcc replaced with cc everywhere.
81:
1.53 millert 82: Oct 30, 2023:
1.58 ! millert 83: Multiple fixes and a minor code cleanup.
! 84: Disabled utf-8 for non-multibyte locales, such as C or POSIX.
! 85: Fixed a bad char * cast that causes incorrect results on big-endian
! 86: systems. Also fixed an out-of-bounds read for empty CCL.
! 87: Fixed a buffer overflow in substr with utf-8 strings.
! 88: Many thanks to Todd C Miller.
1.53 millert 89:
1.52 millert 90: Sep 24, 2023:
91: fnematch and getrune have been overhauled to solve issues around
1.58 ! millert 92: unicode FS and RS. Also fixed gsub null match issue with unicode.
! 93: Big thanks to Arnold Robbins.
1.52 millert 94:
1.51 millert 95: Sep 12, 2023:
96: Fixed a length error in u8_byte2char that set RSTART to
97: incorrect (cannot happen) value for EOL match(str, /$/).
1.50 millert 98:
1.49 millert 99:
1.51 millert 100: -----------------------------------------------------------------
1.48 millert 101:
1.51 millert 102: [This entry is a summary, not a precise list of changes.]
1.46 millert 103:
1.51 millert 104: Added --csv option to enable processing of comma-separated
105: values inputs. When --csv is enabled, fields are separated
106: by commas, fields may be quoted with " double quotes, fields
107: may contain embedded newlines.
1.46 millert 108:
1.51 millert 109: If no explicit separator argument is provided, split() uses
110: the setting of --csv to determine how fields are split.
1.44 millert 111:
1.51 millert 112: Strings may now contain UTF-8 code points (not necessarily
113: characters). Functions that operate on characters, like
114: length, substr, index, match, etc., use UTF-8, so the length
115: of a string of 3 emojis is 3, not 12 as it would be if bytes
116: were counted.
1.43 millert 117:
1.58 ! millert 118: Regular expressions are processed as UTF-8.
1.6 kstailey 119:
1.51 millert 120: Unicode literals can be written as \u followed by one
121: to eight hexadecimal digits. These may appear in strings and
122: regular expressions.