Fix --posix to disable the GNU regular expression escapes - #550
Conversation
Codecov Report❌ Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## main #550 +/- ##
==========================================
+ Coverage 83.04% 83.16% +0.12%
==========================================
Files 13 13
Lines 7046 7109 +63
Branches 401 402 +1
==========================================
+ Hits 5851 5912 +61
- Misses 1192 1194 +2
Partials 3 3
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Harness. 🚀 New features to boost your workflow:
|
There was a problem hiding this comment.
🟡 Changes recommended
The new integration tests don’t yet cover all GNU escapes called out by #542 (notably \+ and \|), reducing end-to-end regression protection for the claimed fix.
Once you've addressed the issues Copilot identified, you can request another Copilot review.
Pull request overview
This PR updates the sed script regex parser so that when --posix is enabled, GNU regex escape extensions (e.g., \?, \+, \|, \w, \s, etc.) are treated as literals rather than GNU-specific operators/classes/anchors, aligning behavior with GNU sed and fixing #542.
Changes:
- Thread
context.posixinto regex parsing (parse_regex_for_mode) and handle GNU escape extensions as literals under POSIX mode (with special handling for ERE metacharacters? + |). - Add end-to-end regression tests validating
--posixdisables key GNU regex escapes, plus unit tests covering BRE vs ERE emission rules.
File summaries
| File | Description |
|---|---|
| tests/by-util/test_sed.rs | Adds integration tests for --posix behavior around GNU regex escape extensions. |
| src/sed/delimited_parser.rs | Implements --posix parsing behavior for GNU regex escapes and adds targeted unit tests. |
| src/sed/compiler.rs | Passes context.posix into regex parsing for addresses and substitution patterns. |
Review details
- Files reviewed: 3/3 changed files
- Comments generated: 2
- Review effort level: Lite
💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.
|
@sylvestre While working on this I noticed that $ printf 'cat catalog\n' | sed 's/\<cat\>/X/g'
X catalog
$ printf 'cat catalog\n' | ./target/debug/sed 's/\<cat\>/X/g'
cat catalogThe fix looks small, and differs per escape. All three engines support
This is the separate problem from this PR, so I left it out. Do you want to add it in this PR or open a separate issue for it? |
- Add a POSIX parameter to `parse_regex_for_mode()` that emits the literal character for `\?`, `\+`, `\|`, `\w`, `\W`, `\s`, `\S`, `\b`, `\B`, `\<`, `\>`, `` \` `` and `\'` - Emit the character bare in BRE, where `bre_to_ere()` escapes it afterwards, and keep the backslash on `\?`, `\+` and `\|` in ERE - Add unit and integration tests
There was a problem hiding this comment.
🟢 Approval recommended
The change is narrowly scoped, threads --posix consistently through the compiler, and includes both unit and integration tests covering the corrected behavior.
Review details
- Files reviewed: 3/3 changed files
- Comments generated: 0 new
- Review effort level: Lite
Fixes #542
Under
--posix, GNU sed treats the GNU regular expression escapes as the literal character that follows the backslash. These are the operators\?,\+and\|, the character classes\w,\W,\sand\S, and the empty-width matches\b,\B,\<,\>,\`and\'.parse_regex_for_mode()now takes a POSIX parameter and emits the literal character for these escapes. The check comes beforeparse_char_escape(), otherwise\bis decoded as a backspace.BRE and ERE
The two modes need the opposite spelling of the same literal:
bre_to_ere()escapes the ERE metacharacters afterwards. Emitting\?would makebre_to_ere()turn it back into the operator.\?,\+and\|keep their backslash, since a backslash is already what makes them literals there. Emitting them bare would make them operators.The remaining escapes are letters and punctuation with no meaning of their own, so they are emitted bare in both modes.