100

I'm trying to use sed to substitute all the patterns with digits followed immediately by a dot (such as 3., 355.) by an empty string. So I try:

sed 's/\d+\.//g' file.txt

But it doesn't work. Why is that?

141

Because sed is not perl -- sed regexes do not have a \d shorthand:

sed 's/[[:digit:]]\+\.//g'

sed regular expression documentation here.

| improve this answer | |
  • 4
    That's if you want zero or more digits. /[[:digit:]]*\. / will match the string foo. because you allow for zero digits. If you want one or more use \+ as shown – glenn jackman Mar 2 '16 at 11:19
  • 2
    Not very regular then, is it? – Cameron Hudson Feb 12 at 17:54
85

Two problems:

  1. sed does not support \d. Use [0-9] or [[:digit:]].

  2. + must be backslashed to get the special meaning: \+.

| improve this answer | |
  • 11
    instead of backslashing the + (which doesn't work on Mac OS X, for example) you can use the -E option to interpret regular expressions as extended (modern) regular expressions rather than basic regular expressions (BRE's). Sadly, this doesn't help with the \d issue... – gMale Aug 6 '13 at 1:01
  • 6
    @gmale: -E does not work for GNU sed, it uses -r instead. – choroba Aug 6 '13 at 6:54
  • 16
    Okay... it sure looks like sed just sucks when it comes to portability... – iconoclast Jul 14 '14 at 15:16
  • @choroba I think I confused myself today. I'm going to delete my noisy comments... – Steven Lu Jun 28 '18 at 21:47
  • 1
    Basically, what I was trying to warn people about is: If you do not use extended regex (-E on BSD sed and -r on GNU sed), in BSD sed, neither + nor \+ (same with ?) will work at all, whereas in GNU sed you can get them to work with the backslash. Hence the common recommendation to use extended regex in scripting – Steven Lu Jun 28 '18 at 21:55
4

The sed man page references the re_format man page. It makes 2 distinctions: (1) obsolete versus extended regular expressions; (2) non-enhanced versus enhanced regular expressions. All 4 combinations are possible. There is support in sed for both obsolete and extended, but in either case only for non-enhanced. The \d operator is a feature of enhanced regular expressions, therefore not supported by sed.

| improve this answer | |
0

Adding to the other answers a few years later, I found I wanted the extended feature for a more complex regex

This expects simply + for one or more, and generally made the string more obvious to me for both my case and this one

# NOTE \d is not supported
sed --regexp-extended 's/[0-9]+\.//g'

-E -r --regexp-extended are all the same

Using sed 4.7

| improve this answer | |

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.