75

I'm trying to use sed to substitute all the patterns with digits followed immediately by a dot (such as 3., 355.) by an empty string. So I try:

sed 's/\d+\.//g' file.txt

But it doesn't work. Why is that?

110

Because sed is not perl -- sed regexes do not have a \d shorthand:

sed 's/[[:digit:]]\+\.//g'

sed regular expression documentation here.

  • 3
    That's if you want zero or more digits. /[[:digit:]]*\. / will match the string foo. because you allow for zero digits. If you want one or more use \+ as shown – glenn jackman Mar 2 '16 at 11:19
71

Two problems:

  1. sed does not support \d. Use [0-9] or [[:digit:]].

  2. + must be backslashed to get the special meaning: \+.

  • 6
    instead of backslashing the + (which doesn't work on Mac OS X, for example) you can use the -E option to interpret regular expressions as extended (modern) regular expressions rather than basic regular expressions (BRE's). Sadly, this doesn't help with the \d issue... – gMale Aug 6 '13 at 1:01
  • 4
    @gmale: -E does not work for GNU sed, it uses -r instead. – choroba Aug 6 '13 at 6:54
  • 12
    Okay... it sure looks like sed just sucks when it comes to portability... – iconoclast Jul 14 '14 at 15:16
  • @choroba I think I confused myself today. I'm going to delete my noisy comments... – Steven Lu Jun 28 '18 at 21:47
  • Basically, what I was trying to warn people about is: If you do not use extended regex (-E on BSD sed and -r on GNU sed), in BSD sed, neither + nor \+ (same with ?) will work at all, whereas in GNU sed you can get them to work with the backslash. Hence the common recommendation to use extended regex in scripting – Steven Lu Jun 28 '18 at 21:55
3

The sed man page references the re_format man page. It makes 2 distinctions: (1) obsolete versus extended regular expressions; (2) non-enhanced versus enhanced regular expressions. All 4 combinations are possible. There is support in sed for both obsolete and extended, but in either case only for non-enhanced. The \d operator is a feature of enhanced regular expressions, therefore not supported by sed.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.