I am trying to clean an email list with huge data.
When I try this:
pv "Email-Raw.txt" | grep -vf <(sed 's/^/^/; s/$/$/' Segment00.txt) > RESULT-1.txt
grep: memory exhausted
How do I solve this? Please help.
As, in this case, I wanted to match the EXACT MATCH of the whole line, I solved it by modifying the command to -
pv "Email-Raw.txt" | grep -vxFf Segment00.txt) > RESULT-1.txt
Note: this may not work if you partially want to match text in each line.