Remove ^H and ^M characters from a file using Linux shell scripting

How do I remove ^H and ^M characters from a file using Linux shell scripting?

^[[0^H ^H^H ^H^H ^H^H ^H^H ^H^H ^H^H ^H^H ^H   rcv-packets: 0
^[[0^H ^H^H ^H^H ^H^H ^H^H ^H^H ^H^H ^H^H ^H      rcv-errs: 0
     rcv-d开发者_StackOverflow中文版rop: 0
     rcv-fifo: 0
     rcv-frame: 0

What you're seeing there are control characters, you simply could delete them with tr

cat your_file |
tr -d '\b\r'

this is better:

tr -d '\b\r' < your_file

Two methods come to mind immediately:

• tr -d control+v control+h
• sed 's/control+v control+h//g'

Here's both in action:

$ od -c test
0000000  \b   h   e   l   l   o  \b   t   h   e   r   e  \b  \n
0000016
$ sed 's/^H//g' < test | od -c
0000000   h   e   l   l   o   t   h   e   r   e  \n
0000013
$ tr -d ^H < test | od -c
0000000   h   e   l   l   o   t   h   e   r   e  \n
0000013

For removing ^M characters appearing at the end of every line, I usually do this in vi editor.

:%s/.$//g

It just removes the last character of every line irrespective of what the character is. This solved my provlem.

Use sed utility. See below as per examples:

sed 's/%//' file > newfile
echo "82%%%" | sed 's/%*$//'
echo "68%" | sed "s/%$//" #assume % is always at the end.

You can remove all control characters by using tr, e.g.

tr -d "[:cntrl:]" file.txt

To exclude some of them (like line endings), check: Removing control characters from a file.

if you want to change original file, do this:

sed -i '.bak' 's/^M//g ; s/^H//g' test.md

(^M is control+v control+m)
(^H is control+v control+h)

much file, you can do this:

find source -name '*.md' | xargs sed -i '.bak' 's/^M//g ; s/^H//g'