[kwlug-disc] weird characters in files
Insurance Squared Inc.
gcooke at insurancesquared.com
Thu Dec 10 14:47:14 EST 2009
I've got some 'text' files created by an OCR program. Some of the text
files have the occassional weird character in them that is causing
issues when I import. How can I get rid of them from the command prompt?
When I 'nano' one file, it shows a question mark with a white
background. When I view the file with vi, not that I use vi :) , I see
<97> where the character is - probably the decimal representation.
I tried "perl - p -i -e 's/?//g' *" and "perl -p -i -e 's/\<97\>/g' *"
as a search and replace but neither removed the character from the
file. Grep doesn't find the characters either.
More information about the kwlug-disc