[kwlug-disc] weird characters in files

Insurance Squared Inc. gcooke at insurancesquared.com
Thu Dec 10 14:47:14 EST 2009

I've got some 'text' files created by an OCR program.  Some of the text 
files have the occassional weird character in them that is causing 
issues when I import.  How can I get rid of them from the command prompt?

When I 'nano' one file, it shows a question mark with a white 
background.  When I view the file with vi, not that I use vi :) , I see 
<97> where the character is - probably the decimal representation.

I tried "perl - p -i -e 's/?//g' *" and "perl -p -i -e 's/\<97\>/g' *" 
as a search and replace but neither removed the character from the 
file.   Grep doesn't find the characters either. 


More information about the kwlug-disc mailing list