[kwlug-disc] wget and variable assignment

Richard Weait richard at weait.com
Thu Jun 3 12:58:15 EDT 2010


I have a simple screen-scrape to do.

>From the command line it works fine

wget -q -O - http://www.openstreetmap.org/stats/data_stats.html| grep
"<td>Number of users" | sed -e 's/[:a-zA-Z <>/:]//g'

it returns the plain number

262086

Cool, now to add it to a script

This works fine
GETTEE=`wget -q -O -
http://www.openstreetmap.org/stats/data_stats.html| grep "<td>Number
of users" | sed -e 's/[:a-zA-Z <>/:]//g'`
echo "GETTEE = $GETTEE"

gives:
GETTEE = 262086

But.  I want to grab some other data from the same page, so I want to
wget once, then grep / sed a couple of times.  And I'm breaking it.
The page appears to have been stripped of its \n and so grepping the
line I want is failing.

GETTEE=`wget -q -O - http://www.openstreetmap.org/stats/data_stats.html`
echo "GETTEE = $GETTEE"

This returns a mess.

The quick and dirty is to wget four times for four numbers, but I
don't want to do that.  How do I assign the wget to a variable and
keep \n ?



More information about the kwlug-disc_kwlug.org mailing list