A couple interesting quotes from the Hadoop user list. Not indicative of anything in particular, but noteworthy.
Another dimension is redundancy; we have had a long running [Hadoop] setup downloading and parsing blogs posts. Only very recently was it noticed that one of our machines was in fact dead. The show still went on and nothing was lost-- Miles Osborne
Regarding Hadoop cluster vs. grep and sort...
we concatenated the files to bring them close to and less than 64mb and the difference was huge without changing anything else we went from 214 minutes to 3 minutes !-- Elia Mazzaw
Leave a comment