You would have to be dead not to realise that the major story today is the contamination paper, Salter et al, available here. Read more about it here and here, including quotes from me. I’ve been banging on about this paper for a while now, and arguably I think it’s more important than the authors do!
As I said in Ed Yong’s Nat Geo piece, Salter et al isn’t just about contamination in microbiome studies, it is about how we behave as scientists. Did we learn nothing from the XMRV fiasco? Apparently not, because we are still finding probable contaminants and insisting they’re implicated in varied diseases such as HIV, cancer, sleep apnoea and stupidity.
My point is this: in any experiment (not just microbiome), and especially experiments involving deep sequencing, if you find something incredible, then it probably is exactly that (below is the definition of incredible, by the way) – “unconvincing; far fetched; hard to believe; scarecely credible” etc etc
Yesterday, I presented at NGS Sheffield, and this is what I said about contamination:
If you travel to Mars, and upon your return, feel ill; you subsequently undergo a sequencing test that suggests you are infected with a virus from Venus; the conclusion should not be “Venusian virus found on Mars!”; rather, the question should be “have any of my lab been to Venus?” and “Could any of my reagents include anything Venusian?”
In other words, when you find something that flies in the face of all previous evidence, or which defies belief, then the onus is on you to prove it is not a false positive. Sometimes I think researchers are too quick to pick up the phone to Nature and Science – because incredible results get high impact papers, and to hell with the idea that it might not actually be true.
To torture another metaphor, the infinite monkey theorem states that an infinite number of monkeys hitting keys at random on a keyboard will eventually type the complete works of Shakespeare. Well, with current high-throughput sequencing technologies, we are approaching the equivalent of infinite monkeys, which means occasionally you’re going to find something that looks like Shakespeare. It isn’t though, and we all need to be big enough to admit that our perfect results might turn out to be complete crap.