Leaving the Land of Woo

A rational, sceptical look at the ideas of alternative medicine, food, religion, and the paranormal

  • Increase font size
  • Default font size
  • Decrease font size
General

Pseudoscience creeping into academic journals

E-mail Print PDF

Until recently, we could trust that academic scientific journals published papers from respected scientists which demonstrated a high standard of evidence and methodology.  As a result, the conclusions of these papers, often stated in cautious terms with appropriate caveats, represented reasonable judgements based on the presented evidence.  Before the papers were published, they would have been reviewed by other leading scientists of the field and perhaps the authors would have had to respond to pertinent questions and made corrections.

This peer review process is designed to achieve a high standard of published research, to ensure that unjustified claims were not made in print.  The problem is that once a paper makes it into the journal, it will be referenced by others who will quote the results and conclusions as reliable.  If they are not reliable, then nevertheless they will still be quoted as such.  Poor science when published will still be propagated widely.

We mentioned on this blog a recent case highlighted by PZ Myers on the Pharyngula blog in which the Southern Medical Journal was to publish a very poor paper on faith healing, in which no valid conclusions could be drawn at all.  I am still waiting for a response to an email I sent asking how such a lapse of publishing standards could occur and what their view was of the likely effect on their reputation.

Now, the wonderful Orac has found another instance, this time in the public access hournal PLoS ONE.  These guys are really committed to putting into the public domain medical research for ordinary folks who can't afford thousands of dollars in medical journal subscriptions, and who don't happen to have a public medical library on thier doorstep.  It's a laudable aim.  But now it seems they too have been caught out.

Orac's recent post looks at a paper claiming to have investigated impedance in intermuscular collagen bands, the idea surely being to look for evidence of the acupuncturist meridians - since there is no evidence for the existence of these meridians.  The study takes as an assumption that those meridians exist, and they are then going hunting for the evidence.  Their initial attempts failed, so they tried somewhere else and came up with - nothing.

Not to be put off, they tried to derive some comfort from statistical manipulation of the data.  They found a small correlation with a proposed site of the large intestine meridian, but here's the crucial point.  Instead of assuming that this variation correlated with their claimed meridian, they should take the presence of this anomalous reading and test a hypothesis derived from it, not the other way round.

In this case, there were very many reasons why any of their readings might have been anomalous, not least that the trial wasn't blinded.   They did at least realise that tissue thickness and varying echogenicity (the ability of tissue to bounce an echo) easily explained it.  So the paper showed nothing.

They went fishing to see if they could find any evidence consistent with their predetermined theory, and didn't.  In any case, you start with the data and derive your theory from that.  First the data, then the theory.  These guys start with their fanciful theory, that Orac calls fairy dust, and then go fishing for anything that they can quote to support it.

But the unfortunate fact is that once they get this sort of poor study published, all the other fairy dust collectors will quote it, in their blogs, in their own papers, in their press releases, in their advertising.  Unless journals like PLoS ONE keep to their high standards and reject this sort of low standard paper, the reputations of the journals themselves will become coopted into the marketing effort of Woo merchants.

Last Updated on Thursday, 02 September 2010 13:04
 

Vaccine scares and alt-med Woo

E-mail Print PDF

There are a great many people who react to campaigns urging vaccination with hostility to those who are trying to get them to act.  They are suspicious of any organisation that is trying to get them to do anything that they wouldn't do by choice.  In the US, they are suspicious of government actions which affect them, and they are suspicious of big corporations who use their lobbying power to promote vaccines.

It is understandable that there is massive suspicion of big pharma because whenever there is some perceived danger, such as bird flu, the pharmaceutical companies move into action, developing and promoting their highly profitable products.  And where there are connections with government however tenuous, such as the ownership of Gilead shares by Donald Rumsfeld, public suspicion rises further.

And of course, the alt-med community go to town on the idea that government is interfering in private choice because of the commercial interests of its members.  What then happens is rather curious because instead of looking at the evidence of risk, the nature of the actions being suggested, the likely benefits and costs, in other words rationally evaluating the situation, many alt-med enthusiasts decide to reject any and every aspect of the science.  It's all tarred with the same broad brush.

All vaccines become the tainted offerings of corrupt Big Pharma, every government health warming becomes a covert attempt to boost personal wealth, and every suggestion to take health precautions is rejected out of hand.  Instead of assessing the scientific evidence, alt-med takes advantage of the confusion to promote their alternative therapy.

They exploit the links between government and business to create a widespread rejection of the science itself, and in the process expand the market for their own untested and unevidenced products.

But it's not just the alt-med promoters who confuse the issue.  There are those who distrust medical opinion to the extent of challenging the effects of vaccines themselves, producing videos arguing that vaccines are dangerous, and that the potential effects should be weighed against any possible benefit.  They argue that the benefits are only potential, but the risks are real.  Of course, the statement could be reversed and still be as valid: the benefits are real and the risks are only potential.

It is important to be able to sort out the science from the marketing but these days it is increasingly difficult because those with political agendas also operate within science.  They create their own institutes, publish their own journals, teach their own courses, issue their own qualifications, and often manufacture their own evidence.  Sometimes the quality science is there, but often it is not.

For the lay person, the people with only high-school science behind them, it can be very confusing.  And when people reject government warnings because they no longer believe the government about anything, and when they can't inspect the science for themselves, they are easy prey to marketers.

Material from drug companies medicalising every trivial complaint through to government information about vaccines is rejected en masse.  Health warmings are seen as marketing and are therefore dismissed out of hand.  And the alt-med peddlars are ready in the wings to redirect the confused into their own market.

They use words like "natural" and "non-invasive" to persuade customers to not even think about the science.  They position their own irrational theories against those of some perceived monolithic science entity and argue that the whole of science is unable to help maintain human health.  And since science is now used as a marketing tool, scientific results are corrupted to conform to the required marketing message.  As a result, alt-med sounds as credible as anything else.

Of course it's not.  But it can sometimes be very difficult to refocus attention on the science itself.  As companies debase science and control the appearance of results which support their sales effort, confidence in the objectivity of clinical science falls and this serves to undermine public understanding of their own biology and the natural world.  A clinical trial sounds like some company finding the results it wants instead of a technique of basic clinical research.  As a result, many people are not even interested in considering the results themselves because they just don't believe them.

For the alt-med peddlars, this confusion is an excellent opportunity to appear radical and to ride the wave of public rejection of Big Pharma and disaffection from governments.  Politicians too struggle to deal with the confusion: witness the UK government's recent rejection of the evidence against homeopathy on the grounds that any voice in favour of homeopathy must represent some credible evidence.

Privately owned medical and scientific journals, alt-med institutes issuing their own bogus qualifications, commercially controlled trials, and the medicalisation of trivial complaints to boost product sales, all serve to undermine the objectivity of science.  We have to persuade people to recognise the value of the science whatever their view of politicians and the big medical companies might be.

Last Updated on Wednesday, 25 August 2010 11:42
 

Faith Healing creeps into medical journal

E-mail Print PDF

One of the ways in which we can judge the seriousness and authenticity of scientific research is if it has been peer-reviewed and published in a reputable scientific journal.  The peers doing the reviewing uphold strict scientific standards in which the evidence has to be completely independent  of the views of the researchers, the methodology has to be sound, and the conclusions have to be reasonably drawn from the presented evidence.

This filter mechanism performs a number of very positive functions.  It catches methodological errors and poor experiment design, it questions unreasonable conclusions, it highlights omissions in the data, it checks the statistical processing of results, and it ensures that the results as far as possible are free from bias.  That's why we take results published in reputable journals seriously.

But what happens when a journal accepts poor papers for publication which don't uphold those standards?  Sometimes poor work slips through and people write responses which identify the weaknesses, challenge the results, correct the mistakes, etc.  But by then, the poor quality paper is already in publication, being cited far and wide by those who have a vested interest in those biased conclusions.

PZ Myers, the man behind the absolutely excellent Pharyngula website, recently identified one such shoddy piece of work apparently being published in the Southern Medical Journal.  It claims to have trialled the effects of Proximal Intercessionary Prayer or PIP (that's praying nearby in common language) on vision and hearing.  Now there's nothing wrong with designing a trial to do this and testing the results.

We'd obviously need a group in which no PIP had occurred so that we had something to compare the results with.  We call that a control group and it's an absolutely fundamental part of any scientific trial. Without one, we can't conclude anything.   We'd also choose subjects at random so they didn't know if they were getting the real prayer or a fake, and we'd make sure the experimenters didn't know which was which either.  We call that double-blinding and it's an essential way to prevent bias.  All scientists know about these techniques and why they are essential.

But as PZ Myers shows in his assessment of the paper, it wasn't double-blind and didn't even have a control.  Instead, it was a self-selected group of devout Christians all of whom were biased in their belief in faith healing.  Normally such a paper would not even be considered for publication in a reputable journal so why is it due to appear in the September issue of the Southern Medical Journal?  Indeed, the authors were not scientifically trained at all but were theologians and the work was funded by the evangelical Templeton Foundation.  And yet the Southern Medical Journal is apparently publishing it.

When Woo marketers gain influence over the editorial decisions of reputable scientific journals, they are gaining a form of endorsement.  Of course, in the past Woo merchants have set up their own institutions, printed their own certificates, and teach their own Woo courses, and with a suitable "journal" title for their own publications, they try to project some appearance of academic respectability.

But a cheaper alternative for them is to persuade members of editorial boards of reputable journals, via their religious beliefs, to relax their scientific standards and permit utterly worthless papers to be published.  That gives them a means of piggy-backing on the scientific reputation of the journal built up over a long period of time by the genuine scientific standards previously followed.  Corrupting the journal editorial board is a cheap means of trying to get academic approval for work which even a high school student would have thrown out.

Shame on the Southern Medical Journal for allowing its standards to be lowered to such a derisory level!  If any of you are interested in getting in touch with them, there are two email addresses associated with the Southern Medical Journal:

This e-mail address is being protected from spambots. You need JavaScript enabled to view it   - Wendy Erhart who is also responsible for Corporate Relations

This e-mail address is being protected from spambots. You need JavaScript enabled to view it - Kathy Mclendon

I've written to them to ask about the paper and its likely effect on their journal's reputation given the appallingly bad methodology and questionable results of the faith-healing paper.  We'll see what they say.

Last Updated on Tuesday, 24 August 2010 14:05
 

Chiropractors regularly make false claims

E-mail Print PDF

Given the acrimonious, and failed, libel case raised by the UK chiropractors against Dr Simon Singh over the last two years, one might be forgiven for thinking that where there's smoke there's fire, and that perhaps, just perhaps, the chiropractors might have a case.  Dr Singh claimed that chiropractors were making unjustified medical claims that weren't supported by the evidence.

Now a paper has been published by Edzard Ernst and Andrew Gilbey in the Journal of the New Zealand Medical Association which puts figures on the scale of the deception. They carried out a review of 200 chiropractor websites and 9 chiropractic associations covering Australia, Canada, New Zealand, the UK and the US and looked at the claims they were making.  The study covered the period from 1.10.08 to 26.11.08 and investigated claims to treat asthma, headache/migraine, infant colic, colic, ear infections/earache/otitis media, neck  pain, whiplash, and lower back pain.

The only condition for which there is any sound evidence is in the case of lower back pain where it is equivalent to conventional physiotherapy.

The results were startling.  A total of 190 (95%) of the sites made unsubstantiated claims for at least one of the conditions.  When colic and infant colic were treated as one condition, a total of 76 (38%) made unsubstantiated claims about all of the conditions not supported by sound evidence.  All 9 of the associations, and 179 (90%) of the websites made unsubstantiated claims about headaches and migraines.  At least half of the websites carried unsubstantiated claims about asthma, ear infections, neck pain and whiplash.

As the paper rightly points out, this is a serious ethical and public health issue indicating that the standards of honesty amongst these practitioners is woefully inadequate.  People consulting a medical practitioner should at least be able to rely on the honesty of the claims being made but in the case of chiropractors, that simply cannot be done.

They continually make unjustified claims and it is clear that the associations that in some cases are trusted with a regulatory role, endorse these claims without appropriate evidence.

The full paper is freely available for public view here.  Please repost the link and spread the news.  Chiropractic is just not to be trusted because the majority of them are known to make false claims.

 

Prince's alt-med accountant jailed

E-mail Print PDF

George Gray, the accountant in charge of the Prince of Wales' Foundation for Integrated Health, the body that promotes the ludicrous homeopathy nonsense, has been given a three year jail sentence for pocketing £253,000.

Ironically he was done for fraud but the Foundation itself, which was promoting homeopathy known to be a complete nonsense, was not.  Surely the Foundation for Integrated Health ought to have been taken to court for promoting non-existent medical treatments?

The Foundation for Integrated Health has now been wound up to be replaced by something dishonestly called the College of Medicine, which is neither a true college for has anything really to do with medicine.  This digracefully named organisation will carry on the work of promoting alt-med untested and unproven treatments and although the Prince claims to have nothing to do with it, four of the directors of the now defunct Foundation, are also directors of the new college.

How long will it be before these charlatans promoting fake medical treatments get their claims challenged in a court of law? We know that when such claims are challenged, folks like Simon Singh can end up in court defending themselves.  In a rational world, it would be unacceptable to promote treatments without a peer-reviewed body of convincing evidence of efficacy to support it.

It is to be hoped that the financial pressures on the NHS will at least focus attention on the absurdity of having a state-sponsored homeopathic hospital in London.  Turning that into a real hospital and getting shot of the fantasy merchants would at least be a step in the right direction. 

 
  • «
  •  Start 
  •  Prev 
  •  1 
  •  2 
  •  3 
  •  4 
  •  5 
  •  6 
  •  7 
  •  Next 
  •  End 
  • »


Page 1 of 7

Bob Lloyd Bob Lloyd has studied in four universities and has degrees in Biochemistry, Mathematics, and Computer Science.  After a long career in publishing, teaching, and software engineering, he is now retired and lives in Andalucia in the South of Spain with his wife and rather ancient cat.