Track your comments!
[x]


When you register, comments on your articles and replies to your comments appear here. Register Now!

Sign in to your account
[x]

Not a Scientific Blogging member yet?

Register Now for a Free Scientificblogging.com Account

  • Customize your profile with pictures, banner, a blogroll and more.
  • Leave comments on articles, add other members to your friend lists, chat with people on the site.
  • Write blog posts that can be seen by hundreds of thousands of readers.

It's free and it only takes a minute!

Already a Scientific Blogging member?

Sign In Now

Banner
By Ben Morrish | October 5th 2009 02:20 PM | 12 comments | Print | E-mail | Track Comments
.

More All True articles

All

About Ben Morrish

I'm a skeptical 30-something, and interested in popular science, and popularizing science.

I am particularly interested in evolutionary science and cosmology, with a view to seeing the best answers... Full Bio

To test whether my belief that homeopathy is not an evidence-based rational system of medicine is reasonable or just prejudice on my part, I did a quick experiment using Google Scholar. (This was done Jan 17, 2008)

A "layman's meta-analysis" of sorts. Not supremely scientific alas (although perhaps somewhat reminiscent of a GCSE science project ;) ), but the best I could do early in the morning with only vending-machine coffee to keep my brain from sleep ;-) 

The Setup
The basics of the test were as follows:

1. Search for homeopathic trials in Google Scholar (using a neutral search term) - I used "homeopathy trial"

2. Look at the conclusions of the first 10 results to come back (I don't know how Google Scholar prioritises results, so hopefully there's no bias either way in picking the first 10).

I'm taking the first 10 results regardless of what specific remedy or ailment is being tested,  I have no way of knowing if there's certain ailments homeopathy is better or worse for, and no way of knowing what ailments will come up, so I think this is as fair as I can make it. If there's any duplicates, I'll ignore them and take the next one.

3. Categorise each result into 3 broad categories:

    Negative - no statistically significant evidence that homeopathic medicine was more effective than placebo

    Positive - statistically significant evidence that homeopathic medicine was more effective than placebo

    Neutral - no conclusive result either way, or indication of problems with the trial that could make the results meaningless


4. Having sorted out the results into the categories, I'll look at the results and see if my belief that homeopathy isn't supported by reasonable evidence is fair or just "out of hand" dismissiveness on my part.


Having set up the experiment, I entered the search term into Google Scholar and took the first 10 results and categorised them based on their stated conclusions:


POSITIVE - statistically significant evidence that homeopathic medicine was more effective than placebo

http://pediatrics.aappublications.org/cgi/content/abstract/93/5/719
(small scale single trial, concluded more research needed)

http://www.pidj.org/pt/re/pidj/abstract ... 29!8091!-1
(small scale single trial, concluded more research needed)

NEGATIVE - no statistically significant evidence that homeopathic medicine was more effective than placebo

http://archsurg.highwire.org/cgi/conten ... 33/11/1187
(meta-analysis, fairly large scale, conclusively says no effect)

http://www.clinicalpain.com/pt/re/clnjp ... 28!8091!-1
(medium scale, conclusively says no effect)

http://thorax.bmj.com/cgi/content/abstract/58/4/317
(small scale, no significant effect)

http://www.jrsm.org/cgi/content/abstract/96/2/60
(small scale, no significant effect)

NEUTRAL - no conclusive result either way, or indication of problems with the trial that could make the results meaningless

http://www.sciencedirect.com/science?_o ... 7efe96eb7d
(small scale, no significant effect, but "further research is justified")

http://www.sciencedirect.com/science?_o ... 5e704b40fd
(slight positive effect in one specific area, no significant effect in others, limited number of patients observed and the posology employed could have interfered with the significance of the results.)

http://rheumatology.oxfordjournals.org/ ... t/39/7/714
(semi-positive. medium scale, positive results in that homeopathic gel was as good or better than the conventional one, but "The presence of a clinically relevant difference between treatment groups cannot be excluded"))

http://www.sciencedirect.com/science?_o ... cd1f237978
(semi-negative. no significant effect but mentions "complexity theory" as a possible factor in future trials)

Which gives us the final scores as follows:

RESULTS:

Positive (in favour of homeopathy) - 2

Negative (indicating homeopathy is ineffective - 4

Neutral (not conclusive either way) - 4

Conclusion:   In conclusion, I think that, with 40% of the results strongly indicating homeopathy is ineffective, and with only 20% demonstrating a statistically significant effect in favour of homeopathy, I think my belief that homeopathy is ineffective is reasonable and my dismissal of homeopathy isn't merely "out of hand".

Of the cases that showed a positive effect for homeopathic treatment, none of them indicated a really strong positive effect, just a statistically significant one.  Both of the cases showing a positive result for homeopathy concluded that "more research was needed".

In light of the fact 40% of cases were in the neutral category, I'd conclude that more research is needed to give a stronger answer as to whether homeopathy is effective, but from the evidence so far, it seems it isn't.

What do you reckon? Was this a fair test to check if I was prejudiced, or was it a total waste of time given that I chose which category to put each result into? ;)


Comments

Hank's picture
What do you reckon? Was this a fair test to check if I was prejudiced, or was it a total waste of time given that I chose which category to put each result into?

It's as accurate a methodology as every homeopathy endorsement study I have ever seen but maybe my real memory, like water memory, is a little weak.

alltruism's picture
And water memory is just one of the many non-evidenced-based things that have to be conjured up for homeopathy to even potentially work.
After that, a mechanism for the transfer of the water's memory to the sugar pill needs to be invented.

And then we'd a mechanism for that memory to transfer through the digestive system into the body, and then we need a further mechanism for that "memory" to interact with the disease / "negative energy" / immune system so as to cure the patient or at least relieve the symptoms.

One nonsense leads to another.... :)

Gerhard Adam's picture
It wasn't a total waste of time, since it confirmed that I was too lazy to follow-up on your results and simply accepted your conclusions.

Not a great test - I think you need an inclusion criteria for the trials. If you ignore small scaler trials, and ones that are not blinded or randomised then this would be a fairer test.

This would of course bring you to the same conclusion - that it's bunk.

Well, first off, I'd say that getting a web bot to cherry pick reports of experiments performed by technicians and written up by ghost writers cherry picked by vested interests to cherry pick data that tells them what they want to know is hardly what I'd call fair, scientific or anything else but downright misleading. (see Ben Goldacre on this).

Secondly, on the Memory of Water issue, when are you guys going to get out of the 18th century and read this paper by the co-discoverer of HIV, 2008 Nobel Prize winning virologist, Luc Montagnier:

http://www.homeopathyeurope.org/downloads/MontagnierElectromadneticSigna...

He even sites Jacques Benveniste for chrissakes! He needs to be treated with the same contempt as Benveniste and kicked out of the lab for good.

Well what about going to a homeopath when you are sick and see what the results bring you? Often if you observe something it will act differently so if you go to a homeopathic website you will be able to find 100% of homeopathic studies both clinical and trialed and you will get a much better understanding of what is out there. I know that because there are more than 10 studies done on homeopathy.

alltruism's picture
I've been to see homeopaths, 3 in fact. No beneficial results. Thankfully I didn't have to pay :)

If I go to a homeopathic website I will usually find either no studies, or an extremely biased selection of trials with slight positive results (and many flaws).

By just taking the first 10 results from Google Scholar I was just seeking to remove any human bias in the selection of which studies to look at.

@Ben Morrish
I've been to see homeopaths, 3 in fact. No beneficial results.

Francis Bacon, the Enlightenment and every scientist from Galileo to Feynman would have said that personal experience is THE ONLY acceptable form of scientific evidence. Happily, lawyers and lobbyists from the international drug cartels that now dominate the education and employment of scientists, the publication of scientific papers and government science policy, have succeeded in having personal experience classed as "anecdotal" and ruled out of court.

Unfortunately, Chair of NICE, Sir Michael Rawlins, let slip his opinion in a lecture to the Royal College of Physicians last year that, ‘RCTs, long regarded as the ‘gold standard’ of evidence, have been put on an undeserved pedestal.'

Fortunately, lawyers and lobbyists from the international drug cartels are making significant progress in having that statement reversed.

Thankfully I didn't have to pay :)

Professionals charge for their services. Amateurs do it for nothing. If you didn't have to pay, what else can you expect?

If I go to a homeopathic website I will usually find either no studies, or an extremely biased selection of trials with slight positive results (and many flaws).

1) If you don't think that's even more true of drug cartel dominated websites you need to read more Ben Goldacre.

2) At least one of the world’s top-selling drugs, Prozac, has been shown to be no better than placebo. That's less than just a slight effect, so why aren't you citing that as a reason for the rejection of drug cartel dominated pharmacology?

By just taking the first 10 results from Google Scholar I was just seeking to remove any human bias in the selection of which studies to look at.

No. You are are ignoring the bias that comes from the international drug cartels spending a large portion of their mind-boggling profits on financing science education and experts; lab technicians and drug trials; ghost-writers, scientific publications and websites; PR agencies and lobbyists; and press and political junkets and inducements of every description; to make sure they appear in the top 10 of Google's page rank.

Against that kind of marketing and PR machinery, and with the three 'homeopaths you visited charging nothing and therefore having no profits to finance a counterbalancing PR and lobbying campaign of their own, then a result of '20% demonstrating a statistically significant effect in favour of homeopathy' is nothing short of amazing.

I note that you have so far failed to comment on Nobel Prize winning virologist Luc Montagnier's recent discoveries that pathogenic bacteria and viruses show a distinct electromagnetic signature at homeopathic dilutions ranging from 10^-5 to 10^-12 and possibly even up to 10^-18. If true, this would provide a firm theoretical foundation for the "spirit-like" essence "no longer perceptible to the senses" that Samuel Hahnemann discovered by experiment 70 years before James Clark Maxwell first postulated the electromagnetic field. It would also support the more recently postulated Memory of Water effect AND Jacques Benveniste's most far-flung speculations, that this effect may be transmitted over the phone lines.

Mercifully, thanks to the ground-breaking lab-work of the eminent conjurer James Randi; the marketing of the drug cartel's through mass media vehicles like Nature, the Guardian and the BBC; the closure of university science departments and the dumbing-down of science GCSEs; we have wasted very little of the past ten years trying to build on Benveniste's discoveries. Instead we have chosen to expend most of our resources ladling the likes of Benveniste with contempt whilst elevating bankers who understood squat about economics to the position of masters of the universe, and promoters of 'popular' science, who have no significant scientific discoveries to their names and are sceptical of everything except themselves, to the position of scientific gods.

That's science Ben, but not as Francis Bacon would have know it.

alltruism's picture

The "Big Pharma" thing has nothing to do with homeopathy (even if all "Big Pharma" products were ineffective and dangerous, which they aren't, that would tell us nothing about homeopathy), yet it always seems to get brought up when the value of homeopathy is questioned.

"Big pharma" has nothing to do with what I wrote. Attacking "Big Pharma" does not help the case FOR homeopathy one bit.

The frequency with which discussions about the effectiveness / ineffectiveness of homeopathy get derailed with attacks on "Big Pharma" suggests that the case FOR homeopathy isn't all that strong, so an attack on something else has to stand in for it.

A discovery that pathogenic bacteria and viruses show a distinct electromagnetic signature in "homeopathic" circumstances doesn't really help homeopathy, at least not without a lot of further discoveries showing the significance of that signature on health, a way to overturn the findings of the trials in which homeopathy has been shown to be ineffective or at best minimally effective, and some large scale, well conducted trials that show a positive effect for homeaopthic treatments, above placebo.

Bacteria and viruses themselves (never mind their electromagnetic signatures) would have been "no longer perceptible to the senses" and "spirit like" to Hahneman as he had no means to detect them effectively, and who in any case believed disease to be caused by miasms - "peculiar morbid derangements of the [internal] vital force" - rather than physical, external entities.

The homeopaths I saw were all professionals, at least one of them was very highly regarded in the homeopathic community.  I didn't explain why I didn't have to pay, but that doesn't allow us to reach the conclusion that the homeopaths I saw were amateurs.

Of course, I don't think an amateur homeopath would be any worse than a professional one, as they are all limited by the ineffectiveness of the remedies they prescribe.

You bring up Ben Goldacre as an authority against "Big Pharma", but didn't mention his stance on the topic we're talking about - homeopathy. Here's the intro to a piece of his on homeopathy:


A kind of magic?


Time after time, properly conducted scientific studies have proved that
homeopathic remedies work no better than simple placebos. So why
do so many sensible people swear by them? And why do homeopaths
believe they are victims of a smear campaign? Ben Goldacre follows a
trail of fudged statistics, bogus surveys and widespread self-deception



The full story is here: http://www.guardian.co.uk/science/2007/nov/16/sciencenews.g2
Am I supposed to read more of his stuff about "Big Pharma" and yet ignore his scathing stuff about homeopathy?


As to Prozac, which is of course not homeopathic and so not really relevant to my post, I'll include a quote from wikipedia (which can be verified elsewhere):
A meta-analysis published in February 2008 combined 35 clinical trials of four newer antidepressants (fluoxetine, paroxetine (Paxil), nefazodone (Serzone) and venlafaxine
(Effexor)).

These antidepressants belonging to three different
pharmacological groups were considered together, and the authors did
not analyze them separately.

The authors concluded that "although the
difference [between the placebo and antidepressants] easily attained statistical significance", it did not meet the criterion for clinical significance, as used by National Institute for Health and Clinical Excellence (UK), "for any but the most severely depressed patients."[54]

Some articles in the press using the titles "The creation of the Prozac myth"[55] and "Prozac does not work in majority of depressed patients"[56][57]
presented these general findings about the relative efficacy of
antidepressants and placebo as the findings about ineffectiveness of
fluoxetine.

In a follow-up article, the authors of the meta-analysis
noted that "unfortunately, during its initial coverage, the media often
portrayed the results as “antidepressants do not work”, which
misrepresented our more nuanced pattern of findings".

"The "Big Pharma" thing has nothing to do with homeopathy (even if all "Big Pharma" products were ineffective and dangerous, which they aren't, that would tell us nothing about homeopathy), yet it always seems to get brought up when the value of homeopathy is questioned."

I said absolutely nothing about "Big Pharma", Nor did I attack it. I simply drew attention to the fact that the international drug cartels pour immense funds into financing scientific education, research, press and public relations and political lobbying.

A rough estimate of the true extent of this can be gained from NHS statistics which show that, in 2007, out of a total drug prescription budget of £5,350,000,000, only £321,000 was spent on homeopathic prescriptions. Having received only 0.006% of the revenue of the their non-homeopathic competitors, its reasonable to assume that the volume of research, PR and political lobbying and associated Google page ranking would be in similar proportion.

The fact that you begin by setting up a Straw Man you call "Big Pharma", swiftly followed by the bald assertion that this "has nothing to do with homeopathy", without offering anything in the way of evidence of rational argument to support your case, shows that you are no lover of the scientific method.

Your assertion that "Big Pharma" products are neither ineffective nor dangerous is a gross generalisation which has no place in scientific enquiry.

Your attempt to cast my statements of empirically verifiable fact as an "attack" on "Big Pharma" shows an eagerness to drag the discussion into the gutter of of the worst kind of mud slinging tabloid journalism, which has nothing to do with science.

The frequency with which discussions of the scientific basis of homeopathy get derailed by this kind of hot headed, narrow minded jingoism suggests some kind of paranoid witch hunt, and good reason to believe that this thing you call "Big Pharma" may have something it needs to hide.

I'm well aware of Ben Goldacre's "A kind of magic?" I read it when it was first published two years ago. But that's old news. Science has moved on a lot since then. You may prefer to remain in the dark ages of 18th century chemistry, but my money says Uncle Ben won't.

Only those with very little understanding of science and a complete lack of imagination will have difficulty understanding the possible implications of pathogenic electromagnetic signals on health.

Only those who have no love of science and are blinded by narrow minded prejudices to the true facts will not see that demanding electromagnetic effects overturn the findings of tests to detect chemical ones is as nonsensical as demanding a television programme overturns the results of a urine test.

To say that Hahnemann had no means of detecting a "spirit-like" essence "no longer perceptible to the senses" because he had no means of detecting bacteria and viruses is as nonsensical as saying Rutherford had no means of detecting the nucleus because he didn't have Large Hadron Collider. Thankfully, both Rutherford and Hahnemann understood that the scientific method is a means of detecting hidden causes by a process of experimental design and deduction. Obviously you don't.

Hahnemann's hypothesis of miasms - "peculiar morbid derangements of the [internal] vital force" - sounds suspiciously like electromagnetic signatures to me. Refusing to accept that Hahnemann's could have detected the effects of electromagnetic signatures because he couldn't detect the external physical entities that generated them is as nonsensical as saying you can't detect radio signals if you haven't seen the transmitter, or you can't eat a chicken curry if you haven't seen the egg.

I have no doubt that in a follow-up article, the authors of the meta-analysis of trials of fluoxetine et al were at great pains to stress the "unfortunately, during its initial coverage, the media often portrayed the results as “antidepressants do not work”, which misrepresented our more nuanced pattern of findings". I don't know what "more nuanced pattern" they mean exactly, but I can make on educated guess.

What I do know is that three weeks ago, Wired magazine revealed that the increasing effect of placebo and proportionally decreasing effectiveness of tdrugs is something the international drug cartels have known about for a whole decade, but have been at great pains to keep under wraps.

http://www.wired.com/medtech/drugs/magazine/17-09/ff_placebo_effect?curr...

I also know that neither Ben Goldacre, who has made placebo his thing, nor any other of the mainstream press have chosen to make much of this. That is one of those scientifically verifiable facts that many of us consider significant. Though obviously you will fail to see what it has to do with anything.

I could go on. But your obvious lack of enthusiasm for the possibilities opened up by Montagnier's work, and eagerness to drag it down into the gutter of misinformation, sophistry and rhetoric is a depressing reminder that where once science was the realm of open minds, now it is the domain of closed ones.

alltruism's picture
"I said absolutely nothing about "Big Pharma"

Yes, you did, you just referred to it as "international drug cartels". "Lawyers and lobbyists from the international drug cartels that now dominate the education and employment of scientists" is what "Big Pharma" means.

"Your assertion that "Big Pharma" products are neither ineffective nor
dangerous is a gross generalisation which has no place in scientific
enquiry"

I did not make that assertion. I asserted that not ALL "Big Pharma" products are ineffective AND dangerous. I think that is a reasonable assertion to make, and indeed I have personal experience of some "Big Pharma" products, and some of them were effective for me (although I don't consider

"I'm well aware of Ben Goldacre's "A kind of magic?" I read it when it
was first published two years ago. But that's old news. Science has
moved on a lot since then."

What relevant bits of science have "moved on a lot"? Is homeopathy now accepted by science?
The piece is still perfectly relevant today.

Once again you go on with the derail, talking about "Big Pharma" and linking to an a Wired article about placebo and decreasing effects of conventional drugs. That doesn't have anything to do with homeopathy (unless you believe as I do that homeopathy is a placebo).

You rather rudely state "though obviously you will fail to see what it has to do with anything": and true enough, I don't, but it seems the majority the scientific community fails to see any relevance either (unless homeopathy is now accepted by most scientists?), so I'm at least in good company!

"kind of hot headed, narrow minded jingoism suggests some kind of paranoid witch hunt"

This kind of hostile, emotive language strongly suggests that you are not looking for a rational scientific discussion, but an emotion-drive confrontation.

Countless trials have been done and failed to provide evidence that homeopathy is effective.

You have presented no new science that changes the outcomes of the trials referred to by Ben Goldacre, no new information which calls the reliablity of those trials into question, and no new trials that DO support the effectiveness of homeopathy above placebo.

Montagnier's work is interesting, and may lead to something useful, but it can't change the demonstrable (and demonstrated) ineffectiveness of homeopathy.
 
The only thing that could do that would be trials that demonstrate that homeopathy is effective, and preferably also an explanation for why the previous trials failed to detect that.

Even if we could come up with a plausible scientific mechanism by which homeopathy could operate (and sure, Montagnier's work could possibly be a step towards doing that), that wouldn't matter if the evidence continues to point to its lack of effectiveness.




""Lawyers and lobbyists from the international drug cartels that now dominate the education and employment of scientists" is what "Big Pharma" means."

No. As the father of modern chemistry, Antoine-Laurent de Lavoisier, said in his "Traité Elémentaire de Chimie" in 1790, "We think only through the medium of words.... The art of reasoning is nothing more than a language well arranged."

I said "Lawyers and lobbyists from the international drug cartels that now dominate the education and employment of scientists".

You said, "is what "Big Pharma" means" which is ignoring what I said and putting false words into my mouth.

I asserted that not ALL "Big Pharma" products are ineffective AND dangerous.

Fair enough. I'll buy that. So what are we saying here exactly? The majority of? Some of? The minority of? what you call "Big Pharma's" products are ineffective and dangerous. You tell me and we can take it from there.

What relevant bits of science have "moved on a lot"?

Montagnier's recent discoveries, Wired's recent discoveries, Ben Goldacre recent revelations and Richard Dawkin's recent attempts to recast "The Selfish Gene" as an argument for cooperation and altruism. Do you need more?

Once again you go on with the derail, talking about "Big Pharma" and linking to an a Wired article about placebo and decreasing effects of conventional drugs. That doesn't have anything to do with homeopathy (unless you believe as I do that homeopathy is a placebo)

"Belief" has nothing to do with science. Anybody who talks about belief without providing the evidence fails Science 101.Your assertion that this means homeopathy is a placebo is a non sequitur.

"You rather rudely state "though obviously you will fail to see what it has to do with anything": and true enough, I don't

A scientist would not seek to pervert an accurate description with the addition of emotive and pejorative terms like "rude".

"but it seems the majority the scientific community fails to see any relevance either (unless homeopathy is now accepted by most scientists?), so I'm at least in good company!

Sure enough. You're in the "good" company of a scientific community bought-and-paid for by the international drug-pushing cartels. "Everybody stays friends, everybody gets paid, everybody has a f***ing future." Bully for you.

http://www.guardian.co.uk/media/organgrinder/2009/apr/29/wire-episode-11...

"hot headed, narrow minded jingoism suggests some kind of paranoid witch hunt"
This kind of hostile, emotive language strongly suggests that you are not looking for a rational scientific discussion, but an emotion-drive confrontation.

Er. No. "Paranoia" and "Witch Hunts" are well-documented in the scientific literature. Setting up Straw Men and putting words like "Big Pharma" and "attack" into my mouth are well understood indications of both conditions.

"Countless trials have been done and failed to provide evidence that homeopathy is effective"

Add the caveat that "countless trials conducted under an agenda laid down by the vested interests of the international drug-pushing cartels" and I'd agree with you.

Even if we could come up with a plausible scientific mechanism by which homeopathy could operate (and sure, Montagnier's work could possibly be a step towards doing that), that wouldn't matter if the evidence continues to point to its lack of effectiveness.

Fair enough. My money says that in 5 year's time you'll be singing from a different hymn sheet. What does your money say?

Add a comment

The content of this field is kept private and will not be shown publicly.
  • Allowed HTML tags: <sup> <sub> <a> <em> <strong> <center> <cite> <code> <TH><ul> <ol> <li> <dl> <dt> <dd> <img> <br> <p> <blockquote> <strike> <object> <param> <embed> <del> <pre> <b> <i> <table> <tbody> <div> <tr> <td> <h1> <h2> <h3> <h4> <h5> <h6> <hr> <iframe>
  • Lines and paragraphs break automatically.
  • Web page addresses and e-mail addresses turn into links automatically.
CAPTCHA
If you register, you will never be bothered to prove you are human again. And you get a real editor toolbar to use instead of this HTML thing that wards off spam bots.