Response to: R Guo, PH Canter, E Ernst. A systematic review of randomised clinical trials of individualised herbal medicine in any indication. Postgrad Med J 2007;83:633-637

From: Ally Broughton Bsc (Hons) MNIMH Director of Research for, and Member of, the National Institute of Medical Herbalists (NIMH) Contact: ally.broughton@blueyonder.co.uk

I am a trained herbal practitioner of 12 years and teach research methodology on BSc and MSc courses in herbal medicine.

A herbal practitioner undergoes a 3-4 year degree level accredited training course which includes clinical skills and differential diagnosis, materia medica (plant medicine), and clinical experience in accredited training clinics. Professional bodies are currently self regulating and exist to ensure professional and best clinical practice.

In teaching, I use critical appraisal tools developed by the Critical Appraisal Skills Programme (CASP)(i) , I used a tool to evaluate this review to minimise bias.

Study validity Only 3 small scale clinical studies are included for review, one of which is a pilot study. The review can have no statistical significance.

The studies have very different outcome measures and investigate entirely different conditions, making comparison difficult.

Selection criteria From the 1345 references identified, 3 studies were selected. There was no clear pre-determined strategy used to determine which studies were included.

The reviewers recognise this limitation saying they had ‘difficulties designing a search strategy to locate RCTs of individualised herbal medicine because of the large number of potential descriptors for such studies’. This is a strong limitation in the review methodology.

Statistical Analysis The results for each of the studies are assessed by statistical significance, however there is no clear indication given of p values or confidence intervals used by any of the studies.

Critical Analysis The analysis focus is on statistical data. Some potentially valid points are not reviewed. For example in the Bensoussan trial(ii) there was no significant difference between the individualised and standard treatments at 16 weeks were reported, however, on follow-up 14 weeks after treatment, only the individualised treatment group maintained improvement. The reviewers entirely dismissed this as statistically non significant. It is an important point considering that individualised, holistic treatment addresses underlying causes of illness which takes longer to resolve but often with longer lasting benefit compared to symptomatic treatments.

Discussion Analysis In the discussion analysis there is consistently inadequate links made between the review evidence and the conclusions made by the authors. Discussion on herbal practice and safety issues are not substantiated or referenced, in fact there are only 7 references for the entire review.

Conclusions There is a lack of scientific rigour in the review methodology. Based on the evidence presented in the review the conclusions made by the authors appear arbitrary and insufficiently based on the evidence presented.

Designing a randomised controlled trial to investigate individual treatment is highly complex and not without limitations. Within the field of complementary medicine current research is looking for new or adapted research paradigms appropriate to holistic medicine (iii,iv) .

(i)Oxman AD, Cook DJ, Guyatt GH, Users’ guides to medical literature. VI. How to use an overview. JAMA 1994; 272(17): 1367-1371

(ii) Bensoussan A et al. Treatment of irritable bowel syndrome with Chinese herbal medicine. JAMA 1998;280:1585-9

(iii)Boon H et al. Evaluating complex healthcare systems: A critique of four approaches. eCAM Advance Access 2006; doi:10.1093/ecam/nel079 (iv) Fonnebo V et al. Researching complementary and alternative treatments – the gatekeepers are not at home. BMC Medical Research Methodology 2007;7:7

I enjoyed reading the article on 'testis cancer' by Khan et al.I agree with the authors that the survival rate has increased over the past few years.The authors have rightly pointed out the role of chromosome in causing such anomalies while the primordial germ cells are undergoing cell division.While going through the risk factors,I would certainly like to highlight the exposure of dyes and paints.The dyeing agents are known to cause such cancers.The website addresses mentioned in the text are beneficial for clinicians.Overall, the article is informative and the authors need to be praised for their lucid style of presentation.

Editor,

In their helpful review article, Kearney and Dang advocate giving hydrocortisone to suspected adrenal crisis pending ACTH stimulation testing. Many authorities suggest the use of dexamethasone prior to testing as it does not interfere with cortisol assay (eg. Webb et al 1999, Shenker et al 2001). Can the authors justify their postponement of confirmatory tests?

Yours sincerely

Mark Jadav

Kearney T and Dang C. Diabetic and endocrine emergencies. Postgraduate Medical Journal 2007:83:79-86

Webb A, Shapiro M,Singer M and Suter P. Oxford Textbook of Critical Care. Oxford University Press 1999 p.603

Shenker V and Skatrud JB. American Journal of Respiratory and Critical Care Medicine, Volume 163, Number 7, June 2001, 1520-1523

Dear Editors,

A recent article, A systematic review of randomized clinical trials of individualized herbal medicine in any indication, published in October, 2007 in the Postgraduate Medical Journal, by R. Guo , P. H. Canter , E. Ernst, of the Peninsula Medical School, Universities of Exeter & Plymouth, Exeter, U.K., warns public health authorities that the effectiveness of individualized, herbal medicine has not been scientifically established. “The findings of this review are particularly pertinent because section 12(1) of the U.K.’s Medicines Act relating to regulation of unlicensed herbal remedies made up to meet the needs of individual patients is presently under review,” the authors note. But this thinly-veiled call for regulation – publicized in the national media in the U.K., in outlets including The Independent and The Guardian, inter alia, is fatally flawed.

The authors fail to take into account the dramatic differences that animate the diagnostic and prescriptive systems of Chinese medicine, Ayurveda, and European homeopathy. The herbs used by doctors in this complementary medical systems are not used in the same way, or for the same purposes. Chinese medicine is energy medicine – and seeks to balance the body and achieve harmony for the patient. But homeopathy is decidedly different, as it uses herbs to create a catalytic reaction in the patient, and thus stimulate his immune system. Ayurveda differs from both of these approaches.

Lumping the herbal treatments of these three, separate medical systems makes no scientific sense – and, may quite literally be comparing apples to oranges. This is a disservice to readers.

To be sure, the article is not totally without merit. The authors note that evidence of efficacy for some herbal medicines, has increased substantially during the past 20 years. The authors also note that the World Health Organization (WHO) has estimated that 80% of the population in developing countries relies primarily upon herbal medicine for basic health care.

But, the authors caution, most clinical trials of herbal medicine have focused on standardized extracts of single herbs or standardized formulae. “The individualized approach, in which patients receive tailored prescriptions comprising a mixture of herbs, is emphasized in most forms of practitioner based herbalism, including European medical herbalism, Chinese herbal medicine and Ayurvedic herbal medicine,” the authors note. “ Evidence from clinical studies of single herb extracts or standardized formulae cannot be generalized to individualized herbal medicine, and claims by practitioners that the latter has an evidence base requires confirmation. The non-standardized nature of individually prepared herbal prescriptions and the consequent increased potential for adverse events and negative interactions means that safety and effectiveness need to be firmly established before such practices can be endorsed.”

It’s an interesting statement, on the surface, but seems to be a bit of pettifoggery when examined closely. The drugs dispensed by allopathic physicians cannot withstand similar scrutiny – and it has been demonstrated, for example, individual patients react differently to the same, allopathic prescriptions. Some have side effects. Some do not. Some have adverse reactions. Some do not. Some are aided in their healing. Some are not. Is this fact cause for concern? Yes. It has given rise to the field of molecular medicine, wherein scientists are seeking to develop individualized therapies for individual patients. But it is far from the norm for conventional, Western medicine.

As the article’s authors show, they scanned Medline and other medical databases and picked studies of randomized, controlled clinical trials of different herbal treatments – and only three studies that they found featured individualized herbal medicine. This was of 1,345 references in the scientific literature.

The study claims that this methodology is rigorous and that the authors have set a new standard that all herbalists must now follow.

“This study sets a new benchmark for the tailored approach: not only must herbalists demonstrate that individualized treatment is superior to placebo, they must also show, for reasons of cost and safety, that it is superior to standardized treatment,” the authors write. “

We respectfully disagree with the authors of the study that their review has somehow set a “new benchmark” for herbalism. Far from it. In fact, we are concerned that the study design, as we outlined above, is so poorly conceived that it renders its findings and recommendations for public policy makers virtually useless. To lump Chinese medicine, Ayruvedic medicine and European homeopathy into one, undistinguishable category is, simply put, poor scholarship.

Education is needed to explain to allopathic medical practitioners and scientists whose work purports to inform allopaths and public health authorities of the differences between Chinese medicine, Ayurveda and homeopathy. The risk of failing to do so is great – regulators may be driven by hysteria, engendered by ill-conceived studies, into restricting the practice of complementary medicine, to the great disadvantage of patients.

FURTHER READING

1. R. Guo , P. H. Canter , E. Ernst, A systematic review of randomized clinical trials of individualized herbal medicine in any indication, Postgraduate Medical Journal (U.K.), October 2007. 2. Ernst E, Pittler M, Wider B, eds. The desktop guide to complementary and alternative medicine, an evidence based approach , 2nd ed. Mosby Elsevier, 2006.