Geraldine Swift is a specialist registrar in general adult psychiatry in Salford (Meadowbrook Unit, Bolton, Salford and Trafford Mental Health Trust, Stott Lane, Salford M6 8HD, UK. E-mail: ger.swift{at}ntlworld.com). She has clinical and research interests in psychological medicine and medical education.
|
|
|---|
|
|
|---|
Box 1 Journal club goals
|
|
|
|---|
Research into continuing education suggests that interventions consisting only of didactic sessions do not change physicians behaviour (OBrien et al, 2001). There is some evidence that sessions incorporating principles of adult learning such as those listed in Box 2
are more likely to have an impact not only on knowledge but also on skills and behaviour. Any reorganisation of a journal club needs to take these principles into account.
Box 2 Principles of adult learning
|
|
|
|---|
Journal clubs can be seen as a rich topic of research. It seems likely that, in order to maintain enthusiasm and effectiveness, clubs will periodically need to be restructured to meet new goals and objectives. Such changes need to be evaluated for their effect on individuals learning. Randomised controlled trials of such interventions are difficult to design, but cohort studies may be feasible. Morrison et al(1999) provide a checklist of appropriate questions that would be useful to those designing a study in this area.
Attendance rates may be highest in groups supported by the faculty but run independently of it (Linzer et al, 1987; Sidorov, 1995), indicating the advantages of involving a senior trainee as journal club leader. Trainees may feel less inhibited in asking questions in a club run by one of their peers, and trainees as leaders may be more attuned to the needs of their colleagues. Specialist registrars should be encouraged to see the role of journal club leader as contributing to their own training needs and to career enhancement in terms of managerial and organisational skills. Several descriptive accounts of new formats for journal clubs have been written by trainees and published in the Psychiatric Bulletin in recent years (e.g. Warner & King, 1997; Combe et al, 1999).
|
|
|---|
The room should suit the group. A lecture theatre with tiered seating makes small group work difficult and encourages passivity. Moreover, a lecture theatre that is used primarily for medical students may appear less welcoming to a multi-disciplinary group. Seating participants in a circle or a horseshoe promotes eye contact and increases the chance of active participation.
Providing free food has been shown to correlate both with longevity and high attendance rates in journal clubs (Sidorov, 1995). Given the recent debate in the BMJ (Who pays for the pizza? Moynihan, 2003), perhaps the timing is right to reconsider whether mental health services should fund journal clubs, to release them from their controversial reliance on the sponsorship of pharmaceutical companies.
There are advantages and disadvantages to making attendance mandatory for trainees. The risk of mandatory attendance is that the club might be seen as being imposed rather than valued as a learning opportunity; this could be overcome by encouraging the group to agree their own rules for holding pagers, starting on time, and so on. On the plus side, having a core group of regular attenders is important for promoting continuity. Mandatory attendance has been found to be an important positive factor in both attendance rates and longevity of journal clubs (Sidorov, 1995).
Part of the environment of any journal club is the organisation within which it is run. If this supports the club, it is far more likely to be successful. Regular attendance by faculty and community physicians correlated with high levels of satisfaction in one study (Heiligman & Wollitzer, 1987). Therefore, even if the main aim of a journal club were to teach trainees, it would be worth considering what factors would stimulate the interest of consultants. Finally, a study of family-practice clubs found that attendance rates were highest when the programme director rated the educational value of a club as vital and lowest when it was rated as having no educational value (Van Derwood et al, 1991).
|
|
|---|
Critical appraisal journal clubs
Critical appraisal is the systematic weighing up of evidence. Critical appraisal journal clubs are increasingly popular in psychiatry, particularly in view of the changes to Part II of the MRCPsych examinations. They are easier to organise than evidence-based journal clubs and are welcomed by trainees. Generally one article is reviewed: if trainees are encouraged to choose the study themselves, it might be useful to ask the presenter to demonstrate why the chosen study is relevant to the club. Another approach is to review classic papers frequently referred to in the literature, allowing participants to make up their own minds about the validity of the conclusions drawn. However the papers are selected, it is important to include different study designs. Focusing only on randomised controlled trials is not sufficient for the Part II examination.
Journal club sessions may consist of a presenter introducing a paper in a structured way. It can be helpful to use a checklist or reading guide such as the McMaster reading guides (Department of Clinical Epidemiology and Biostatistics, McMaster University, 1981) or JAMA papers (e.g. Oxman et al, 1993). The advantage of this approach is that reviews are more consistent and alert the reader to methodological flaws. Other clubs have tried to increase audience participation by dividing them into small groups (Sackett et al, 1999); the presenter briefly introduces the paper and each group is assigned critical appraisal questions. A general group discussion of the correct answers completes the session. Suitable questions can be taken from books such as The Pocket Guide to Critical Appraisal (Crombie, 1996). It might also be useful to start with worked examples from the critical appraisal papers by Brown & Wilkinson (1998, 2000).
More demanding in terms of preparation, but likely to be useful for trainees preparing for the Part II examination, is the format suggested by Cramer & Mahony (2001) for a family medicine journal club. Over the course of a year, a written test consisting of about ten questions was given to participants before and after each club meeting. The questions were set by the director of the club and were based on critical appraisal of the papers to be discussed. These tests allowed the department and each individual to track objective measures of performance, with the second test representing the learning during the session. The authors suggest that the first test assesses needs, the discussion offers opportunities to practise skills and the second test reinforces change, following principles of adult learning. In both this approach and the one described above, participants are not required to read the papers before the session. Given that a practical problem in most journal clubs is that half the participants have read the paper and the other half have not, this can be seen as an advantage. Moreover, it may mimic examination conditions more closely.
A problem with critical appraisal journal clubs is that participants may be reluctant to join in if they do not feel confident in their critical appraisal skills. Moreover, as few consultants have sat the critical review paper they may not feel competent to offer training to others. The result is that the format can easily slip back into a more familiar, traditional structure. To avoid this, it is important to access resources to support the new format (Box 3
). The Public Health Units Critical Appraisal Skills Programme (CASP) offers web-based learning and annual courses as well as tailor-made courses for groups. Oxford Universitys postgraduate diploma course in evidence-based health care looks at organisational difficulties with disseminating this approach as well as the skills necessary for evidence-based medicine (EBM). Another possibility is to seek statistical support, with a statistician attending the club on a regular basis (Swift et al, 2001).
Box 3 Resources for evidence-based journal clubs
|
Evidence-based clubs
Evidence-based medicine relies on the conscientious, explicit and judicious use of current best evidence in making decisions about the care of individual patients (Sackett et al, 1997). A journal club based on these principles involves the four key elements of EBM (Box 4
), of which critical appraisal is only one. Thus, an EBM journal club is a more extensive undertaking than one devoted specifically to critical appraisal, because it focuses on a topic rather than on a single paper. Such a club is more likely to affect clinical practice and to appeal to senior clinicians.
Box 4 Evidence-based medicine
|
In terms of question setting, the ideal is to start with a real life clinical problem. Badgett et al(1997) refer to teachable moments, those frequent questions that are generated at the patients bedside. These opportunities are usually missed because we do not seek answers, or we refer to less reliable but more convenient sources of information. Kehoe (2000) has described one local solution in a mental health setting: a big red book to record questions that arise from case conferences and ward rounds.
Literature searching is probably the weakest point in the chain for EBM journal clubs. In a study of an obstetrics and gynaecology journal club, Coomarasamy et al(2001) found that 11 of 55 consecutive appraisals missed the article most relevant to the clinical question. It is unlikely that this would be very different in a mental health setting. Some journal clubs have tried to improve participants skills in this area by carrying out a real-time search during meetings, using an internet-linked computer and projector. If there is no one available who feels confident in this skill, consider asking your local trust librarian to help. Most trusts now employ health librarians as training officers, and their skills often include practising and teaching quality filtering and critical appraisal as well as identification of the literature. Once the most relevant article has been identified, critical appraisal then follows as above. In an EBM journal club it may be possible to spend one session formulating the question and identifying the most relevant articles, and the following seesion appraising them. Alternatively, presenters could complete the first three steps in advance with the help of a journal club mentor, and the meeting time could be dedicated to the critical review. A third possibility is to set the question as a debate between two teams. Each side argues its case, with a chairperson mediating.
Other formats: research, publications and medical education
Many variations on formats for journal clubs have been described. Hartlaub (1999) outlines a particularly intriguing problem-solving approach that aims to overcome the nihilism and method-bashing that can plague critical appraisal. The initial steps are as before: posing a question and searching for the most relevant paper. However, this paper is not initially shown to the audience; instead, they are given the question and asked to decide what would be the most appropriate study design to answer it. The design used in the published study is then described, and participants debate its strengths and weaknesses compared with their suggested design. The audience might then be asked to suggest an appropriate control group, and again this is compared with the control group used; and so on. This approach has the merit that participants appreciate the strengths as well as the weaknesses of a particular piece of research, and Hartlaub suggests that they might be more likely to become involved in research as they become more aware of how it can be done.
Several authors have noted the use of journal clubs as a means of generating letters to journals. Sandifer et al(1996) described a public health medicine journal club where participants were encouraged to write letters to the editors after collective appraisal of a recently published paper. Six out of ten submitted letters were published: trainees were less likely to write letters, but more likely to have their letters published. Edwards et al(2001) adopted a similar approach with undergraduates in a public health medicine attachment, with benefits in terms of student enthusiasm, writing skills and an experience of writing for publication.
Journal clubs have also been used as a forum to discuss educational interventions. Centeno et al(1999) noted that physicians are often not interested in theories of teaching. In one medical school in Argentina, accessing an already popular journal club, reduced this problem. Once a month this club was jointly chaired by a physician and a professional educator, and articles relevant to teaching or learning activities were appraised. Similarly, Simpson et al(1997) described the adaptation of relevance criteria from evidence-based medicine to education, to help faculty members interested in medical education to select papers that warranted critical review, as defined by their potential impact on student or trainee learning.
Creativity and journal clubs
In one survey (Taylor & Warner, 2000) respondents complained of the lack of flexibility of evidence-based journal clubs, where philosophical works, personal views and psychodynamic issues were not easily discussed. Roberts (2000) describes a scene from one journal club where discussion of an evidence-based mental health topic was followed by a brief narrative account of a general practitioner visiting an elderly, dying woman; this story
created a touching silence, reflections on what the story meant and quiet tears from a colleague ... A mature student, previously a professional, said his career change had been prompted by a desire to be more connected and in touch with peoples lives. We observed that the current presentation of EBM misses this altogether.
Combe et al(1999) described an attempt to improve attendance at journal club meetings by alternating the traditional format with a more creative approach, looking at topics as wide-ranging as psychodynamic interpretations of Goldilocks and the Three Bears and recognising and interpreting body language. The alternative presentations were more varied in their choice of media, including videos, story-telling and book reviews, and seemed to promote group cohesion, as members brought more personal material to the group; for example, one showed a video on eating disorders, in which she had taken part some years earlier. The alternative journal clubs were not seen as an easy option, as more thought had to go into the choice of material, but they were rated by the group as having more impact than the traditional format and were better remembered.
|
|
|---|
Some of the pupils, making themselves into a sort of a club, had a small room over the bakers shop near the Hospital Gate where we could sit and read the journals and where some, in the evening, played cards (quoted by Linzer, 1987).
Journal clubs will continue to be experienced as interesting if they respond to the needs of participants. With 6-monthly rotations among junior medical staff and high turnover of many others, these needs are liable to change rapidly, so journal clubs need to use regular written surveys to assess goals and monitor satisfaction. Given the wide range of formats possible, these clubs can be both stimulating and entertaining.
|
|
|---|
|
View this table: [in a new window] | MCQ answers |
|
|
|---|
This article has been cited by other articles:
![]() |
R. A. Figueroa, S. Valdivieso, M. Turpaud, P. Cortes, J. Barros, and C. Castano Journal Club Experience in a Postgraduate Psychiatry Program in Chile Acad Psychiatry, September 1, 2009; 33(5): 407 - 409. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||