Evidence-informed language: interpretation and impact on intentions to treat – results of an online survey of medical students and specialists in German-speaking countries
Objectives Currently, there is no generally accepted consensus on how to translate strength of evidence into language. Against this background, we here investigated how widely used verbal descriptors of evidence grades and clinical practice recommendations, respectively, are understood, interpreted...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMJ Publishing Group
2025-02-01
|
| Series: | BMJ Open |
| Online Access: | https://bmjopen.bmj.com/content/15/2/e082907.full |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1823865353564848128 |
|---|---|
| author | Sven Benson Reinhard Griebenow Justine Schmidt Henrik Herrmann |
| author_facet | Sven Benson Reinhard Griebenow Justine Schmidt Henrik Herrmann |
| author_sort | Sven Benson |
| collection | DOAJ |
| description | Objectives Currently, there is no generally accepted consensus on how to translate strength of evidence into language. Against this background, we here investigated how widely used verbal descriptors of evidence grades and clinical practice recommendations, respectively, are understood, interpreted and transferred into intentions to treat. We explored differences between medical specialists and undergraduate medical students.Design Cross-sectional, anonymous online survey. Assessment was based on publicly available proposals for wording to characterise strength of evidence from randomised versus non-randomised trials and of clinical practice recommendations, respectively.Setting The online survey was conducted between September 2021 and March 2022 and promoted by several professional organisations in German-speaking European countries (Germany, Austria and Switzerland).Participants Medical students, trainees and medical specialist (open to all medical specialties).Outcome The survey was composed of two sections: (1) Aim of the first survey section was to assess if the linguistic differentiation between results from randomised versus non-randomised studies is correctly understood as put forward by the proponents. To this end, participants were asked to grade the relative weight of the expression for the results of a randomised trial versus two proposals for how to express the results of non-randomised studies. (2) Next, strong positive, weak positive, weak negative and strong negative clinical recommendations were presented, and participants were asked to answer in a forced-choice format if they would treat all/no patients, selected patients or only consider treatment. Additionally, the number of eligible patients who would be treated was assessed.Results N=1081 physicians and N=539 medical students completed the survey. (1) Less than half of the participants (48.5%) interpreted use of ‘associated with’ as linguistic differentiation between results from randomised versus non-randomised trials in a sense as put forward by the proponents. However, use of the subjunctive mood (‘could’) resulted in 87.3% correct differentiations. (2) Even with only four types of clinical practice recommendations (positive/negative and strong/weak), interpretation and translation into intention to treat, respectively, showed a heterogeneous picture: while the presentation of a strong clinical recommendation led to largely congruent responses, the interpretation of weak recommendations showed a high variability, with no clear response pattern for intentions to treat. Responses from physicians and medical students were largely comparable.Conclusion This study demonstrates limitations in the currently used linguistic expressions of strength of evidence and clinical practice recommendations and supports the need to prospectively test effects of language on intentions to treat prior to implementation of a certain wording. Study results cast doubt on that linguistic means alone will lead to optimally targeted intentions to treat. |
| format | Article |
| id | doaj-art-1da73a5c39d74be6a7c7f6386d2b739f |
| institution | Kabale University |
| issn | 2044-6055 |
| language | English |
| publishDate | 2025-02-01 |
| publisher | BMJ Publishing Group |
| record_format | Article |
| series | BMJ Open |
| spelling | doaj-art-1da73a5c39d74be6a7c7f6386d2b739f2025-02-08T06:50:09ZengBMJ Publishing GroupBMJ Open2044-60552025-02-0115210.1136/bmjopen-2023-082907Evidence-informed language: interpretation and impact on intentions to treat – results of an online survey of medical students and specialists in German-speaking countriesSven Benson0Reinhard Griebenow1Justine Schmidt2Henrik Herrmann32 Institute for Medical Education, Centre for Translational Neuro- and Behavioral Sciences (C-TNBS), University Hospital Essen, Essen, Germany1 European Cardiology Section Foundation, Cologne, Germany2 Institute for Medical Education, Centre for Translational Neuro- and Behavioral Sciences (C-TNBS), University Hospital Essen, Essen, Germany3 Committee for Training and Education Politics, Marburger Bund Germany, Berlin, GermanyObjectives Currently, there is no generally accepted consensus on how to translate strength of evidence into language. Against this background, we here investigated how widely used verbal descriptors of evidence grades and clinical practice recommendations, respectively, are understood, interpreted and transferred into intentions to treat. We explored differences between medical specialists and undergraduate medical students.Design Cross-sectional, anonymous online survey. Assessment was based on publicly available proposals for wording to characterise strength of evidence from randomised versus non-randomised trials and of clinical practice recommendations, respectively.Setting The online survey was conducted between September 2021 and March 2022 and promoted by several professional organisations in German-speaking European countries (Germany, Austria and Switzerland).Participants Medical students, trainees and medical specialist (open to all medical specialties).Outcome The survey was composed of two sections: (1) Aim of the first survey section was to assess if the linguistic differentiation between results from randomised versus non-randomised studies is correctly understood as put forward by the proponents. To this end, participants were asked to grade the relative weight of the expression for the results of a randomised trial versus two proposals for how to express the results of non-randomised studies. (2) Next, strong positive, weak positive, weak negative and strong negative clinical recommendations were presented, and participants were asked to answer in a forced-choice format if they would treat all/no patients, selected patients or only consider treatment. Additionally, the number of eligible patients who would be treated was assessed.Results N=1081 physicians and N=539 medical students completed the survey. (1) Less than half of the participants (48.5%) interpreted use of ‘associated with’ as linguistic differentiation between results from randomised versus non-randomised trials in a sense as put forward by the proponents. However, use of the subjunctive mood (‘could’) resulted in 87.3% correct differentiations. (2) Even with only four types of clinical practice recommendations (positive/negative and strong/weak), interpretation and translation into intention to treat, respectively, showed a heterogeneous picture: while the presentation of a strong clinical recommendation led to largely congruent responses, the interpretation of weak recommendations showed a high variability, with no clear response pattern for intentions to treat. Responses from physicians and medical students were largely comparable.Conclusion This study demonstrates limitations in the currently used linguistic expressions of strength of evidence and clinical practice recommendations and supports the need to prospectively test effects of language on intentions to treat prior to implementation of a certain wording. Study results cast doubt on that linguistic means alone will lead to optimally targeted intentions to treat.https://bmjopen.bmj.com/content/15/2/e082907.full |
| spellingShingle | Sven Benson Reinhard Griebenow Justine Schmidt Henrik Herrmann Evidence-informed language: interpretation and impact on intentions to treat – results of an online survey of medical students and specialists in German-speaking countries BMJ Open |
| title | Evidence-informed language: interpretation and impact on intentions to treat – results of an online survey of medical students and specialists in German-speaking countries |
| title_full | Evidence-informed language: interpretation and impact on intentions to treat – results of an online survey of medical students and specialists in German-speaking countries |
| title_fullStr | Evidence-informed language: interpretation and impact on intentions to treat – results of an online survey of medical students and specialists in German-speaking countries |
| title_full_unstemmed | Evidence-informed language: interpretation and impact on intentions to treat – results of an online survey of medical students and specialists in German-speaking countries |
| title_short | Evidence-informed language: interpretation and impact on intentions to treat – results of an online survey of medical students and specialists in German-speaking countries |
| title_sort | evidence informed language interpretation and impact on intentions to treat results of an online survey of medical students and specialists in german speaking countries |
| url | https://bmjopen.bmj.com/content/15/2/e082907.full |
| work_keys_str_mv | AT svenbenson evidenceinformedlanguageinterpretationandimpactonintentionstotreatresultsofanonlinesurveyofmedicalstudentsandspecialistsingermanspeakingcountries AT reinhardgriebenow evidenceinformedlanguageinterpretationandimpactonintentionstotreatresultsofanonlinesurveyofmedicalstudentsandspecialistsingermanspeakingcountries AT justineschmidt evidenceinformedlanguageinterpretationandimpactonintentionstotreatresultsofanonlinesurveyofmedicalstudentsandspecialistsingermanspeakingcountries AT henrikherrmann evidenceinformedlanguageinterpretationandimpactonintentionstotreatresultsofanonlinesurveyofmedicalstudentsandspecialistsingermanspeakingcountries |