2691 Delirium Communications Delirium Communications 2959-104X European Delirium Association Website: Delirium 92852 10.56392/001c.92852 Articles Implementation of delirium management during the pandemic: lessons learned https://orcid.org/0000-0002-5178-0364 Nydahl Peter 1 2 Baumgarte Friederike 3 Berg Daniela 4 Borzikowsky Christoph 5 Green Diana 3 Hannig Anisa 6 Hansen Hans-Christian 6 Hansen Uta 7 Istel Rahel 6 Krämer Norma 6 Krause Karita 6 Mohammadzadeh-Vazifeh Mohammad 6 Osterbrink Jürgen 2 Palm Frederick 8 Petersen Telse 3 Rasmussen Fidan 4 Schöller Bernd 8 Stolze Henning 7 Meyne Johannes 4 Margraf Nils G 4 Nursing Research University Hospital Schleswig-Holstein, Kiel Institute for Nursing Research and Practice Paracelsus Medical University, Salzburg Christian Albrechts University Kiel Department of Neurology University Hospital Schleswig-Holstein Institute of Medical Informatics und Statistics Kiel University https://ror.org/04v76ef78 Department of Neurology Friedrich-Ebert-Krankenhaus, Neumünster Department of Neurology Diakonissenkrankenhaus Flensburg Department of Neurology Heliosklinikum Schleswig 18 2 2024 92852 28 12 2023 1 2 2024 http://creativecommons.org/licenses/by/4.0 This is an open access article distributed under the terms of the Creative Commons Attribution License (4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Background

During the covid-19 pandemic, a non-funded, nurse-led quality improvement project on delirium management was in progress on four Stroke Units (SU). Two sites experienced pandemic-related delays; we set out to learn lessons based on the impact for delivering multicentre trials.

 Methods

Secondary analysis of a prospective quality improvement project. We compared data quality from centres with vs. without delay. Unplanned modifications in study management were classified as a) fatal modifications (ending the study), b) serious modifications (requiring a revision of the registration and/or ethic approval, c) moderate modifications (revising study management), d) minor modifications (improving study performance). Local study coordinators summarised lessons learned.

 Results

The study had an overall delay of 14 months. Centres without delay delivered better data quality and had less loss of patients due to missing primary outcome data in 0.3% vs 28.8% in centres with delay (p<0.001). There were no fatal modifications, two serious (exchange of study centre, adding new outcome parameters), six moderate (e.g. delayed start in two centres, change from in-person to virtual meetings), and one minor modification (four local study coordinators taking parental leave). Lessons learned were frequent communication with study coordinators, attention to data quality, protocolisation of recruitment rates, and adapted education in quality improvement projects.

 Conclusions

Pandemic-related disruption can be substantial, with poorer data quality, but only in a few cases were registration and/or ethic approval modifications required. Facilitators are flexible, including changed time frames, frequent virtual communication, and critical reflection.

 Covid-19 Data quality Delirium Encephalopathy Research Management Pandemic All authors confirm that this study is not funded and had no financial or non-financial interests; had study-specific approval by the appropriate ethics committee for research involving humans and/or animals, had informed consent if the research involved human participants. Animals were not involved in this study. Background

Quality improvement (QI) projects aim to implement evidence-based knowledge to ensure best nursing care.1,2 Stakeholders often use a plan-do-check-act cycle to allow specific planning, performing, communication and evaluation of each step.3 Evaluation can use a before / after approach.4 The process requires management skills, especially regarding implementation in an interprofessional and/or interdisciplinary team.5 The COVID pandemic influenced several ongoing studies and projects, leading to delay, modification, and cancellation.6–12 Affected projects needed to be balanced between less efficacy due to the pandemic and the urgent need for improving practice to protect vulnerable patients.

Patients with a stroke are most often cared for on specialised SUs, which offer a high level of care to initiate first therapies and reduce complications.13 Delirium is among these complications, affecting around 40% of patients.14–16 Since there is a dose-response relationship between duration of delirium and adverse outcomes such as prolonged stay in hospital, cognitive impairment or increased mortality, implementation of delirium management is recommended to reduce the negative impact of delirium.17–20 Several studies have addressed barriers and implemented delirium QI using a before/after comparison.4,21–25 We performed one such QI project to implement interprofessional delirium management on four affiliated Stroke Units (SU) in Germany.26

Since pandemics and other events occur unforeseen and can lead to several challenges in running scientific trials, we aimed to evaluate data quality in a QI project in study centres with vs. without pandemic-related disruption, report unplanned study modifications and regulatory approvals, and overall lessons learned.

 Design and methods

This is a secondary analysis of a previously published, investigator-initiated, non-funded, nurse-led, observational, prospective QI project.26 The original study was planned before the pandemic and started after the first wave in autumn 2020. The local ethics committee (D459/20) approved and registered the original QI project in the German Register of Clinical Studies (DRKS00021436). The report of this secondary analysis is in concordance with Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement (Supplement).27

Setting

The design is reported in detail elsewhere.26 In brief, we conducted a QI project in four affiliated SUs to implement an interprofessional protocol for delirium management and evaluated it in a before/after comparison. The primary outcome was the median delirium severity over admission, assessed with the Nursing Delirium Screening Scale (Nu-DESC). The Nu-DESC is a delirium assessment tool including five dimensions with 0 to 2 points, and a total score ranging from 0 to 10 points; with a score ≥ 2 indicates delirium.28 Nurses screened 3x/24h all eligible patients for delirium; for positive results, physicians confirmed delirium using the Diagnostic and Statistical Manual of Mental Disorders fifth edition (DSM-5) criteria. Secondary outcomes were the presence and duration of delirium, length of stay in SU and hospital, and modified Rankin Scale (mRS). There were four phases: a) two weeks of interprofessional teaching of delirium assessment; b) four weeks pre-phase (phase 1) to measure the baseline of outcome parameters; c) four weeks of interprofessional teaching of staff in delirium management; and d) four weeks post-phase (phase 2) to measure the effect of delirium management after implementation of delirium management. Delirium management included the cooperation of physicians and nurses, evaluating possible reasons for delirium and the choice of appropriate, specific treatments, non-pharmacological interventions such as mobilisation, patient information, re-orientation, patient distress, administration of specific pharmacological interventions.26 All data were collected by local study coordinators, using standardised data collection forms. The QI project included nearly 500 patients, with 9.5% being having delirium.26

 Sample

This secondary analysis included 14 participating local study coordinators in four centres. All centres were affected by the pandemic, including having patients with COVID-19 and stroke, re-structuring processes, extended working hours, visitor restrictions, and changes in staffing numbers. Coordinators were active clinicians, working as nurses, physicians, or students on SU and/or research in participating hospitals and related universities. Before the study began, all coordinators were asked to record all unplanned modifications related to the study. As mentioned above, two centres could perform the project as planned with no delay in all phases, and two centres had a delayed start and delivery.

 Outcome parameters

The primary outcome was data quality of centres with vs. without delay in study delivery, measured as the rate of missing information in primary and secondary outcome parameters. The secondary outcomes were unplanned modifications as qualitative results, identified by clustering of observed themes. We defined an unplanned modification as an unforeseen modification resulting from a modifiable cause avoidable in future recurrence by reasonable adaption.29 Hence, we structured unplanned modifications in four different clusters: a) fatal modifications which would lead to ending the study in case of unexpected increased mortality, severe violation of ethical approval, or other reasons; b) serious modifications, requiring a revision of the registration and/or ethic approval, e.g. new or withdrawing study centres, revision of primary or secondary outcome parameters, or revision of other pre-registered information; c) minor modifications, requiring a revision of the study management, e.g. delayed study phases, adaption of information sheets due to local needs, modification of teachings from presence- into virtual-mode; and d) other modifications, e.g. revisions for improving study performance, and others.

Information was collected prospectively by participating study coordinators by a standardised data collection form, and supported by personal talks, real and virtual meetings, emails, and recorded timelines in reaching milestones.

 Statistical methods

We conducted a descriptive analysis, using nominal data in absolute and relative frequency, and continuous data in median and interquartile range (IQR) or mean and standard deviation (SD), depending on the distribution. Inferential tests were conducted using Chi-squared, t-test, and Mann-Whitney-U tests. The level of significance was defined as alpha=0.05. The analysis was carried out with SPSS 23 (IBM, New York).

 Results

All centres were able to implement delirium management in 2020 and 2021. Participating centres planned study initiation over different time frames, ranging from August to October 2020; but in November, the second wave started in Germany and led to several changes, such as reduced admission rates, other tasks and responsibilities for local study coordinators, especially participating nurses, restricted visiting policies, and others.30–33 These unplanned disturbances delayed some participating study centres (Figure 1).

194252 Delay in performing the study due to pandemic Data quality

The four study centres recruited 359 patients. Compared with planned recruitment, the rate of recruited patients was one-quarter lower than expected in all centres (Table 1). Data quality in delayed centres was significantly poorer than in centres without delayed study delivery. Missing primary outcome led to the exclusion of 28.8% (n=55) of recruited patients in centres with delays, compared with 0.3% (n=1) in centres with study conduct as planned (p<0.001). In secondary outcomes, data quality of length of stay in hospital, discharge destination, and admission diagnosis were significantly different (Table 1).

194162 Comparison of centres with/out delayed performance
Item Total (n=4) Centres with performance as planned (n=2) Centres with delayed performance (n=2) p
Patient recruitment
Planned 492 301 191 0.5322
Actual 359 (73) 223 (74.1) 136 (71.2)
Data completeness
Primary Outcome missinga 56 (15.6) 1 (0.3) 55 (28.8) 0.0001
Secondary Outcome missingb
Length of stay in SU 1 (0.3) 0 (0) 1 (0.7) 0.379
Length of stay in hospital 25 (7) 2 (0.9) 23 (16.9) 0.0001
Discharge destination 19 (5.3) 7 (3.1) 12 (8.8) 0.0273
mRS at discharge from SU 49 (13.6) 12 (5.4) 37 (27.2) 0.0001
Missing patient data
Age 8 (2.2) 2 (0.9) 6 (4.4) 0.0574
Gender 29 (8.1) 14 (6.3) 15 (11) 0.1149
Admission diagnosis 16 (4.5) 5 (2.2) 11 (8.1) 0.0152
Delirious patientsc 30 (100) 20 (66.7) 10 (33.3) 0.844
Missing data in nursing/therapeutical interventions 2 (6.7) 0 (0) 2 (20) 0.143

Abbreviations: mRS modified Rankin Scale; SU Stroke Unit

a Primary outcome was delirium severity, measured by Nursing Delirium Scale; result is based on planned number of patients (patients without primary outcome were excluded), n=492 in total

b Based on number of included patients, n=359 in total

c Based on n=30 delirious patients in total. No data were available for number of anticholinergic drugs, complications, and pharmacological interventions

 Modifications

There were no fatal modifications which would have led to ending the study in case of unexpected increased mortality, a major violation of ethical approval, or other reasons.

There were two serious modifications: a) one exchange of a study centre (before recruiting patients, one centre withdrew from the study due to the pandemic and was replaced by another centre); b) two outcome measures were added in two centres: polymorphic delta waves in electroencephalography and changes in cholinesterase samples. These modifications required a change in registration and ethical approval.

Minor modifications happened in six cases, requiring a revision of the study management, e.g., delayed study phases, adaptation of information sheets due to local needs, modification of teachings from presence into virtual mode, and others. Other modifications were short-term changes to virtual meetings due to new parental responsibilities for the local study coordinators (Table 2). Not all modifications were clearly related to the pandemic and might have happened anyway.

194163 Modifications in Study Design
Modifications Adaptions Lessons learned
0 Fatal modificationsa
None None required None
2 Serious modificationsb
Study centre declined Recruitment of another centre Withdrawal of participating centres can always happen, better to have more centres than needed to ensure sufficient power (calculate 25% patient than expected)During pandemic, it is important to motivate centres, allow delay, stay in contact, enable frequent meetings
Adding new outcome parameters Electroencephalography and cholinesterase added in two centres with amendment for ethic approval and registration Consider additional questions during conduction, which must be suit into the frame of ethic approval
 
6 Minor modificationsc
Delayed pre/post phases, due to Covid-19 Two centres had a delayed start, requiring re-training and updates in team teachings. Mutual information of participating centres and study coordinationRefresh the knowledge about delirium and how to screen and treat before taking up the study again
Different work patterns due to pandemic Clinicians had to work at the bedside, leading to postponed research, delegated tasks to uninformed persons, or after-work-research To increase data quality, it would be better to interrupt the study and continue when life is normal again
Change from presence- to virtual-teachings Hygienic rules hampered team teachings, less clinicians participated in meetings, and virtual meetings and teaching materials were developed We recommend in trials to use virtual team meetings and trainings, and provision of digital training materials.
Adaption of information sheet for physicians Physicians had an overload of information at their office’ pinboards, and the information sheet had to be revised to be perceived as important Information should be adapted to local structures and perceptions
Active involvement of physicians Despite team training, physicians did not react to nurses screening results. Hence, a critical examination during morning rounds by leading physicians was used to improve adherence. Information about every professions’ role and responsibilities must be communicated and repeated, e.g. in rounds. Involvement of key opinion leaders is crucial
Interprofessionality Delirium management and the study became a lower priority due to the pandemic, with the risk of low-quality data collection Find leaders in every profession and shift, involve as much people as possible to have always one who can answer questions and remind the staff to follow the study.Be very clear about which profession has which tasks to fulfil and that communication between the professions is absolutely necessary.
1 Other modificationsd
Babies born by local study coordinators Our congratulations! This did not lead to serious delay or reduced performance, but parents were overworked. Every local study coordinator should have a second one at her/his side

Abbreviations:

a fatal modifications which would lead to ending the study

b serious modifications, requiring a revision of the registration and/or ethic approval

c minor modifications, requiring a revision of the study management

d other modifications, e.g. revisions for improving study performance etc.

 Discussion

In this secondary analysis of a QI project for implementing delirium management on four SU, the reported data quality from centres without delay due to the pandemic was significantly better, compared to centres with delayed start and conduction. Several regulatory approval amendments were needed on several levels, mostly due to pandemic conditions.

Involved clinicians reported anecdotally higher workload, up to 16h per day, other tasks such as caring for Covid-19 patients instead of doing research, working on other units, handling isolated patients and personal protection equipment, visiting restrictions and virtual communication while asking for consent, and other challenges. The key lessons learned were:

Communication: Communication with all involved study coordinators is crucial to staying in contact and sharing information about challenges and facilitators. Video conferences for all were difficult due to limited time. Better were personal calls or WhatsApp messages.

Data quality: Allowing for a delay in study delivery should be feasible, due to higher workload, changed local policies, and others. More staff would have been helpful to increase data quality, but this was impossible in pandemics due to workforce diversion. A delay after the pandemic or wave would result in better data;

Recruitment: A pandemic may lead to lower recruitment for several reasons, e.g., lower admittance rate of patients, lower consent due to absent legal representatives, less time for talks about the study, and others. Hence, study duration should be extended, ongoing evaluations and feedback should be implemented, and a scoring for included patients should be communicated.

Education: the pandemic led to changes from educational meetings in small rooms and bedside teachings on the units to virtual courses and the development of teaching videos. Meanwhile, virtual meetings seem to have several advantages, and the development of teaching videos and evaluation forms has become more feasible, especially in a non-funded study. Nevertheless, bedside teaching and interprofessional cooperation cannot be wholly replaced in real world settings. This required sustained engagement from key opinion leaders in every profession in each centre;

Reflection: During the pandemic, clinicians had to cover more and different tasks and responsibilities. It became difficult to monitor all ongoing projects and tasks. Critical reflection within the teams about study progress, related tasks and responsibilities seem to be important, including talks for reflection, supervision, and emotional relaxation. A delay in study performance should be offered to prevent burn-out risks.

In summary, lessons were related to adapted communication and education, attention to data quality and recruitment, and ongoing reflection.

During this non-funded study, several revisions were required. Adaption of studies to ongoing processes is quite usual, e.g. change of outcome parameters, replacement of study centres, or others,34,35 and some of the reported changes might have happened anyway, such as adding more outcome parameters. Other changes can be strongly related to the pandemic, such as type of educational meetings, delay of study phases, data quality, and especially emotional stress for participating staff.36 Also, other authors reported challenges in reduced recruitment rates, reduced data quality or ensuring safety of patients and staff due to Covid-19, and reaction to suspension of a study, adaption of research processes, or use of new technologies.37–40 Since the original trial did not reach statistical significance in reducing delirium severity,26 the question raises if a better data quality might have led to a better outcome. This is plausible in a few cases, but given the lower-than-expected number of patients with delirium and the low effect size, we assume that better data quality might not have led to a substantial change in the main results.

Data quality fluctuations are not specific to pandemics.41 We observe similar phenomena in periods of staff shortage or staff changes. Here, we saw additive effects: research staff had to work at the bedside or were in quarantine. Though study coordinator communication was maintained due to electronic media, control and re-adjustment of data quality was difficult to monitor due to staff shortage. Recruitment rates dropped because of the pandemic as observed in other departments outside stroke services.30 The most important lesson learned was to conduct quality assessments of data quality, react, and communicate unforeseen changes.

Limitations

This study has several limitations. The generalisability may be limited to our setting. The study was unfunded, led by working clinicians and no dedicated staff were involved; hence, data quality may not be affected in studies with more staff and resources. It is possible that delayed centres were more affected by the pandemic, e.g., by serving more Covid-19 patients, compared to the other centres, but this effect has not been measured and hence, cannot be estimated. The study performance was not reviewed externally, so the lessons learned are limited to the reflection competency of the research team, albeit a multiprofessional and experienced one.

 Conclusions

Pandemics may lead to delays in performing unfunded trials, with a significant difference in data quality between study centres with and without delay. Data quality tends to be lower in centres where the pandemic had caused a delay. An ongoing pandemic may affect a clinical trial negatively unless a more frequent monitoring of data allowing for more rapid interventions can be established.

Author Contributions

All authors have made substantial contributions to all of the following: PN, FB, DB, CB, DG, AH, HCH, UH, RI, NK, KK, MM-V, JO, FP, TP, FR, BS, HS, JM, NGM made substantial contributions to (1) the conception and design of the study, or acquisition of data, or analysis and interpretation of data; PN, FB, DB, CB, DG, AH, HCH, UH, RI, NK, KK, MM-V, JO, FP, TP, FR, BS, HS, JM, NGM made substantial contributions to (2) drafting the article or revising it critically for important intellectual content; PN, FB, DB, CB, DG, AH, HCH, UH, RI, NK, KK, MM-V, JO, FP, TP, FR, BS, HS, JM, NGM made substantial contributions to (3) final approval of the version to be submitted.

 Ethics

The original QI project was approved by the ethic committee (D459/20) and registered in the public German Register of Clinical Studies (DRKS00021436).

 Declaration of Conflicts

All authors declare to have no conflicts related to this work.

 Data transparency

All data generated or analysed during this study are included in this published article [and its supplementary information files].

 Supporting information Supplementary file How and under what circumstances do quality improvement collaboratives lead to better outcomes? A systematic review Implementation Science Zamboni Karen Baker Ulrika Tyagi Mukta Schellenberg Joanna Hill Zelee Hanson Claudia 4 5 2020 15 1 27 1748-5908 10.1186/s13012-020-0978-z 32366269 PMC7199331 https://doi.org/10.1186/s13012-020-0978-z A unit-based, multi-center evaluation of adopting mobility measures and daily mobility goals in the hospital setting Applied Nursing Research Hoyer Erik H. Friedman Michael Lavezza Annette Flanagan Eleni Kumble Sowmya D'Alessandro Michelle Gutierrez Morning Colantuoni Elizabeth Brotman Daniel J. Young Daniel L. Elsevier BV 4 2023 70 151655 0897-1897 10.1016/j.apnr.2022.151655 https://doi.org/10.1016/j.apnr.2022.151655 Can quality improvement improve the quality of care? A systematic review of reported effects and methodological rigor in plan-do-study-act projects BMC Health Services Research Knudsen Søren Valgreen Laursen Henrik Vitus Bering Johnsen Søren Paaske Bartels Paul Daniel Ehlers Lars Holger Mainz Jan Springer Science and Business Media LLC 4 10 2019 19 1 683 1472-6963 10.1186/s12913-019-4482-6 31585540 PMC6778385 https://doi.org/10.1186/s12913-019-4482-6 Rehabilitation quality improvement in an intensive care unit setting: implementation of a quality improvement model Topics in Stroke Rehabilitation Needham Dale M. Korupolu Radha 7 2010 17 4 271 281 1074-9357 10.1310/tsr1704-271 https://doi.org/10.1310/tsr1704-271 Health professionals’ experience of teamwork education in acute hospital settings JBI Database of Systematic Reviews and Implementation Reports Eddy Kylie Jordan Zoe Stephenson Matthew 4 2016 14 4 96 137 2202-4433 10.11124/jbisrir-2016-1843 https://doi.org/10.11124/jbisrir-2016-1843 The Impact of COVID-19 on the Conduct of Clinical Trials for Medical Products in Korea Journal of Korean Medical Science Jeon JuYeun Kim Hyeikyoung Yu Kyung-Sang Korean Academy of Medical Sciences 2020 35 36 329 1011-8934 10.3346/jkms.2020.35.e329 32924344 PMC7490200 https://doi.org/10.3346/jkms.2020.35.e329 Successful conduct of an acute stroke clinical trial during COVID PLoS One Yamal Jose-Miguel Parker Stephanie A. Jacob Asha P. Rajan Suja S. Bowry Ritvij Bratina Patti Wang Mengxi Nour May Mackey Jason Collins Sarah Jones William Schimpf Brandi Ornelas David Spokoyny Ilana Im Jenny Fung Gilbert Greg Eisshofer Michael Grotta James C. 15 1 2021 16 1 e0243603 1932-6203 10.1371/journal.pone.0243603 33449944 PMC7810330 https://doi.org/10.1371/journal.pone.0243603 Challenges and opportunities in health care and nursing management research in times of COVID-19 outbreak Journal of Nursing Management Palese Alvisa Papastavrou Evridiki Sermeus Walter Hindawi Limited 12 3 2021 29 6 1351 1355 0966-0429 10.1111/jonm.13299 33710710 PMC8250042 https://doi.org/10.1111/jonm.13299 Challenges and lessons learned from Covid-19 trials - should we be doing clinical trials differently? Can J Cardiol Janiaud Perrine Hemkens Lars G Ioannidis John P.A. 2021 Neurological manifestations of COVID-19: a systematic review and meta-analysis of proportions Neurological Sciences Favas T. T. Dev Priya Chaurasia Rameshwar Nath Chakravarty Kamlesh Mishra Rahul Joshi Deepika Mishra Vijay Nath Kumar Anand Singh Varun Kumar Pandey Manoj Pathak Abhishek Springer Science and Business Media LLC 21 10 2020 41 12 3437 3470 1590-1874 10.1007/s10072-020-04801-y 33089477 PMC7577367 https://doi.org/10.1007/s10072-020-04801-y Impact of COVID-19 on stroke admissions, treatments, and outcomes at a comprehensive stroke centre in the United Kingdom Neurological Sciences Padmanabhan Nishita Natarajan Indira Gunston Rachel Raseta Marko Roffe Christine 2021 42 1 15 20 1590-1874 10.1007/s10072-020-04775-x 33021704 PMC7537376 https://doi.org/10.1007/s10072-020-04775-x Did COVID-19 impact stroke services? A multicenter study Neurological Sciences Shokri Hossam Nahas Nevine El Basiony Ahmed El Nguyen Thanh N. Abdalkader Mohamad Klein Piers Lavados Pablo M. Olavarría Verónica V. Amaya Pablo Llanos-Leyton Natalia Brola Waldemar Michał Lipowski Fariña Donoband Edson Dejesus Melgarejo Cardozo Analia Caballero Cesar David Pedrozo Fatima Rahman Aminur Hokmabadi Elyar Sadeghi Jalili Javad Farhoudi Mehdi Aref Hany Roushdy Tamer Springer Science and Business Media LLC 25 3 2022 43 7 4061 4068 1590-1874 10.1007/s10072-022-06018-7 35338400 PMC8956331 https://doi.org/10.1007/s10072-022-06018-7 Acute therapy of ischemic stroke. S2-guideline, 2021 guidelines for diagnostics and therapies in neurology Ringleb P A Hametner C Köhrmann M Frank B Jansen O German Society for Neurology 2021 Clinical Practice Guidelines for the Prevention and Management of Pain, Agitation/Sedation, Delirium, Immobility, and Sleep Disruption in Adult Patients in the ICU Critical Care Medicine Devlin John W. Skrobik Yoanna Gélinas Céline Needham Dale M. Slooter Arjen J. C. Pandharipande Pratik P. Watson Paula L. Weinhouse Gerald L. Nunnally Mark E. Rochwerg Bram Balas Michele C. van den Boogaard Mark Bosma Karen J. Brummel Nathaniel E. Chanques Gerald Denehy Linda Drouot Xavier Fraser Gilles L. Harris Jocelyn E. Joffe Aaron M. Kho Michelle E. Kress John P. Lanphere Julie A. McKinley Sharon Neufeld Karin J. Pisani Margaret A. Payen Jean-Francois Pun Brenda T. Puntillo Kathleen A. Riker Richard R. Robinson Bryce R. H. Shehabi Yahya Szumita Paul M. Winkelman Chris Centofanti John E. Price Carrie Nikayin Sina Misak Cheryl J. Flood Pamela D. Kiedrowski Ken Alhazzani Waleed 9 2018 46 9 e825 e873 0090-3493 10.1097/ccm.0000000000003299 https://doi.org/10.1097/ccm.0000000000003299 Delirium Nature Reviews Disease Primers Wilson Jo Ellen Mart Matthew F. Cunningham Colm Shehabi Yahya Girard Timothy D. MacLullich Alasdair M. J. Slooter Arjen J. C. Ely E. Wesley Springer Science and Business Media LLC 12 11 2020 6 1 90 2056-676X 10.1038/s41572-020-00223-4 33184265 PMC9012267 https://doi.org/10.1038/s41572-020-00223-4 Occurrence Rate of Delirium in Acute Stroke Settings: Systematic Review and Meta-Analysis Stroke Shaw Robert C. Walker Graham Elliott Emma Quinn Terence J. 11 2019 50 11 3028 3036 0039-2499 10.1161/strokeaha.119.025015 https://doi.org/10.1161/strokeaha.119.025015 Antipsychotics for Preventing Delirium in Hospitalized Adults: A Systematic Review Annals of Internal Medicine Oh Esther S. Needham Dale M. Nikooie Roozbeh Wilson Lisa M. Zhang Allen Robinson Karen A. Neufeld Karin J. 3 9 2019 171 7 474 0003-4819 10.7326/m19-1859 https://doi.org/10.7326/m19-1859 Antipsychotics for Treating Delirium in Hospitalized Adults: A Systematic Review Annals of Internal Medicine Nikooie Roozbeh Neufeld Karin J. Oh Esther S. Wilson Lisa M. Zhang Allen Robinson Karen A. Needham Dale M. 3 9 2019 171 7 485 0003-4819 10.7326/m19-1860 https://doi.org/10.7326/m19-1860 Non-pharmacologic interventions for the prevention of delirium in the intensive care unit: An integrative review Nursing in Critical Care Sahawneh Fursan Boss Lisa 20 1 2021 26 3 166 175 1362-1017 10.1111/nicc.12594 https://doi.org/10.1111/nicc.12594 Mobilization in the evening to prevent delirium: A pilot randomized trial Nursing in Critical Care Nydahl Peter McWilliams David Weiler Norbert Borzikowsky Christoph Howroyd Fiona Brobeil Angelika Lindner Matthias von Haken Rebecca 2022 27 4 519 527 1362-1017 10.1111/nicc.12638 https://doi.org/10.1111/nicc.12638 Consensus and variations in opinions on delirium care: a survey of European delirium specialists International Psychogeriatrics Morandi A. Davis D. Taylor J. K. Bellelli G. Olofsson B. Kreisel S. Teodorczuk A. Kamholz B. Hasemann W. Young J. Agar M. de Rooij S. E. Meagher D. Trabucchi M. MacLullich A. M. Cambridge University Press (CUP) 20 8 2013 25 12 2067 2075 1041-6102 10.1017/s1041610213001415 23962713 PMC3819184 https://doi.org/10.1017/s1041610213001415 Delirium: A Survey of Healthcare Professionals’ Knowledge, Beliefs, and Practices Journal of the American Geriatrics Society Sinvani Liron Kozikowski Andrzej Pekmezaris Renee Akerman Meredith Wolf-Klein Gisele 23 11 2016 64 12 0002-8614 10.1111/jgs.14544 https://doi.org/10.1111/jgs.14544 Attitudes, knowledge and practices concerning delirium: a survey among intensive care unit professionals Nursing in Critical Care Trogrlić Zoran Ista Erwin Ponssen Huibert H Schoonderbeek Jeannette F Schreiner Frodo Verbrugge Serge J Dijkstra Annemieke Bakker Jan van der Jagt Mathieu 20 3 2016 22 3 133 140 1362-1017 10.1111/nicc.12239 https://doi.org/10.1111/nicc.12239 Survey among critical care nurses and physicians about delirium management Nursing in Critical Care Nydahl Peter Dewes Michael Dubb Rolf Hermes Carsten Kaltwasser Arnold Krotsetis Susanne von Haken Rebecca 18 5 2017 23 1 23 29 1362-1017 10.1111/nicc.12299 https://doi.org/10.1111/nicc.12299 Implementation of an ICU Bundle: An Interprofessional Quality Improvement Project to Enhance Delirium Management and Monitor Delirium Prevalence in a Single PICU Pediatric Critical Care Medicine Simone Shari Edwards Sarah Lardieri Allison Walker L. Kyle Graciano Ana Lia Kishk Omayma A. Custer Jason W. 6 2017 18 6 531 540 1529-7535 10.1097/pcc.0000000000001127 https://doi.org/10.1097/pcc.0000000000001127 Delirium on stroke units: a prospective, multicentric quality-improvement project Journal of Neurology Nydahl Peter Baumgarte Friederike Berg Daniela Bergjan Manuela Borzikowsky Christoph Franke Christiana Green Diana Hannig Anisa Hansen Hans Christian Hauss Armin Hansen Uta Istel Rahel Krämer Norma Krause Karita Lohrmann Renée Mohammadzadeh-Vazifeh Mohammad Osterbrink Jürgen Palm Frederick Petersen Telse Schöller Bernd Stolze Henning Zilezinski Max Meyne Johannes Margraf Nils G. Springer Science and Business Media LLC 14 2 2022 269 7 3735 3744 0340-5354 10.1007/s00415-022-11000-6 35157137 PMC9217833 https://doi.org/10.1007/s00415-022-11000-6 The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies Annals of Internal Medicine von Elm Erik Altman Douglas G. Egger Matthias Pocock Stuart J. Gøtzsche Peter C. Vandenbroucke Jan P. for the STROBE Initiative 16 10 2007 147 8 573 77 0003-4819 10.7326/0003-4819-147-8-200710160-00010 https://doi.org/10.7326/0003-4819-147-8-200710160-00010 Psychometric properties and feasibility of instruments for the detection of delirium in older hospitalized patients: a systematic review International Journal of Geriatric Psychiatry van Velthuijsen Eveline L. Zwakhalen Sandra M. Warnier Ron M. Mulder Wubbo J. Verhey Frans R. Kempen Gertrudis I. 21 2 2016 31 9 974 989 0885-6230 10.1002/gps.4441 https://doi.org/10.1002/gps.4441 Prevalence, severity, and nature of preventable patient harm across medical care settings: systematic review and meta-analysis Bmj Panagioti Maria Khan Kanza Keers Richard N Abuzour Aseel Phipps Denham Kontopantelis Evangelos Bower Peter Campbell Stephen Haneef Razaan Avery Anthony J Ashcroft Darren M BMJ 17 7 2019 366 l4185 0959-8138 10.1136/bmj.l4185 31315828 PMC6939648 https://doi.org/10.1136/bmj.l4185 Reduced Admissions for Cerebrovascular Events During COVID-19 Outbreak in Italy Stroke Sacco Simona Ricci Stefano Ornello Raffaele Eusebi Paolo Petraglia Luca Toni Danilo Rota Eugenia Bruzzone Gianluca Testa Lucia Bongioanni Roberta Rosso Mara Labate Carmelo Tarletti Roberto Cantello Roberto Fleetwood Thomas Melis Fabio Imperiale Daniele Amarù Salvatore Reggiani Monica Ruiz Luigi Cipriano Elia Ferrandi Delfina Julita Patrizia Africa Liana Meinieri Piero Grasso Maria Federica Servo Serena Cavallo Roberto Chianale Gigliola Naldi Andrea Cerrato Paolo Rubino Elisa Giossi Alessia Puglisi Valentina Vinciguerra Luisa Santilli Ignazio Bordo Bianca Maria Marcheselli Simona Bottini Julia D’Alessandro Caterina Mariotto Micieli Giuseppe Cavallini Anna Canavero Isabella Muscia Francesco Nuzzaco Graziamaria Ciccone Alfonso Silvestrelli Giorgio Salmaggi Andrea Sangalli Davide Zanferrari Carla Fanucchi Simona Ranieri Michela Beretta Simone Ferrarese Carlo Pasini Francesco Santangelo Francesco Checcarelli Nicoletta Beretta Sandro Bazzi Paola Camerlingo Massimo Tognozzi Marcello Caneve Giorgio Adami Alessandro Quatrale Rocco Critelli Adriana Bartolomei Luigi Masato Maela Perini Francesco De Boni Antonella Disco Caterina Baracchini Claudio Pieroni Alessio Lerario Roberto Russo Monia Polo Alberto Danese Alessandra Valentinis Luca Baldi Antonio Tonello Simone Paladin Francesco Tonon Agnese Bonetti Bruno Cappellari Manuel Teatini Francesco Dossi Roberto Currò Franchini Enrica Giometto Bruno Bignamini Valeria Manganotti Paolo Naccarato Marcello Gigli Gian Luigi Lorenzut Simone Merlino Giovanni Valente Mariarosaria Rana Michele Gentile Carolina Tassinari Tiziana Sugo Annalisa Saia Valentina Balestrino Maurizio Coccia Alberto Finocchi Cinzia Valzania Franco Zedde Maria Luisa Toschi Giulia Longoni Marco Paolucci Matteo Tugnoli Valeria Querzani Pietro Padroni Marina Meletti Stefano Bigliardi Guido Dall’Acqua Maria Luisa Zini Andrea Gentile Mauro Migliaccio Ludovica Chiti Alberto Tassi Rossana Martini Giuseppe Nencini Patrizia Lamassa Maria Mancuso Michelangelo Orlandi Giovanni Ferrari Elena Marconi Roberto Gallerini Simone Groggia Vincenzo Volpi Gino Menichetti Chiara Spolveri Stefano Silvestrini Mauro Viticchi Giovanna Buratti Laura Pelliccioni Giuseppe Potente Eleonora Mazzoli Tatiana Marsili Erica Cenciarelli Silvia Picchioni Antonella Costantini Franco Colosimo Carlo Paciaroni Maurizio Caso Valeria Rasura Maurizia Beccia Mario Falcone Nicola Di Stefano Marisa Cecconi Emanuela Anticoli Sabrina Pezzella Francesca Romana Mangiardi Marilena Plocco Maurizio Magarelli Maria Saggese Carlo Emanuele Berto Irene Altavista Maria Concetta Roberti Cinzia Diomedi Marina Sallustio Fabrizio Rocco Alessandro Cupini Letizia Maria Bonaffini Novella De Angelis Maria Vittoria Digiovanni Anna Rispoli Marianna Orlandi Berardino Santis Federica De Colangeli Enrico Blasio Francesco Di Carmine Caterina Di Tocco Pierluigi Melis Maurizio Moller Jessica Saddi Valeria Manca Antonio Baule Antonio Caddeo Antonello Iorio Nicola Napoletano Rosa di Gregorio Maria Volpe Giampiero D’Onofrio Florindo Spitaleri Daniele Barbarini Leonardo Barbagallo Gaetano Caggiula Marcella Ardito Bonaventura Noia Domenico Di Viesti Pietro Di Leone Maurizio Angelo Inchingolo Vincenzo Petruzzellis Marco Rizzo Federica Savarese Mariantonietta Petrone Alfredo Galati Franco Arcudi Luciano Branca Damiano Aridon Paolo Arnao Valentina Musolino Rosa Dell’Aera Cristina Francalanza Isabella Grimaldi Luigi Arnao Valentina Gammino Matilde Giordano Antonello Zelante Giuseppe Sanzaro Enzo Gasparro Antonio Ovid Technologies (Wolters Kluwer Health) 12 2020 51 12 3746 3750 0039-2499 10.1161/strokeaha.120.031293 33059543 PMC7678662 https://doi.org/10.1161/strokeaha.120.031293 Querschnittsstudie zu Arbeitsbedingungen und Versorgungsqualität in der Versorgung von COVID-19-Patienten Der Anaesthesist Kaltwasser Arnold Pelz Sabrina Nydahl Peter Dubb Rolf Borzikowsky Christoph Springer Science and Business Media LLC 9 2 2021 70 9 753 760 0003-2417 10.1007/s00101-021-00919-6 33564892 PMC7872114 https://doi.org/10.1007/s00101-021-00919-6 Consequences of visiting restrictions during the COVID-19 pandemic: An integrative review International Journal of Nursing Studies Hugelius Karin Harada Nahoko Marutani Miki 9 2021 121 104000 0020-7489 10.1016/j.ijnurstu.2021.104000 34242976 PMC8196532 https://doi.org/10.1016/j.ijnurstu.2021.104000 Factors associated with changes in nurses' emotional distress during the COVID-19 pandemic Applied Nursing Research Brown Robin Da Rosa Patricia Pravecek Brandi Carson Paula Elsevier BV 2 2023 69 151659 0897-1897 10.1016/j.apnr.2022.151659 36635014 PMC9745970 https://doi.org/10.1016/j.apnr.2022.151659 Outcome switching in randomized controlled oncology trials reporting on surrogate endpoints: a cross-sectional analysis Scientific Reports Falk Delgado Alberto Falk Delgado Anna Springer Science and Business Media LLC 23 8 2017 7 1 9206 2045-2322 10.1038/s41598-017-09553-y 28835682 PMC5569019 https://doi.org/10.1038/s41598-017-09553-y Comparison of Clinical Trial Changes in Primary Outcome and Reported Intervention Effect Size Between Trial Registration and Publication JAMA Network Open Chen Tao Li Chao Qin Rui Wang Yang Yu Dahai Dodd James Wang Duolao Cornelius Victoria American Medical Association (AMA) 19 7 2019 2 7 e197242 2574-3805 10.1001/jamanetworkopen.2019.7242 31322690 PMC6646984 https://doi.org/10.1001/jamanetworkopen.2019.7242 Factors associated with nurses emotional distress during the COVID-19 pandemic Applied Nursing Research Da Rosa Patricia Brown Robin Pravecek Brandi Carotta Christin Garcia Aileen S. Carson Paula Callies Dannica Vukovich Matthew Elsevier BV 12 2021 62 151502 0897-1897 10.1016/j.apnr.2021.151502 34814998 PMC8463109 https://doi.org/10.1016/j.apnr.2021.151502 How to deal with a temporary suspension and restarting your trial: our experiences and lessons learnt Trials Constable Lynda Davidson Tracey Breeman Suzanne Cotton Seonaidh McDonald Alison Wileman Samantha Norrie John Springer Science and Business Media LLC 5 9 2020 21 1 765 1745-6215 10.1186/s13063-020-04705-4 32891161 PMC7474317 https://doi.org/10.1186/s13063-020-04705-4 It is unprecedented: trial management during the COVID-19 pandemic and beyond Trials Mitchell Eleanor J. Ahmed Khaled Breeman Suzanne Cotton Seonaidh Constable Lynda Ferry Gillian Goodman Kirsteen Hickey Helen Meakin Garry Mironov Katy Quann Niamh Wakefield Natalie McDonald Alison Springer Science and Business Media LLC 11 9 2020 21 1 784 1745-6215 10.1186/s13063-020-04711-6 32917258 PMC7484918 https://doi.org/10.1186/s13063-020-04711-6 Managing clinical trials during COVID-19: experience from a clinical research facility Trials Shiely Frances Foley Jean Stone Amy Cobbe Emma Browne Shaunagh Murphy Ellen Kelsey Maeve Walsh-Crowley Joanne Eustace Joseph A. Springer Science and Business Media LLC 18 1 2021 22 1 62 1745-6215 10.1186/s13063-020-05004-8 33461595 PMC7812560 https://doi.org/10.1186/s13063-020-05004-8 Conducting clinical trials during the COVID-19 pandemic—a collaborative trial network response Trials Robison Laura on behalf of the Australasian Kidney Trials Network Cho Yeoungjee Viecelli Andrea K. Johnson David W. Hawley Carmel M. Valks Andrea Paul-Brent Peta-Anne Stastny Ruth Varghese Julie Kiriwandeniya Charani Pascoe Elaine M. Vergara Liza A. Fahim Magid A. Boudville Neil Krishnasamy Rathika Reidlinger Donna Springer Science and Business Media LLC 14 4 2021 22 1 278 1745-6215 10.1186/s13063-021-05200-0 33853661 PMC8045567 https://doi.org/10.1186/s13063-021-05200-0 Quality control in multicentric clinical trials. An experience of the EORTC Gynecological Cancer Cooperative Group European Journal of Cancer Favalli G Vermorken J.B Vantongelen K Renard J Van Oosterom A.T Pecorelli S 6 2000 36 9 1125 1133 0959-8049 10.1016/s0959-8049(00)00090-3 https://doi.org/10.1016/s0959-8049(00)00090-3