ObjectivesTo assess the methodological and reporting quality of surgical meta-analyses published in English in 2014.MethodsAll meta-analyses investigating surgical procedures published in 2014 were selected from PubMed and EMbase. The characteristics of these meta-analyses were collected, and their reporting and methodological quality were assessed by the PRISMA and AMSTAR, respectively. Independent predictive factors associated with these two qualities were evaluated by univariate and multivariate analyses.ResultsA total of 197 meta-analyses covering 10 surgical subspecialties were included. The mean PRISMA and AMSTAR score (by items) were 22.2±2.4 and 7.8±1.2, respectively, and a positive linear correlation was found between them with a R2 of 0.754. Those meta-analyses conducted by the first authors who had previously published meta-analysis was significantly higher in reporting and methodological quality than those who had not (P<0.001). Meanwhile, there were also significant differences in these reporting (P<0.001) and methodological (P<0.001) quality between studies published in Q1 ranked journals and (Q2+Q3) ranked jounals. On multivariate analyses, region of origin (non-Asiavs. Asia), publishing experience of first authors (ever vs. never), rank of publishing journals (Q1 vs. Q2+Q3), and preregistration (presence vs. absence) were associated with better reporting and methodologic quality, independently.ConclusionThe reporting and methodological quality of current surgical meta-analyses remained suboptimal, and first authors' experience and ranking of publishing journals were independently associated with both qualities. Preregistration may be an effective measure to improve the quality of meta-analysis, which deserves more attention from future meta-analysis reviewers.
ObjectiveTo systematically summarize and evaluate the existing evidence of Qishen Yiqi dropping pill (QSYQ) in the treatment of chronic heart failure (CHF), and to evaluate its quality. MethodsThe PubMed, Cochrane Library, EMbase, Web of Science, CNKI, CBM, WanFang Data databases were electronically searched to collect systematic reviews/meta-analyses(SRs/MAs) related to objectives from inception to December 31, 2022. Two researchers independently screened the literature and extracted data, and assessed the methodological quality, risk of bias, reporting quality, and quality of evidence of included SRs/MAs by using Assessment of Multiple Systematic Reviews 2 (AMSTAR-2), the Risk of Bias in Systematic(ROBIS) scale, the list of Preferred Reporting Items for Systematic Reviews and Meta-Analysis(PRISMA), and the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) system. ResultsThis overview included 17 SRs/MAs. The methodological quality, reporting quality, risk of bias, and quality of evidence for outcome measures of SRs/MAs were all unsatisfactory. All SRs/MAs were of low quality according to the results of the AMSTAR-2 assessment. And only a small number of SRs/MAs were assessed as low risk of bias based on the results of the ROBIS assessment. The evaluation results of the PRISMA checklist showed that the report quality of the 24 studies included was relatively complete. According to the GRADE system evaluation results, 94% of the 84 outcome indicators were low-quality and very low-quality evidence. Limitations were the main factors leading to their degradation, followed by publication bias, inconsistency, imprecision and indirectness. ConclusionAt present, QSYQ has good clinical efficacy in the treatment of CHF, but the standardization and scientificity of clinical research and secondary research reports are insufficient, resulting in low quality of clinical recommendations evidence. In the future, it is necessary to further standardize and improve the quality of clinical and secondary research.
ObjectivesTo evaluate the methodology quality and report quality of the published systematic reviews/meta-analyses (SRs/MAs) of pediatric tuina domestically and abroad.MethodsCBM, VIP, CNKI, WanFang Data, PubMed, EMbase, and The Cochrane Library were electronically searched to collect published pediatric tuina SRs/MAs from inception to December 10th, 2018. The SRs/MAs which includes scale evaluation used AMSTAR2 and the PRISMA report quality evaluation tool to systematically review methodology, adopts Excel to carry out data collation and statistical analysis. ResultsA total of 18 studies (14 in Chinese and 4 in English) on the SRs/MAs of pediatric tuina were finally included. In terms of methodological quality, 6 studies were of low quality and 12 studies were of very low quality. All studies did not explain the reasons for adopting a particular research design type, and few of them explained the pre-plan, exclusion list, reasons and funding. In terms of report quality, 7 studies were relatively complete, 10 studies had certain defects and one study had serious defects. The existing problems were program and registration, comprehensive retrieval, information sources, financial support and so on. ConclusionsSRs/MAs of pediatric tuina have different degrees of issues in terms of methodological quality and report quality which still require further improvement and continuous strengthening.
ObjectivesTo comprehensively evaluate the methodological quality and applicability of the results of systematic reviews on acupuncture treatment for primary depression.MethodsWeb of Science, EMbase, PubMed, The Cochrane Library, CNKI, CBM, WanFang Data and VIP databases were electronically searched to collect systematic reviews/meta-analyses on acupuncture treatment for primary depression from inception to December 5th, 2018. Two researchers independently screened and extracted data by using tools of AMSTAR 2 to evaluate the methodological quality, using ROBIS to assess risk of bias, and using CASP-S.R to evaluate the applicability of the results.ResultsA total of 18 systematic reviews/meta-analyses were included, and all focused on acupuncture intervention, including 2 primary outcome indicators. According to AMSTAR 2 evaluation results, there were 4 high quality studies, 12 medium quality studies and 2 low quality studies; ROBIS results found 10 high bias risk studies, 7 low bias risk studies and 1 unclear; CASP-S.R showed only 4 design studies applicable to local individuals, and there were no studies on the relationship between design benefits, hazards and costs.ConclusionsThe quality of systematic reviews/meta-analyses for acupuncture treatment of primary depression is moderate, however with a certain bias. Most studies may not directly benefit local individuals. All studies have no relationship with cost hazards. It is expected for further reviewers to strictly follow systematic evaluation method to improve research quality and reduce bias, while the applicability of the systematic review to individuals from different regions should be considered as well as the relationship between the benefit and cost hazard. In addition, more valid RCTs are required to provide higher quality evidence and explore correlated and comprehensive mechanism.
Objectives To evaluate the methodological bias and the reliability of the conclusions of systematic reviews on acupuncture for polycystic ovary syndrome. Methods We comprehensively searched PubMed, EMbase, The Cochrane Library, CBM, CNKI and WanFang Data to collect systematic reviews on acupuncture for polycystic ovary syndrome from the establishment time of databases to January 5th, 2018. The AMSTAR tool was applied for methodological quality assessment of included studies and the GRADE system was applied for evidence quality assessment of included outcomes of systematic reviews. Results A total of 11 systematic reviews were included. The results of assessment using AMSTAR showed that, among the 11 items, most problems occurred in Item 5 " Were there any lists of research articles included and excluded”, followed by Item 1" Was an‘a prior’design provided?”and Item 11" Were potential conflict of interest included?”. GRADE grading results showed that quality of evidence for the outcome measure were" low”or" very low”. Conclusions Current acupuncture treatment of polycystic ovary syndrome has a certain effect, however, the quality of evidence is low. Thus, physicians should apply the evidence to make decision on acupuncture for polycystic ovary syndrome with caution in clinical practice and consider the actual situation, combined with the patient’s value preferences and economic factors.
ObjectivesTo conduct an overview of systematic reviews (SRs) on Tuina from 2013 to 2017, and to explore recent research improvements on Tuina.MethodsPubMed, Web of Science, The Cochrane Library, SpringerLink e-book database, CNKI, VIP, WanFang Data and CBM databases were searched to collect SRs including randomized controlled clinical trials on Tuina from January 1st, 2013 to December 31st, 2017. Two reviewers independently screened literature, extracted data, and used AMSTAR 2 tool and PRISMA statement to assess methodology quality and reporting quality of included studies, respectively. The R 3.4.3 software was used to analyze data.ResultsA total of 8 SRs studies were included in the overview. The studied diseases involved radiculopathy cervical spondylotic, myelopathy cervical spondylotic, constipation, child anorexia, child diarrhea and external humeral epicondylitis. The results of above SRs showed that massage might be superior to other interventions in clinical efficacy, curative effects or total effective rate. However, due to the low quality of included studies of SRs, further evidence from high-quality clinical studies is required to verify above conclusions. For the results of AMSTAR 2 assessment, all 8 SRs were rated as very low quality. The quantity of items accomplished for each SR ranged from 7 to 13, 2 SRs had low methodological quality (percentage of accomplishment or partial accomplishment <50.0%) and 6 SRs with high methodological quality (percentage of accomplishment or partial accomplishment ≥50.0%). All 8 SRs did not report item 2 "Whether to declare research methods", item 10 "Whether reports have included funding sources for each study" and item 11 "Whether reports used the correct statistical method". The results of PRISMA assessment showed that all SR had good quality of reporting. The accomplished items number of each SR ranged from 22 to 26. However, there were defects in item 5(0), item 16(25.0%) and item 23(25.0%). All SRs did not report item 5 "Whether to declare research program".ConclusionsThis study finds that Tuina has supportive evidence-based medical evidence for treating anorexia, cervical spondylosis and other diseases, however, the SRs of Tuina are yet needed to be improved in terms of standardized degree. Therefore, establishing a reporting consolidated standard for evidence-based medicine on Tuina in order to improve the quality of clinical studies so as to provide clinicians with high-quality evidence is the focus of our further research.
ObjectivesTo overview the systematic reviews of traditional Chinese herb injections for viral pneumonia.MethodsCNKI, CBM, WanFang Data, VIP, PubMed, Web of Science, The Cochrane Library and EMbase databases were electronically searched to collect systematic reviews (SRs) of traditional Chinese herb injections for viral pneumonia from inception to March 2020. Two reviewers independently screened literature and extracted data. Then, AMSTAR 2 was used to assess the methodological quality and GRADE was used to grade the outcome indicators of included SRs.ResultsA total of 10 SRs were included, containing six Chinese herb injections (Xiyanping injection, Yanhuning injection, Tanreqing injection, Reduning injection, Shuanghuanglian injection, and Chuanhuning injection). Five items of AMSTAR 2 were reported well, and two items were not reported in any of the included SRs, and the quality was unsatisfactory. The efficacy of Chinese herb injection was superior than that of western medicine in many outcome indicators, such as antipyretic time, the pulmonary rales disappearing time, and the total clinical efficiency. The quality of evidence ranged from medium to very low.ConclusionsCurrent evidence shows that the quality of SRs of Chinese herb injections for viral pneumonia requires improvement, and most of the results show that Chinese herb injections are more effective than western medicines.
Objective To overview the systematic reviews/meta-analysis (SR/MA) for the effectiveness of yoga on patients with type 2 diabetes mellitus. Methods The CNKI, WanFang Data, VIP, CBM, PubMed, Cochrane Library, Embase, Web of Science, JBI and CINAHL databases were electronically searched to collect SR/MA on the intervention of yoga in diabetes mellitus from inception to November 6th, 2023. Two researchers independently screened the literature and extracted data. AMSTAR was used to evaluate the quality of methodology, and GRADE was used to evaluate the certainty of evidence, and the outcome indicators were statistically analyzed. Results A total of 14 SR/MA were included. The evaluation results of AMSTAR showed that 7 articles were of high quality and 7 articles were of moderate quality. The result of GRADE showed that there were 2 items of high-level evidence, 26 items of intermediate evidence, and the remaining 31 items were low-level or very low-level evidence. The results showed that yoga could significantly reduce fasting blood glucose (FBG) (moderate confidence), glycosylated hemoglobin (HA1C) (moderate confidence) and postprandial blood glucose (PPBG) levels (moderate confidence), and was also superior to other interventions in high-density cholesterol (HDL) (moderate confidence), low-density cholesterol (LDL) (moderate confidence), triglyceride (TG) (moderate confidence), total cholesterol (TC) (moderate confidence), systolic blood pressure (SBP) and diastolic blood pressure (DBP) (moderate confidence), muscle strength (high confidence), cardiorespiratory fitness (moderate confidence) and weight (moderate confidence). Conclusion The existing evidence shows that yoga has a good effect on blood glucose control (moderate confidence) and also has a certain effect on lipid parameters (moderate confidence) and anthropometric indicators (moderate confidence), but the quality and confidence of the current research evidence are low. Future researchers should standardize the research design to provide more high-quality evidence for the prognosis and treatment of type 2 diabetes mellitus.
ObjectiveTo overview the reporting and methodology quality of systematic reviews/meta-analysis on acupuncture in the treatment of primary osteoporosis (POP).MethodsPubMed, EMbase, The Cochrane Library, CBM, WanFang Data, CNKI and VIP databases were electronically searched to collect systematic reviews/meta-analysis on acupuncture in the treatment of POP from inception to July 2018. Two reviewers independently screened literature, extracted data, and assessed the quality of systematic reviews. A Measurement Tool to Assess Systematic Reviews (AMSTAR) methodological quality score and Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) were used to assess the methodological quality and reporting quality of the systematic reviews, along with the risk of homogeneity and publication bias.ResultsA total of 11 systematic reviews/meta-analysis were included and multiple evaluations of the radar plot showed that the quality average rank scored 7.68. The major problems in studies were lack of items registration, imperfect search strategies and selection bias and so on.ConclusionThe quality of systematic reviews/meta-analysis of acupuncture in the treatment of POP is insufficient, indicating that the methodological and reporting quality of systematic reviews should be further strengthened.
Objective To evaluate the relevant systematic reviews/meta-analyses that focused on the prevention and treatment of complications after impacted tooth extraction. Methods The systematic reviews/meta-analyses on the prevention and treatment of complications after impacted tooth extraction were searched in PubMed, The Cochrane Library, CBM, CNKI and WanFang Data from inception to September 30th, 2012, and a total of 15 professional journals and the references of included studies were also retrieved manually. Two reviewers screened the literature according to the inclusion criteria and extracted the data. Then the AMSTAR was used to evaluate the quality of the included studies, and the GRADE system was used to evaluate the quality of evidence. Results A total of twelve relevant systematic reviews/meta-analyses were included, of which five focused on the prevention and treatment of dry socket, six on the prevention of swelling, seven on the prevention and treatment of pain, six on the prevention of limitation of mouth opening, two on the prevention of infection, three on the prevention of bleeding, and one on the treatment of nerve damage after tooth extraction. Based on AMSTAR, seven studies were minor limitations and five studies were moderate limitations. Based on GRADE system, two was high quality of evidence, twelve were moderate, nine were low, and seven were very low. Conclusion Currently, the systematic reviews/meta-analyses on the prevention and treatment of complications after impacted tooth extraction can provide some references for clinical practice, which should be combined with the real condition by clinical doctors when making an evidence-based decision. However, it also suggests performing more high quality and large sample studies to prove this conclusion.