ObjectiveTo evaluate the reliability and validity of Guideline Implementation Success Assessment Tool (A-GIST). MethodsWith the guideline for the prevention and treatment of type 2 diabetes mellitus in China (2020 edition) as the target guideline, health care providers and patients from different hospitals across the country were investigated by questionnaire using A-GIST. Spearman-Brown coefficient and Cronbach's α coefficient were used to evaluate the split-half reliability and internal consistency reliability, while the structural validity, convergent validity and discriminant validity were investigated by confirmatory factor analysis based on structural equation. ResultsThe internal consistency reliability and split half reliability coefficients of the whole tool and each dimension ranged from 0.650 to 0.986. The scale-level content validity index (S-CVI/Ave) of content validity was 0.846. Confirmatory factor analysis showed that, the χ2/df of two sections of the tool were 8.695 and 6.123, respectively. The root mean square residual (RMR), the standard root mean square residual (SRMR) and the root mean square error of approximation (RMSEA) were under or almost under the threshold. Besides, the goodness-of-fit index (GFI) of them were 0.901 and 0.822, the adjusted goodness-of-fit index (AGFI) were 0.836 and 0.787, and the parsimonious normed fit index (PNFI) were 0.545 and 0.788, respectively. ConclusionGuideline Implementation Success Assessment Tool (A-GIST) was proved to be valid and reliable, and it shows that it is necessary to optimize the items under the dimensions of maintenance and evaluation of diagnosis and treatment effect in the future.
ObjectiveTo evaluate the reliability and validity of the Quality of Working Life Scale (QWL7-32). MethodsThe QWL7-32 scale was used to survey 487 drilling workers. The presence of chronic diseases was regarded as an effector for evaluating physical health, and the result of SCL-90 measurement was regarded as an effector for evaluating psychological health. The reliability and validity of the scale were statistically analyzed. ResultsThe results of the Pearson correlation coefficient was 0.713, the Cronbach's alpha coefficient was 0.920, and the Splithalf reliability coefficient was 0.942. The result of confirmatory factor analysis showed that the construct validity of scale was good, and the accumulative rate of 7 variances was 62.59%. The results of correlation analysis and t test showed that the validity of scale criterion was also good. In QWL7-32 scale, each dimension showed a good correlation with its relevant item but poor correlation with any other items. ConclusionThe QWL7-32 has a good reliability and validity.
ObjectivesThis study aimed to evaluate the validity and reliability of the clinical practice guidelines (CPGs) applicability evaluation tool, a preliminary revised tool, by using it to appraise specific clinical guidelines.MethodsMedical staffs were sampled from relevant departments in domestic medical institutions to use tool to evaluate the two guidelines. Spearman-Brown coefficient of odd-even split-half method and Cronbach's alpha coefficient were used to evaluate the split-half reliability and internal consistency reliability. The convergent and discriminant validity were evaluated by correlation analysis and correlation coefficient comparison hypothesis test, and the structural validity was investigated by confirmatory factor analysis based on structural equation.ResultsThe split-half reliability of the evaluation tool was 0.86, and the Cronbach's coefficient of the whole tool and each dimension were greater than 0.7 for two guidelines. The success rates of tool convergent and discriminant validity calibration were 100%. In the second-order confirmatory factor analysis model, the χ2 and df were 3.38 and 2.46, the comparative fit index (CFI) were 0.872 and 0.974, the goodness of fit index (GFI) were 0.954 and 0.983, and the adjusted goodness of fit index (AGFI) were 0.846 and 0.959 for two guidelines respectively. Both standard root mean square residual (SRMR) and root mean square error of approximation (RMSEA) were less than 0.09. Both P values of RMSEA hypothesis test were greater than 0.05.ConclusionsThe evaluation scale is a valid and reliable instrument for assessing the applicability of CPGs, which should be further evaluated in practical applications in the future.
ObjectiveTo translate the King’s Brief Interstitial Lung Disease (K-BILD) to Chinese, so as to provide an well reliability and validity assessment instrument for health status of patients with interstitial lung disease.MethodsBrislin’s transition model, six expert’s panel and pre-survey were used for initial Chinese version of K-BILD. Items analysis, exploratory factor analysis (EFA), confirmatory factor analysis (CFA), internal consistency reliability and test-retest reliability were used for validity and reliability test with 122 respondents.ResultsTen-item Chinese version of K-BILD were proved to have great psychometric qualities, two factors were extracted by EFA, which could explain 63.35% of the total variance. Furthermore, the CFA demonstrates the fit indices of two-factors mode: χ2/df=0.797, RMSEA=0.000, NFI=0.848, IFI=1.048, CFI=1.000, TLI=1.071. Cronbach’s α and Guttman Split-half were 0.893 and 0.861, respectively. Besides, the test-retest reliability of the scale was 0.805.ConclusionThe Chinese version of K-BILD scale has good validity and reliability, which is applicable for health status assessment in patient with interstitial lung disease.
ObjectiveTo develop a survey questionnaire on preferences and values regarding perineal injury prevention measures during pregnancy and conduct reliability and validity tests. MethodsCombining literature reviews, qualitative interviews, and expert consultations, we summarized key elements of perineal injury prevention during pregnancy and synthesized the best evidence. Through multiple discussions within the core working group, a survey questionnaire on preferences and values regarding perineal injury prevention measures during pregnancy was formulated. Using convenience sampling, pregnant women were recruited, and a pre-survey was conducted using the questionnaire. Pre-survey results were analyzed using item analysis and reliability and validity testing methods to validate and refine the questionnaire. ResultsThe questionnaire was compiled based on the theory of evidence-based decision-making. The initial version of the questionnaire was developed by combining systematic evaluation, network meta-analysis, and semi-structured interviews. The questionnaire was modified and improved through expert consultation, group discussion, and pre-investigation, which ensured that the questionnaire had good reliability, validity, and practicability. The Cronbach's α coefficient was 0.87, the split-half reliability was 0.71, and the content validity index was 0.97 of the survey questionnaire. ConclusionThe present version of the perineal injury preventive measures preference and values questionnaire has good reliability, validity, and practicability. It can serve as a valuable tool for investigating preferences and values related to perineal injury prevention during pregnancy.
Objective To primarily test the reliability and validity of the Kashin-Beck Disease (KBD) affected big joints function assessing system for adult Tibetans in Rangtang County. Method From June to July 2009, 142 KBD patients were investigated with the function assessing system in Rangtang County of Ngawa. Cronbach’s α coefficient was calculated to estimate internal consistency reliability. Pearson’s r for the correlation of the items with the total score of the scale was computed to test the internal validity. Principal component factor analysis with varimax rotation analysis was conducted to explore construct validity. Result Both the response and complete rates of the scale were 100%. The time for completing the scale was 7.8±3.4 minutes. Cronbach’s α was 0.857, which revealed satisfactory internal consistency reliability. Pearson correlation analysis revealed significant correlation between the scores of each item and the total score of the scale (Plt;0.05). Pearson’s r value of each item was more than 0.4, only except the items of “sitting with legs crossed” and “standing at attention”. The principal factor analysis extracted three latent factors explaining 68.1% of the variation together. The latent factors weights of the items were over 0.4 except the items of “standing at attention”, "taking food” and “wiping after defecation”. Conclusion The reliability and validity of KBD affected big joints function assessing system for adult Tibetans in Rangtang County was good in this primary test, the function assessing system has to be widely applied and further assessed among Tibetans suffered with KBD, in order to provide a standard evaluation criterion in KBD integrate control.
Objective To evaluate the reliability and validity of IBS-QOL scale in irritable bowel syndrome (IBS) patients. Methods IBS-QOL scale was applied to survey the quality of life of 123 IBS patients. The split-half and internal consistency method were used to evaluate the reliability, and with the construct method to evaluate the validity. Results The split-half reliability was 0.86. Cronbach’s α-coefficient of all domains was between 0.71 and 0.89 except body image and food avoidance; In the correlation analysis, the correlations between items and its subscale structure were above 0.60 (except interference with activity), but there were no correlations between items and other subscale structure. Eight components from factorial analysis were in accordance with theoretical structure.The cumulative contribution rate was 72.7%. Conclusions The reliability and validity of IBS-QOL scale are acceptable. It might be useful for us to assess the QOL of IBS patients in China.
Objective To develop an evaluation tool for the screening of high risk population for oral complications in critically ill patients, which can be performed accurately and scientifically. Methods Basing on the related foreign oral assessment scale, combined with the method of brainstorming, expert consultation, method of clinical status and so on, the item pool of the assessment scale was determined. Five nursing experts and two oral experts assessed the content validity and 50 ICU nurses were tested. Then, the screening accuracy of the assessment scale was proved by application in 100 critically ill patients selected randomly. Results The Cronbach’s a coefficient of final version of the High Risk Assessment Scale for Oral Complications in Critically Ill Patients (including seven parts contents of oral health assessment and oral pH value test) was 0.815, the content validity index (Sr-CVI/Ave) was 0.932. The results of 50 nurses to the 91.2% assessment items of the assessment scale were very important and important. For screening related indicators of oral complications in high-risk patients, the sensitivity of the assessment scale was 97.53%, the specificity was 94.11%, the positive predictive value was 98.75%, the negative predictive value was 88.89%, and the crude agreement was 95%. Conclusion There are good reliability, validity and a high accuracy of screening test in the High Risk Assessment Scale for Oral Complications in Critically Ill Patients. It can be used for screening patients at high risk for oral complications in critically ill patients, and help clinical nurses to complete the oral health status of the critically ill patients quickly.
ObjectivesTo compare and analyze existing pharmaceutical economic evaluations quality assessment instruments, and to provide suggestions on how to choose the most appropriate instrument.MethodsPubMed, EMbase, ScienceDirect, Web of Science, CNKI, WanFang Data and VIP databases were electronically searched to collect studies on existing pharmaceutical economic evaluations quality assessment instruments from inception to December, 2017. Two reviewers independently screened literature, extracted data and analyzed studies in terms of items, design methods, scopes and characteristics.ResultsTwelve original checklists with good reliability and validity were found. The first quality assessment method was designed in 1987 and the latest one was published in 2013. The number of checklist items ranged from 11 to 61.ConclusionThere is no consolidated method for assessing the quality of pharmaceutical economics evaluations. Evaluators can choose appropriate evaluation tools according to the purpose, type and operability of evaluation.
ObjectiveTo evaluate the reliability and validity of the instrument of clinical applicability of guidelines (version 2.0). MethodsThe experts of domestic medical institutions were investigated by questionnaire, and the instrument of clinical applicability of guidelines (version 2.0) were evaluated the guidelines for the diagnosis and treatment of tinea mantis and tinea pedis (revised edition 2017) and the guidelines for the diagnosis and treatment of cerebral hemorrhage in China (2019). Using Cronbach's α coefficient and Spearman-Brown coefficient to evaluate the inherent reliability and split-half reliability. The content validity was evaluated by calculating the content validity index of the item level and the adjusted Kappa value. The correlation coefficient between each item and the dimension and the hypothesis test were used to evaluate the convergent and discriminant validity. The structural validity was evaluated by using structural equation model to evaluate the structural validity of the tool. ResultsThe Cronbach's α coefficient and Spearman-Brown coefficient of the instrument of clinical applicability of guidelines (version 2.0) were both greater than 0.7, the content validity index (S-CVI/Ave) were more than 0.8, the success rates of convergent were 100%, and the success rates of discriminant validity calibration were 100% and 96%. In the second-order confirmatory factor analysis model, the χ2/ df were less than 3, the fitting index (CFI), the goodness of fit index (GFI) and the adjustment goodness of fit index (AGFI) were all greater than 0.9. The root mean square residual (RMR) were all less than 0.05, and approximate error root mean square (RMSEA) were less than 0.09. The P value of RESEA hypothesis test were more than 0.05. ConclusionThe instrument of clinical applicability of guidelines (version 2.0) has good reliability and validity, which can be further verified in practical application in the future.