【正文】 ns clear to them?/ 評(píng)價(jià)者內(nèi) Kappa 值較低，那么就需要培訓(xùn)，他們是否理解檢查的特性？是否清楚作業(yè)指導(dǎo)書(shū)？ If the Between Appraiser Kappa scores are low, each Appraiser may have a differing definition of the categories – A standardized definition can improve this situation / 評(píng)價(jià)者間 Kappa 值較低，那么每個(gè)評(píng)價(jià)者對(duì)零件分類的定義不同 –標(biāo)準(zhǔn)定義可以改變這種狀況 If improvements are made, the study should be repeated to confirm improvements have worked /如果已進(jìn)行了改進(jìn)，還需要再次研究以確認(rèn)改進(jìn)有效 15 Measurement Systems Analysis (MSA) Attribute ? Recall what ordinal data is – Categorical variables that have three or more possible levels with a natural ordering, such as strongly disagree, disagree, neutral, agree and strongly agree。 Kappa Statistics Response Kappa SE Kappa Z P(vs 0) 1 2 3 4 5 Overall Kendall39。你的決定取決于你愿意承擔(dān)的風(fēng)險(xiǎn)。 20232023 26 Measurement Systems Analysis (MSA) Attribute Attribute MSA – Supplemental Files Copyright 169。 20232023 29 Measurement Systems Analysis (MSA) Attribute Scoring Example ? 100% is target for all scores 100% indicates training required ? % Appraiser score = repeatability ? Screen % Effectiveness Score = reproducibility ? % Score vs. Attribute individual error against a known population ? Screen % Effective vs. Attribute Total error against a known population % % % % % % SCREEN % EFFECTIVE SCORE % SCREEN % EFFECTIVE SCORE vs. ATTRIBUTE % % APPRAISER SCORE % SCORE VS. ATTRIBUTE Copyright 169。 20232023 33 Measurement Systems Analysis (MSA) Attribute References Kappa Cohen J., A Coefficient of Agreement for Nominal Scales Educational and Psychological Measurement Vol. 20, pp 37– 46, 1960 Fleiss j, l., “The Measure of Interrater Agreement” Statistical Methods for Rates and Proportions 2nd Edition, John Wiley and Sons, pp. 212–304 Kendall’s Coefficient of Concordance ? Sheshkin D. J., “Kendall’s Coefficient of Concordance” Handbook of Parametric and Nonparametric Statistical Procedures, CRC Press, pp. 641–651, 1997 ? Daniel W. W., Applied Nonparametric Statistics Houghton Mifflin, pp. 326334, 1978 34 Measurement Systems Analysis (MSA) Attribute The following are trademarks and service marks of Six Sigma Academy International, LLC: Breakthrough Lean174。 20232023 35 Measurement Systems Analysis (MSA) Attribute 謝謝觀看 /歡迎下載 BY FAITH I MEAN A VISION OF GOOD ONE CHERISHES AND THE ENTHUSIASM THAT PUSHES ONE TO SEEK ITS FULFILLMENT REGARDLESS OF OBSTACLES. BY FAITH I BY FAITH 。, Breakthrough Value Services174。 20232023 31 Measurement Systems Analysis (MSA) Attribute Statistical Report Copyright 169。 for use only in pliance with SSA license. Attribute MSA Excel Method ? Allows for RR analysis within and between appraisers 可以評(píng)價(jià)者內(nèi)和評(píng)價(jià)者間的重復(fù)性和再現(xiàn)性研究 ? Test for effectiveness against standard 檢驗(yàn)和標(biāo)準(zhǔn)值比較的有效性 ? Limited to nominal data at two levels 僅限于 2水平的 nominal 數(shù)據(jù) Copyright 169。 20232023 Six Sigma Academy International, LLC All rights reserved。 P值表示純粹由于偶然而發(fā)生聯(lián)系的可能性。使用 15的標(biāo)準(zhǔn)， 1表示差， 5表示極好， Proposal Judge 1 Judge 2 Judge 3 1 4 3 3 2 4 2 4 3 5 4 5 4 3 4 4 5 3 2 1 6 2 3 2 Would you like to see more proposal to proposal variation or judge to judge? 你愿意看到更多的提議間的波動(dòng)呢還是判斷間的波動(dòng) ? Let’s use KCC to assess the degree of rater association. 17 Measurement Systems Analysis (MSA) Attribute Kendall’s Analysis In MINITAB 1. Put data into MINITAB, each judges trial in a separate column 2. To analyze, go to Stat ? Quality Tools ? Attribute Agreement Analysis 1 2 18 Measurement Systems Analysis (MSA) Attribute Kendall’s Analysis In MINITAB (Cont’d) 3. Select columns that contain the values 4. Enter Judges (Appraisers) and quantity 5. Check the box to show that the categories are ordered (this will trigger the Kendall’s calculation) 6. Select “Results” button 7. Click last option to display the results 6 5 4 3 7 Hit OK twice to execute 8 8 19 Measurement Systems Analysis (MSA) Attribute Attribute Agreement Analysis for Judge 1, Judge 2, Judge 3 Between Appraisers Assessment Agreement Inspected Matched Percent 95 % CI 6 0 (, ) Matched: All Appraisers39。 per the next slides 進(jìn)行 MTB分析 9 Measurement Systems Analysis (MSA) Attribute S V Q O 6 Q N I T Q X N Z I Z B M Q T P Z H J K M 23 Sample Kappa Exercise Begin Kappa exercise 10 Measurement Systems Analysis (MSA) Attribute Kappa Exercise – Data Collection Form P a r t N o .T r i a l 1 ( P / F )T r i a l 2 ( P / F )A g r e e / D i s a g r e e ?T r i a l 1 ( P / F )T r i a l 2 ( P / F )A g r e e / D i s a g r e e ?J u d g e 1 T r i a l 1J u d g e 2 T r i a l 2A g r e e / D i s a g r e