【正文】 ee, disagree, neutral, agree and strongly agree。你的決定取決于你愿意承擔的風(fēng)險。 20232023 29 Measurement Systems Analysis (MSA) Attribute Scoring Example ? 100% is target for all scores 100% indicates training required ? % Appraiser score = repeatability ? Screen % Effectiveness Score = reproducibility ? % Score vs. Attribute individual error against a known population ? Screen % Effective vs. Attribute Total error against a known population % % % % % % SCREEN % EFFECTIVE SCORE % SCREEN % EFFECTIVE SCORE vs. ATTRIBUTE % % APPRAISER SCORE % SCORE VS. ATTRIBUTE Copyright 169。 20232023 35 Measurement Systems Analysis (MSA) Attribute 謝謝觀看 /歡迎下載 BY FAITH I MEAN A VISION OF GOOD ONE CHERISHES AND THE ENTHUSIASM THAT PUSHES ONE TO SEEK ITS FULFILLMENT REGARDLESS OF OBSTACLES. BY FAITH I BY FAITH 。 20232023 31 Measurement Systems Analysis (MSA) Attribute Statistical Report Copyright 169。 20232023 Six Sigma Academy International, LLC All rights reserved。使用 15的標準， 1表示差， 5表示極好， Proposal Judge 1 Judge 2 Judge 3 1 4 3 3 2 4 2 4 3 5 4 5 4 3 4 4 5 3 2 1 6 2 3 2 Would you like to see more proposal to proposal variation or judge to judge? 你愿意看到更多的提議間的波動呢還是判斷間的波動 ? Let’s use KCC to assess the degree of rater association. 17 Measurement Systems Analysis (MSA) Attribute Kendall’s Analysis In MINITAB 1. Put data into MINITAB, each judges trial in a separate column 2. To analyze, go to Stat ? Quality Tools ? Attribute Agreement Analysis 1 2 18 Measurement Systems Analysis (MSA) Attribute Kendall’s Analysis In MINITAB (Cont’d) 3. Select columns that contain the values 4. Enter Judges (Appraisers) and quantity 5. Check the box to show that the categories are ordered (this will trigger the Kendall’s calculation) 6. Select “Results” button 7. Click last option to display the results 6 5 4 3 7 Hit OK twice to execute 8 8 19 Measurement Systems Analysis (MSA) Attribute Attribute Agreement Analysis for Judge 1, Judge 2, Judge 3 Between Appraisers Assessment Agreement Inspected Matched Percent 95 % CI 6 0 (, ) Matched: All Appraisers39。如果文件中有 1個或多個數(shù)字 (09)，就是不合格品。結(jié)果如下所示： Invoice Appraiser 1 Appraiser 2 Agreement? 1 Bad Bad Y 2 Good Bad N 3 Good Good Y 4 Bad Bad Y 5 Good Good Y 6 Good Good Y 7 Good Bad N 8 Good Bad N 9 Good Good Y 10 Good Good Y ? We could simply look at the percent of the time they agree as metric for between Appraiser agreement: 我們可以只考慮評價者判定一致的百分率作為衡量指標 ? But what would that not take into account? 但是還有什么沒有考慮？ _____ % agree _____ % disagree 5 Measurement Systems Analysis (MSA) Attribute Kappa pares the proportion of agreement between Appraisers after removing agreement by chance / Kappa 比較了評價者之間去除了的偶然性的一致性比率 The proportion that the judges are in agreement is Pobserved /判斷一致的比率是 Pobserved The proportion expected to occur by chance is: 由于偶然性一致的比率 Pchance = (P Insp1 Good) (P Insp2 Good) + (P Insp1 Bad)(PInsp2 Bad) 1. What would the Kappa be if the judges agreed on every part?/如果每個 零件的判定都一致， Kappa是多少？ 2. How would you interpret a Kappa of zero?怎么解釋 Kappa為 0？ 3. What would be the Kappa if the judges never agreed? 如果判定都不一 致 Kappa又是多少？ Definition Of Kappa cha ncecha nceobs erv e dP1 PPKap pa ? ??Let’s walk through the calculation by hand. 6 Measurement Systems Analysis (MSA) Attribute How To Calculate Kappa – By Hand Build contingency table Sum columns and rows Calculate Pobs by adding diagonal Calculate Pchance Calculate Kappa Pchance = (PR1bad)(PR2bad)+(PR1good)(PR2good) = (.2)(.5)+(.8)(.5) = .5 Pobs Pchance Kappa = 1 Pchance =(.)/() = .2 .8 .5 .5 Bad Good Appraiser 1 Good Bad Appraiser 2 Pobs = .5 + .2 = .7 3/10 = .3 2/10 = .2 0/10 = 0 5/10 = .5 Add Add Add Add How is this interpreted? 7 Measurement Systems Analysis (MSA) Attribute How To Interpret Kappa Results The general rule for interpreting Kappa results are as follows: 解釋Kappa的規(guī)則通常如下 ? 0 – Nonrandom disagreement 非隨機的不一致 ? – Measurement System needs attention 測量系統(tǒng)需關(guān)注 ? – Generally acceptable, improvement may be needed depending on application and risk 通常可接受，根據(jù)需要和 風(fēng)險進行改善 ? – Excellent Measurement System 極好的測量系統(tǒng) Remember, consider your Measurement System and how well the above criteria might apply. 8 Measurement Systems Analysis (MSA) Attribute Attribute Data – Kappa Exercise 1. Your pany produces documents that are filled with alphanumeric characters. If a document has one or more numerals