【正文】 temswherethemeasurementvalueisoneofafinitenumberofcategories.? Thisiscontrastedtothevariablesmeasurementsystemwhichcanresultinacontinuumofvalues.Themostmonoftheseisago/nogogagewhichhasonlytwopossibleresults.July2023Shanghai MSA71Risk analysis MethodsInsomeattributesituationsitisnotfeasibletogetsuffientpartswithvariablereferencevalues.Insuchcases,therisksofmakingwrongorinconsistentdecisionscanbeevaluatedbuusing:? HypothesisTestAnalyses? SignalDetectionTheoryJuly2023Shanghai MSA72Analysis MethodTheteamhasdecidedtotakearandomsampleoffiftypartsfromtheprocessinordertoobtainpartsthroughouttheprocessrange.Threeappraisersareused,witheachappraisermakingthreedecisionsontheeachpart.（ 1） isdefinedasAccept，（ 0） isdefinedasRejectJuly2023Shanghai MSA73零件 A1 A2 A3 B1 B2 B3 C1 C2 C3 Ref1 1 1 1 1 1 1 1 1 1 12 1 1 1 1 1 1 1 1 1 13 1 1 1 1 1 1 1 1 1 14 0 0 0 1 0 0 0 0 0 05 1 1 1 1 1 1 1 1 1 16 1 1 1 1 1 1 1 1 1 17 1 1 1 1 1 1 1 1 1 18 1 1 1 1 1 1 1 1 1 19 1 1 1 1 1 1 1 1 1 110 1 1 1 1 1 1 1 1 1 111 1 1 1 1 1 1 1 1 1 112 1 1 1 1 1 1 1 1 1 113 1 1 1 1 1 1 1 1 1 1…. July2023Shanghai MSA74Hypothesis Test Analyses – Cross Tab Methodthedata?Determinetheextentofagreementamongtheappraisers?Compareeachoftheappraiserstotheother 30samplesJuly2023Shanghai MSA752. Calculate KappaB Total A Count 7 1 8ExpectedCount 8 Count 2 80 82ExpectedCount 82Count 9 81 90ExpectedCount 90Thepurposeofthesetablesistodeterminetheextentofagreementamongappraisers.TodeterminethelevelofthisagreementtheteamusestheKappawhichmeasurestheagreementbetweentheevaluationsoftworateswhenbothareratingthesameobject.Avalueof1indicatedperfectagreement.Avalueof0indicatedthattheagreementisnobetterthanchance.Po=thesumoftheobservedproportionsinthediagonalcells[=(7+80)/90=]Pe＝＝ thesumoftheexpectedproportionsinthediagonalcells[=(+)/90=]ExpectedCalculation:A0B0=8*9/90=TotalJuly2023Shanghai MSA76Kappa=(P0Pe)/(1Pe)[=()/()=]A general rule of thumb is that values of Kappa greater than indicate good to excellent agreement(with a maximum Kappa = 1)。 Values less than indicate poor agreement.Conclusion:Thisanalysisindicatedthatalltheappraisersshowgoodagreementbetweeneachother.Butitdoesnottellushowwellthemeasurementsystemsortsgoodpartsfrombad???A*B B*C A*CKappa Conclusion Good Good GoodThisanalysisisnecessarytodetermineifthereareanydifferencesamongtheappraisersJuly2023Shanghai MSA77Compare each appraiser to the reference dicisionREF Total A Count 45 5 50ExpectedCount Count 3 97 100ExpectedCount 32 Total Count 48 102 150ExpectedCount A*REFCrosstabulationB*REF,C*REFlikeA*REFAlso calculate the Kappa measure to determine the agreement of each appraiser to the REF decision: A B CKappa Conclusion:Eachoftheappraisershasgoodagreementwiththestandard.July2023Shanghai MSA78 the effectiveness of the measurement system％ Appraiser1 ScoreVSAttribute2AppraiserA AppraiserB AppraiserC AppraiserA AppraiserB AppraiserC30 30 30 30 30 3029 28 29 29 28 290 0 00 0 01 2 197％ 93％ 97％ 97％ 93％ 97％1) Appraiseragreeswithhim/herselfonalltrials2) AppraiseragreesonalltrialswiththeknownstandardsourceTotal inspectedMatchedCalculated ScoreJuly2023Shanghai MSA79SystemeffectiveScore3 SystemEffectiveScoreVSReference4302790%302790%3)Allappraisersagreedwithinandbetweenthemselves4)Allappraisersagreedwithinbetweenthemselvesandagreedwiththereference4.SystemEffectiveEvaluateJuly2023Shanghai MSA805. Calculate Miss and False AlarmMissAlarm=Judgebadwhichisactuallygood/ActuallyGoodFalseAlarm=Judgegoodwhichisactuallybad/ActuallyBadJuly2023Shanghai MSA81DecisionMeasurementSystem Effectiveness Miss Rate False Alarm RateAcceptablefortheappraiser =90% =2% =5%Marginallyacceptablefortheappraisermayneedimprovement=80% =5% =10%Unacceptablefortheappraiserneedsimprovement80% 5% 10%Guideline:July2023Shanghai MSA82Sample selection : ideally 50%“pass“parts / 50%“fail“partsSample size : min. 30 parts (because of Confidence level Binomial)87 July2023Shanghai MSA83Human inspection: typical: 80% best case: 9095%88 July2023Shanghai MSA84QA QuestionsJuly2023Shanghai MSA8586Thanks for your attentionShanghaiJuly202387謝謝觀看 /歡迎下載BY FAITH I MEAN A VISION OF GOOD ONE CHERISHES AND THE ENTHUSIASM THAT PUSHES ONE TO SEEK ITS FULFILLMENT REGARDLESS OF OBSTACLES. BY FAITH I BY FAITH