{"id":28,"date":"2024-04-03T23:09:23","date_gmt":"2024-04-03T20:09:23","guid":{"rendered":"https:\/\/sisu.ut.ee\/measurement\/103-estimating-uncertainty-component-accounting-systematic-effects-using-data-are\/"},"modified":"2024-08-30T08:59:36","modified_gmt":"2024-08-30T05:59:36","slug":"103-estimating-uncertainty-component-accounting-systematic-effects-using-data-are","status":"publish","type":"page","link":"https:\/\/sisu.ut.ee\/measurement\/103-estimating-uncertainty-component-accounting-systematic-effects-using-data-are\/","title":{"rendered":"10.3.\tUncertainty component accounting for systematic effects"},"content":{"rendered":"<p style=\"text-align: center;\"><\/p><div class=\"ratio ratio-16x9 mb-3\"><div class=\"video-placeholder-wrapper video-placeholder-wrapper--16x9\">\n\t\t\t    <div class=\"video-placeholder d-flex justify-content-center align-items-center\">\n\t\t\t        <div class=\"overlay text-white p-2 w-100 text-center d-block justify-content-center align-items-center\">\n\t\t\t            <div>To view third-party content, please accept cookies.<\/div>\n\t\t\t            <button class=\"btn btn-secondary btn-sm mt-1 consent-change\">Change consent<\/button>\n\t\t\t        <\/div>\n\t\t\t    <\/div>\n\t\t\t<\/div>\n<\/div>\n<h4 style=\"text-align: center;\"><strong>Estimating the uncertainty component due to possible bias<\/strong><br>\n<a href=\"http:\/\/www.uttv.ee\/naita?id=17910\" target=\"_blank\" rel=\"noopener\">http:\/\/www.uttv.ee\/naita?id=17910<\/a><\/h4>\n<p style=\"text-align: center;\"><a href=\"https:\/\/www.youtube.com\/watch?v=hLGZsW_o81o\" target=\"_blank\" rel=\"noopener\">https:\/\/www.youtube.com\/watch?v=hLGZsW_o81o<\/a><\/p>\n<p>The component <em>u\u00a0<\/em>(<em>bias<\/em>) takes into account <em>possible<\/em> bias of the measurement procedure.<\/p>\n<p>Reliably determining the bias of the procedure is not easy for the following reasons:<\/p>\n<ol>\n<li>If the random effects are strong then this needs a very large number of measurements. When a limited number of measurements are made then the bias estimate will always contain a contribution from random effects, which will make the bias estimate artificially higher. Even more so \u2013 the procedure can actually have no bias at all.<\/li>\n<li>Even with formally similar matrixes the bias can differ by magnitude and even by sign \u00a0(e.g. when determining pesticides in different varieties of apples, determining drug residues in blood plasma from different patients, etc). This means that having determined the bias in one variety of apples this bias is not automatically applicable for another variety and we can speak about uncerteinty in applying the bias to another variety.<\/li>\n<li>Bias is always determined against a reference value, which also has an uncertainty.<\/li>\n<\/ol>\n<p>This is why we speak about <em>possible<\/em> bias and the uncertainty component <em>u\u00a0<\/em>(<em>bias<\/em>) quantifies our limited knowledge about bias.<\/p>\n<p>Bias refers to difference between our measured value and a reference value. Therefore, for finding <em>u\u00a0<\/em>(<em>bias<\/em>) we need a sample or a material with a reference value. In broad terms there are four different possibilities how the <em>u\u00a0<\/em>(<em>bias<\/em>) can be determined:<\/p>\n<table class=\"table table-hover\" border=\"1\" cellspacing=\"0\" cellpadding=\"0\">\n<tbody>\n<tr valign=\"top\">\n<td style=\"width: 250px;\" valign=\"top\">\n<p style=\"text-align: center;\"><strong>Possibility of determining <em>u\u00a0<\/em>(<em>bias<\/em>) <\/strong><\/p>\n<\/td>\n<td valign=\"top\">\n<p style=\"text-align: center;\" align=\"center\"><strong>Pros<\/strong><\/p>\n<\/td>\n<td valign=\"top\">\n<p style=\"text-align: center;\" align=\"center\"><strong>Cons<\/strong><\/p>\n<\/td>\n<\/tr>\n<tr valign=\"top\">\n<td valign=\"top\">Analysing the sample with a reference analysis procedure<\/td>\n<td valign=\"top\">Bias can be determined very reliably, because the determined bias corresponds to the bias with exactly the same sample matrix as is in the real sample.<\/td>\n<td valign=\"top\">It is usually very difficult to find a suitable reference procedure. Therefore this possibility is not often used at routine labs.<\/td>\n<\/tr>\n<tr valign=\"top\">\n<td valign=\"top\">Certified reference material (CRM)\u00a0<a href=\"#\" data-bs-toggle=\"modal\" data-bs-target=\"#popup-modal\" data-title=\"[1] \" data-content=\"In simplified terms certified reference material is a material, in which the content of the analyte (or analytes) is reliably known (the material has a certificate). If the certified reference material\u2019s matrix is similar to real samples (i.e. it is not a pure compound or a solution but is e.g. milk powder, soil or blood plasma) then we call it certified matrix reference material.\">[1] <\/a><\/td>\n<td valign=\"top\">Bias can be determined quite reliably, because the reference values of CRM-s are generally quite reliable.<\/td>\n<td valign=\"top\">Availability of certified reference materials is limited and their matrixes are often better homogenised than in the case of real samples, leading to somewhat optimistic bias estimates.<\/td>\n<\/tr>\n<tr valign=\"top\">\n<td valign=\"top\">Using samples of interlaboratory comparisons as reference samples<\/td>\n<td valign=\"top\">Is often usable at routine labs, because labs usually participate in interlaboratory comparisons with the procedures that they use in their everyday work.<\/td>\n<td valign=\"top\">The reference values are mostly derived from participant results and have therefore low reliability (high uncertainty). This leads to overestimated <em>u\u00a0<\/em>(<em>bias<\/em>).<\/td>\n<\/tr>\n<tr valign=\"top\">\n<td valign=\"top\">Using spiking studies<\/td>\n<td valign=\"top\">Can be done at the laboratory and can be done with the real samples, thereby exactly matching the matrix.<\/td>\n<td valign=\"top\">The main problem in bias determination by spiking is dispersing the analyte in the sample in the same way as the native analyte in the sample.\u00a0In the case of inhomogenous matrixes this can be very difficult.<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>In the case of all four possibilities it is critical to include also sample preparation in bias determination.<\/p>\n<p>In the case of all four possibilities it is necessary to make an as large as possible number of replicate measurements in order to separate the bias from random effects as efficiently as possible. Bias generally changes from matrix to matrix and usually is different at different concentration levels. So, it is important to use several CRMs, several interlaboratory comparisons, etc.<\/p>\n<p>The lower is the reliability of the reference value the higher is the <em>u\u00a0<\/em>(<em>bias<\/em>) estimate.<\/p>\n<div>\n<p>The <em>u\u00a0<\/em>(<em>bias<\/em>) component is found according to the following equation:<\/p>\n<table class=\"table table-hover\" border=\"0\" align=\"center\">\n<tbody>\n<tr>\n<td><img loading=\"lazy\" decoding=\"async\" width=\"233\" height=\"32\" class=\"alignnone wp-image-75\" title=\"10-2.png\" src=\"https:\/\/sisu.ut.ee\/wp-content\/uploads\/sites\/18\/10-2.png\" alt=\"10-2.png\"><\/td>\n<td>\u00a0(10.2)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p style=\"text-align: left;\" align=\"right\">\n<em style=\"line-height: 1.6em;\">RMS<\/em><sub>bias<\/sub><span style=\"line-height: 1.6em;\"> is the average (root mean square) bias and is found as follows:<\/span><\/p>\n<table class=\"table table-hover\" border=\"0\" align=\"center\">\n<tbody>\n<tr>\n<td><img loading=\"lazy\" decoding=\"async\" width=\"173\" height=\"54\" class=\"alignnone wp-image-76\" title=\"10-3.png\" src=\"https:\/\/sisu.ut.ee\/wp-content\/uploads\/sites\/18\/10-3.png\" alt=\"10-3.png\"><\/td>\n<td>\u00a0(10.3)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p style=\"text-align: left;\" align=\"right\">\n<\/p><p style=\"text-align: left;\" align=\"right\"><span style=\"line-height: 1.6em;\">Where <\/span><em style=\"line-height: 1.6em;\">n<\/em><span style=\"line-height: 1.6em;\"> is the number of bias determinations carried out and each <\/span><em style=\"line-height: 1.6em;\">bias<sub>i<\/sub><\/em><span style=\"line-height: 1.6em;\"> is a result of an individual bias determination and is found as follows:<\/span><\/p>\n<table class=\"table table-hover\" border=\"0\" align=\"center\">\n<tbody>\n<tr>\n<td><img loading=\"lazy\" decoding=\"async\" width=\"153\" height=\"26\" class=\"alignnone wp-image-77\" title=\"10-4.png\" src=\"https:\/\/sisu.ut.ee\/wp-content\/uploads\/sites\/18\/10-4.png\" alt=\"10-4.png\" srcset=\"https:\/\/sisu.ut.ee\/wp-content\/uploads\/sites\/18\/10-4.png 153w, https:\/\/sisu.ut.ee\/wp-content\/uploads\/sites\/18\/10-4-150x26.png 150w\" sizes=\"auto, (max-width: 153px) 100vw, 153px\"><\/td>\n<td>\u00a0(10.4)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>Where <em>Clab<sub>i<\/sub><\/em> is a mean of the results of analyte determination in the reference sample (e.g. in the CRM) obtained by the laboratory and <em>Cref<sub>i<\/sub><\/em> is the reference value of the reference sample. It is important that <em>Clab<sub>i<\/sub><\/em> corresponds to a number of replicates.<\/p>\n<p><em>u\u00a0<\/em>(<em>Cref<\/em>) is the average standard uncertainty of the reference values of the reference samples and is found as follows:<\/p>\n<table class=\"table table-hover\" border=\"0\" align=\"center\">\n<tbody>\n<tr>\n<td><img loading=\"lazy\" decoding=\"async\" width=\"185\" height=\"52\" class=\"alignnone wp-image-78\" title=\"10-5.png\" src=\"https:\/\/sisu.ut.ee\/wp-content\/uploads\/sites\/18\/10-5.png\" alt=\"10-5.png\"><\/td>\n<td>\u00a0(10.5)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p style=\"text-align: left;\" align=\"right\"><span style=\"line-height: 1.6em;\">Here <\/span><em style=\"line-height: 1.6em;\">u\u00a0<\/em><span style=\"line-height: 1.6em;\">(<\/span><em style=\"line-height: 1.6em;\">Cref<sub>i<\/sub><\/em><span style=\"line-height: 1.6em;\">) is the standard uncertainty of the <\/span><em style=\"line-height: 1.6em;\">i<\/em><span style=\"line-height: 1.6em;\">-th reference value. In the case of CRM analysis, spiking or analysis with a reference procedure the <\/span><em style=\"line-height: 1.6em;\">u\u00a0<\/em><span style=\"line-height: 1.6em;\">(<\/span><em style=\"line-height: 1.6em;\">Cref<sub>i<\/sub><\/em><span style=\"line-height: 1.6em;\">) can usually be reasonably found. However, in the case of interlaboratory comparisons where the consensus value of the participants is used as the reference value a reliable uncertainty of the reference value cannot be found. The best estimate in that case would be the standard deviation of the average value after elimination of outliers:<\/span><\/p>\n<table class=\"table table-hover\" border=\"0\" align=\"center\">\n<tbody>\n<tr>\n<td><img loading=\"lazy\" decoding=\"async\" width=\"113\" height=\"50\" class=\"alignnone wp-image-79\" title=\"10-6.png\" src=\"https:\/\/sisu.ut.ee\/wp-content\/uploads\/sites\/18\/10-6.png\" alt=\"10-6.png\"><\/td>\n<td>(10.6)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p style=\"text-align: left;\" align=\"right\">\n<\/p><p>Here <em>s<sub>i<\/sub><\/em> is the standard deviation of the participants in the <em>i<\/em>-th intercomparison after elimination of outlayers and <em>n<sub>i<\/sub><\/em> is the number of participants (again after eliminating the outliers) in the <em>i<\/em>-th intercomparison.<\/p>\n<p>In the special case if a number of bias determinations were carried out using one single CRM the equation 10.2 changes into the following form:<\/p>\n<table class=\"table table-hover\" border=\"0\" align=\"center\">\n<tbody>\n<tr>\n<td><img loading=\"lazy\" decoding=\"async\" width=\"293\" height=\"35\" class=\"alignnone wp-image-80\" title=\"10-7.png\" src=\"https:\/\/sisu.ut.ee\/wp-content\/uploads\/sites\/18\/10-7.png\" alt=\"10-7.png\"><\/td>\n<td>\u00a0(10.7)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p style=\"text-align: left;\" align=\"right\"><span style=\"line-height: 1.6em;\">Where <\/span><em style=\"line-height: 1.6em;\">s<\/em><sub>bias<\/sub><span style=\"line-height: 1.6em;\"> is the standard deviation of the bias estimates obtained and <\/span><em style=\"line-height: 1.6em;\">n<\/em><span style=\"line-height: 1.6em;\"> is the number of bias estimates obtained.<\/span><\/p>\n<p><span style=\"line-height: 1.6em;\">Depending on situation the <\/span><em style=\"line-height: 1.6em;\">u<\/em><span style=\"line-height: 1.6em;\">(<\/span><em style=\"line-height: 1.6em;\">bias<\/em><span style=\"line-height: 1.6em;\">) can be used as absolute or as relative value.<\/span><\/p>\n<p>Finally, it is important to stress that the bias uncertainty component should be estimated separately for different matrixes and different concentration levels.<\/p>\n<\/div>\n<p style=\"text-align: center;\"><a href=\"https:\/\/sisu.ut.ee\/measurement\/self-test-10-3\/\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-60\" title=\"selftest.png\" src=\"https:\/\/sisu.ut.ee\/wp-content\/uploads\/sites\/18\/selftest.png\" alt=\"selftest.png\" width=\"104\" height=\"41\"><\/a><\/p>\n<p style=\"text-align: center;\">\n<\/p><p style=\"text-align: left;\">***<\/p>\n<p style=\"text-align: left;\">[1] In simplified terms certified reference material is a material, in which the content of the analyte (or analytes) is reliably known (the material has a certificate). If the certified reference material\u2019s matrix is similar to real samples (i.e. it is not a pure compound or a solution but is e.g. milk powder, soil or blood plasma) then we call it certified matrix reference material.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>To view third-party content, please accept cookies. Change consent Estimating the uncertainty component due to possible bias http:\/\/www.uttv.ee\/naita?id=17910 https:\/\/www.youtube.com\/watch?v=hLGZsW_o81o The component u\u00a0(bias) takes into account possible bias of the measurement procedure. Reliably determining the bias of the procedure is not &#8230;<\/p>\n","protected":false},"author":14,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"inline_featured_image":false,"footnotes":""},"class_list":["post-28","page","type-page","status-publish","hentry"],"acf":[],"_links":{"self":[{"href":"https:\/\/sisu.ut.ee\/measurement\/wp-json\/wp\/v2\/pages\/28","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sisu.ut.ee\/measurement\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/sisu.ut.ee\/measurement\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/sisu.ut.ee\/measurement\/wp-json\/wp\/v2\/users\/14"}],"replies":[{"embeddable":true,"href":"https:\/\/sisu.ut.ee\/measurement\/wp-json\/wp\/v2\/comments?post=28"}],"version-history":[{"count":3,"href":"https:\/\/sisu.ut.ee\/measurement\/wp-json\/wp\/v2\/pages\/28\/revisions"}],"predecessor-version":[{"id":823,"href":"https:\/\/sisu.ut.ee\/measurement\/wp-json\/wp\/v2\/pages\/28\/revisions\/823"}],"wp:attachment":[{"href":"https:\/\/sisu.ut.ee\/measurement\/wp-json\/wp\/v2\/media?parent=28"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}