{"id":1158,"date":"2013-10-10T19:12:56","date_gmt":"2013-10-10T19:12:56","guid":{"rendered":"http:\/\/jacobimed.org\/NS\/?page_id=1158"},"modified":"2013-10-10T19:12:56","modified_gmt":"2013-10-10T19:12:56","slug":"excerpts-from-us-prev-svs-task-force","status":"publish","type":"page","link":"https:\/\/jacobimed.org\/old\/ambulatory\/mlove\/curriculumprevention\/stats-for-screening\/excerpts-from-us-prev-svs-task-force\/","title":{"rendered":"Excerpts from US Prev Svs Task Force"},"content":{"rendered":"<p>&nbsp;<\/p>\n<div class=\"Section1\">\n<h1 class=\"MsoBodyText\">EXCERPTS FROM US PREVENTIVE SERVICES TASK FORCE GUIDES TO<br \/>\nCLINICAL PREVENTIVE SERVICES.<span>\u00a0 <\/span>READ AS<br \/>\nPREPARATION FOR STEVE MARTIN\u2019S LECTURE ON SCREENING STATISTICS<\/h1>\n<p class=\"MsoNormal\"><!--[if !supportEmptyParas]-->\u00a0<!--[endif]--><\/p>\n<p><strong><span style=\"text-decoration: underline;\">Excerpt from Methods section Of Guide To Clinical Preventive Services,<br \/>\nSecond Edition<\/span><\/strong><\/p>\n<p>The methodologic issues involved in evaluating screening tests require<br \/>\nfurther elaboration. As mentioned above, a screening test must satisfy two<br \/>\nmajor requirements to be considered effective:<\/p>\n<ul type=\"disc\">\n<li class=\"MsoNormal\">The test must be able to<br \/>\ndetect the target condition earlier than without screening and with<br \/>\nsufficient accuracy to avoid producing large numbers of false-positive and<br \/>\nfalse-negative results (<em>accuracy of screening test<\/em>).<\/li>\n<li class=\"MsoNormal\">Screening for and treating<br \/>\npersons with early disease should improve the likelihood of favorable<br \/>\nhealth outcomes (e.g., reduced disease-specific morbidity or mortality)<br \/>\ncompared to treating patients when they present with signs or symptoms of<br \/>\nthe disease (<em>effectiveness of early detection<\/em>).<\/li>\n<\/ul>\n<p style=\"margin: 0in 0in 0.0001pt;\">These two requirements of screening<br \/>\nare essential and therefore appear as headings in each of the 53 screening<br \/>\nchapters in this report.<\/p>\n<h4>Accuracy of Screening Tests.<\/h4>\n<p style=\"margin: 0in 0in 0.0001pt;\">The &#8220;accuracy of a screening<br \/>\ntest&#8221; is used in this report to describe accuracy and reliability.<br \/>\nAccuracy is measured in terms of two indices: sensitivity and specificity <a href=\"http:\/\/hstat.nlm.nih.gov\/hq\/Hquest\/db\/local.gcps.cps\/screen\/Browse\/s\/42157\/cmd\/HF\/action\/GetText?IHR=TII2\" target=\"_top\">(Table 2).<\/a> Sensitivity refers to the proportion of persons<br \/>\nwith a condition who correctly test &#8220;positive&#8221; when screened. A test<br \/>\nwith poor sensitivity will miss cases (persons with the condition) and will<br \/>\nproduce a large proportion of false-negative results true cases will be told<br \/>\nincorrectly that they are free of disease. Specificity refers to the proportion<br \/>\nof persons without the condition who correctly test &#8220;negative&#8221; when<br \/>\nscreened. A test with poor specificity will result in healthy persons being<br \/>\ntold that they have the condition (false positives). An accepted reference<br \/>\nstandard (&#8220;gold standard&#8221;) is essential to the empirical<br \/>\ndetermination of sensitivity and specificity, because it defines whether the<br \/>\ndisease is present and therefore provides the means for distinguishing between<br \/>\n&#8220;true&#8221; and &#8220;false&#8221; test results.<\/p>\n<p style=\"margin: 0in 0in 0.0001pt;\">The use of screening tests with<br \/>\npoor sensitivity and\/or specificity is of special significance to the clinician<br \/>\nbecause of the potentially serious consequences of false-negative and<br \/>\nfalse-positive results. Persons who receive false-negative results may<br \/>\nexperience important delays in diagnosis and treatment. Some might develop a<br \/>\nfalse sense of security, resulting in inadequate attention to risk-reducing<br \/>\nbehaviors and delays in seeking medical care when warning symptoms become<br \/>\npresent.<\/p>\n<p style=\"margin: 0in 0in 0.0001pt;\">False-positive results can lead to<br \/>\nfollow-up testing that may be uncomfortable, expensive, and, in some cases,<br \/>\npotentially harmful. If follow-up testing does not disclose the error, the<br \/>\npatient may even receive unnecessary treatment. There may also be psychological<br \/>\nconsequences. Persons informed of an abnormal medical test that is falsely<br \/>\npositive may experience unnecessary anxiety until the error is corrected.<br \/>\nLabeling individuals with the results of screening tests may affect behavior for<br \/>\nexample, studies have shown that some persons with hypertension identified<br \/>\nthrough screening may experience altered behavior and decreased work<br \/>\nproductivity.<sup><a href=\"http:\/\/hstat.nlm.nih.gov\/hq\/Hquest\/db\/local.gcps.cps\/screen\/Browse\/s\/42157\/cmd\/HF\/action\/GetText?IHR=CII002\" target=\"_top\">2<\/a>,<a href=\"http:\/\/hstat.nlm.nih.gov\/hq\/Hquest\/db\/local.gcps.cps\/screen\/Browse\/s\/42157\/cmd\/HF\/action\/GetText?IHR=CII003\" target=\"_top\">3<\/a><\/sup><\/p>\n<p style=\"margin: 0in 0in 0.0001pt;\">A proper evaluation of a screening<br \/>\ntest result must therefore include a determination of the likelihood that the<br \/>\npatient has the condition. This is done by calculating the <em>positive<br \/>\npredictive value<\/em>(PPV) of test results in the population to be screened <a href=\"http:\/\/hstat.nlm.nih.gov\/hq\/Hquest\/db\/local.gcps.cps\/screen\/Browse\/s\/42157\/cmd\/HF\/action\/GetText?IHR=TII2\" target=\"_top\">(Table 2). <\/a>The PPV is the proportion of positive test results<br \/>\nthat are correct (true positives). For any given sensitivity and specificity,<br \/>\nthe PPV increases and decreases in accordance with the prevalence of the target<br \/>\ncondition in the screened population. If the target condition is sufficiently<br \/>\nrare in the screened population, even tests with excellent sensitivity and<br \/>\nspecificity can have low PPV in these settings, generating more false-positive<br \/>\nthan true-positive results. This mathematical relationship is best illustrated<br \/>\nby an example <a href=\"http:\/\/hstat.nlm.nih.gov\/hq\/Hquest\/db\/local.gcps.cps\/screen\/Browse\/s\/42157\/cmd\/HF\/action\/GetText?IHR=TII3\" target=\"_top\">(see Table 3):<\/a><\/p>\n<p class=\"MsoNormal\" style=\"margin-right: 0.5in; margin-left: 0.5in;\">A population of 100,000 in which the prevalence of a<br \/>\nhypothetical cancer is 1% would have 1,000 persons with cancer and 99,000<br \/>\nwithout cancer. A screening test with 90% sensitivity and 90% specificity would<br \/>\ndetect 900 of the 1,000 cases, but would also mislabel 9,900 healthy persons.<br \/>\nThus, the PPV (the proportion of persons with positive test results who<br \/>\nactually had cancer) would be 900\/10,800, or 8.3%. If the same test were<br \/>\nperformed in a population with a cancer prevalence of 0.1%, the PPV would fall<br \/>\nto 0.9%, a ratio of 111 false positives for every true case of cancer detected.<\/p>\n<p style=\"margin: 0in 0in 0.0001pt;\"><em>Reliability<\/em>(reproducibility),<br \/>\nthe ability of a test to obtain the same result when repeated, is another<br \/>\nimportant consideration in the evaluation of screening tests measuring<br \/>\ncontinuous variables (e.g., cholesterol level). A test with poor reliability,<br \/>\nwhether due to differences in results obtained by different individuals or<br \/>\nlaboratories (<em>interobserver variation<\/em>) or by the same observer (<em>intraobserver<br \/>\nvariation<\/em>), may produce individual test results that vary widely from the<br \/>\ncorrect value, even though the average of the results approximates the true<br \/>\nvalue.<\/p>\n<h4>Effectiveness of Early Detection.<\/h4>\n<p style=\"margin: 0in 0in 0.0001pt;\">Even if the test accurately detects<br \/>\nearly-stage disease, one must also question whether there is any benefit to the<br \/>\npatient in having done so. Early detection should lead to the implementation of<br \/>\nclinical interventions that can prevent or delay progression of the disorder.<br \/>\nDetection of the disorder is of little clinical value if the condition is not<br \/>\ntreatable. Thus, treatment efficacy is fundamental for an effective screening<br \/>\ntest. Even with the availability of an efficacious form of treatment, early<br \/>\ndetection must offer added benefit over conventional diagnosis and treatment if<br \/>\nscreening is to improve outcome. The effectiveness of a screening test is<br \/>\nquestionable if asymptomatic persons detected through screening have the same<br \/>\nhealth outcome as those who seek medical attention because of symptoms of the<br \/>\ndisease. Studies of the effectiveness of cancer screening tests, for example,<br \/>\ncan be influenced by lead-time and length biases.<\/p>\n<h5>Lead-Time and Length Bias.<\/h5>\n<p style=\"margin: 0in 0in 0.0001pt;\">It is often difficult to determine<br \/>\nwith certainty whether early detection truly improves outcome, an especially common<br \/>\nproblem when evaluating cancer screening tests. For most forms of cancer,<br \/>\n5-year survival is higher for persons identified with early-s tage disease.<br \/>\nSuch data are often interpreted as evidence that early detection of cancer is<br \/>\neffective, because death due to cancer appears to be delayed as a result of<br \/>\nscreening and early treatment. Survival data do not constitute true proof of<br \/>\nbenefit, however, because they are easily influenced by lead-time bias:<br \/>\nsurvival can appear to be lengthened when screening simply advances the time of<br \/>\ndiagnosis, lengthening the period of time between diagnosis and death without<br \/>\nany true prolongation of life.<sup><a href=\"http:\/\/hstat.nlm.nih.gov\/hq\/Hquest\/db\/local.gcps.cps\/screen\/Browse\/s\/42157\/cmd\/HF\/action\/GetText?IHR=CII004\" target=\"_top\">4<\/a><\/sup><\/p>\n<p style=\"margin: 0in 0in 0.0001pt;\"><em>Length bias<\/em>can also result<br \/>\nin unduly optimistic estimates of the effectiveness of cancer screening. This<br \/>\nterm refers to the tendency of screening to detect a disproportionate number of<br \/>\ncases of slowly progressive disease and to miss aggressive cases that, by<br \/>\nvirtue of rapid progression, are present in the population only briefly. The<br \/>\n&#8220;window&#8221; between the time a cancer can be detected by screening and<br \/>\nthe time it will be found because of symptoms is shorter for rapidly growing cancers,<br \/>\nso they are less likely to be found by screening. As a result, persons with<br \/>\naggressive malignancies will be underrepresented in the cases detected by<br \/>\nscreening, and the patients found by screening may do better than unscreened<br \/>\npatients even if the screening itself does not influence outcome. Due to this<br \/>\nbias, the calculated survival of persons detected through screening could<br \/>\noverestimate the actual effectiveness of screening.<sup><a href=\"http:\/\/hstat.nlm.nih.gov\/hq\/Hquest\/db\/local.gcps.cps\/screen\/Browse\/s\/42157\/cmd\/HF\/action\/GetText?IHR=CII004\" target=\"_top\">4<\/a><\/sup><\/p>\n<h5>Assessing Population Benefits.<\/h5>\n<p style=\"margin: 0in 0in 0.0001pt;\">Although these considerations<br \/>\nprovide necessary information about the clinical effectiveness of preventive<br \/>\nservices, other factors must often be examined to obtain a broader picture of<br \/>\nthe potential health impact on the population as a whole. Interventio ns of<br \/>\nonly minor effectiveness in terms of relative risk may have significant impact<br \/>\non the population in terms of attributable risk if the target condition is<br \/>\ncommon and associated with significant morbidity and mortality. Under these<br \/>\ncircumstances, a highly effective intervention (in terms of relative risk) that<br \/>\nis applied to a small high-risk group may save fewer lives than one of only<br \/>\nmodest clinical effectiveness applied to large numbers of affected persons <a href=\"http:\/\/hstat.nlm.nih.gov\/hq\/Hquest\/db\/local.gcps.cps\/screen\/Browse\/s\/42157\/cmd\/HF\/action\/GetText?IHR=TII4\" target=\"_top\">(see Table 4). <\/a>Failure to consider these epidemiologic<br \/>\ncharacteristics of the target condition can lead to misconceptions about<br \/>\noverall effectiveness.<\/p>\n<p style=\"margin: 0in 0in 0.0001pt;\"><em>Potential adverse effects<\/em>of<br \/>\ninterventions must also be considered in assessing overall health impact, but<br \/>\noften these effects receive inadequate attention when effectiveness is<br \/>\nevaluated. For example, the widely held belief that early detection of disease<br \/>\nis beneficial leads many to advocate screening even in the absence of<br \/>\ndefinitive evidence of benefit. Some may discount the clinical significance of<br \/>\npotential adverse effects. A critical examination will often reveal that many<br \/>\nkinds of testing, especially among ostensibly healthy persons, have potential<br \/>\ndirect and indirect adverse effects. Direct physical complications from test<br \/>\nprocedures (e.g., colonic perforation during sigmoidoscopy), labeling and<br \/>\ndiagnostic errors based on test results (see above), and increased economic<br \/>\ncosts are all potential consequences of screening tests. Resources devoted to<br \/>\ncostly screening programs of uncertain effectiveness may consume time,<br \/>\npersonnel, or money needed for other more effective health care services. To<br \/>\nthe USPSTF, potential adverse effects are considered clinically relevant and<br \/>\nare always evaluated along with potential benefits in determining whether a<br \/>\npreventive service should be recommended.<\/p>\n<p style=\"margin: 0in 0in 0.0001pt;\"><!--[if !supportEmptyParas]-->\u00a0<!--[endif]--><\/p>\n<p><span style=\"color: #3366ff;\">EXCERPTED FROM \u201cCANCER SCREENING\u201d ON-LINE MODULE<\/span><\/p>\n<p>Cancer is the second leading cause of death in the United States. The major<br \/>\nintent of cancer screening is to reduce morbidity and mortality, typically by detecting<br \/>\ndisease earlier than when the disease becomes clinically apparent.<span>\u00a0 <\/span>However, earlier detection does not<br \/>\nnecessarily result in decreased morbidity and mortality. Because the test<br \/>\ndetects cancer before it is clinically apparent, the cancer is usually detected<br \/>\nat an earlier stage, and a stage shift is said to occur. Although earlier<br \/>\ndiagnosis is intuitively appealing, if no effective treatment is available,<br \/>\ndetection at an earlier stage will be of real benefit. Although 5-year survival<br \/>\nmay appear to increase (referred to as lead-time bias, discussed below),<br \/>\nearlier detection will be of no real benefit if no effective treatment is<br \/>\navailable or if treatment does not affect outcomes. This issue has been raised<br \/>\nwith several screening tests, including mammography and prostate cancer<br \/>\nscreening. Five-year survival rates will also appear to increase when there is<br \/>\nincreased detection of indolent types of cancer, although there is no real<br \/>\nbenefit to those patients who have the aggressive cancer form. The best standard<br \/>\nby which to judge a screening test is reduction in disease-specific mortality<br \/>\nrate.<span>\u00a0 <\/span><\/p>\n<p>Because screening implies subjecting an apparently healthy population to<br \/>\ntesting, rigorous criteria should be applied in assessment of any new screening<br \/>\ntest. Criteria for screening for a disease include that the disease should be<br \/>\nmedically important, and should cause significant morbidity and\/or mortality.<br \/>\nThe disease should be detectable at a pre-clinical phase, and have a sufficient<br \/>\nwindow of time before becoming clinically apparent (to allow a time for<br \/>\nscreening to occur). The test should be accessible and acceptable to the<br \/>\ngeneral public and have a low complication rate, since it will be applied to<br \/>\nlarge numbers of patients.<\/p>\n<p><!--[if !supportEmptyParas]-->\u00a0<!--[endif]--><\/p>\n<p><span style=\"text-decoration: underline;\">Sensitivity, specificity, positive predictive value and negative<br \/>\npredictive value<\/span><\/p>\n<p>The test characteristics are another crucial component in determining the<br \/>\nusefulness of a screening test. The sensitivity of a test, its ability to<br \/>\ncorrectly identify those who have the disease (i.e., of those with the disease,<br \/>\nwhat percentage tests positive), should be adequate to detect a reasonable<br \/>\nportion of disease. Sensitivity can be remembered by the mnemonic: sensitivity<br \/>\n= PID = positive in disease. Tests that screen for cancers with a short<br \/>\npreclinical phase require a higher sensitivity, while tests for cancers with a<br \/>\nlong preclinical phase may have low sensitivity, since testing can be repeated<br \/>\nmultiple times. The specificity of a test (i.e. the ability to correctly<br \/>\nidentify those who do not have the disease), should be high for all screening<br \/>\ntests to reduce the number of false-positive results. Specificity can be<br \/>\nremembered by the mnemonic: specificity = NIH = negative in health.<\/p>\n<p>Positive and negative predictive value refers to test results, and addresses<br \/>\nthe likelihood that a person with a positive test result has disease, or a<br \/>\nperson with a negative test result does not have disease. The positive<br \/>\npredictive value of a test refers to the proportion of those patients who test<br \/>\npositive that actually have the disease (i.e. true positives rather than false<br \/>\npositives). The positive predictive value depends heavily on the prevalence of<br \/>\nthe disease in the population. When a disease is infrequent, even tests with<br \/>\nhigh specificity will have a poor positive predictive value.<\/p>\n<p>The negative predictive value of a test refers to the proportion of patients<br \/>\nwho test negative that truly do not have the disease (i.e. true negatives<br \/>\nrather than false negatives). Negative predictive value is best when disease<br \/>\nprevalence is low.<\/p>\n<p><!--[if !supportEmptyParas]-->\u00a0<!--[endif]--><\/p>\n<p><span style=\"text-decoration: underline;\">Lead-time bias and length-time bias<\/span><\/p>\n<p>Two types of bias that must be considered in evaluating screening tests:<br \/>\nlead-time bias and length-time bias. If a screening test detects a tumor at an<br \/>\nearly stage, but the cancer remains incurable, it will appear as if screening<br \/>\nhas increased survival time merely by finding the tumor earlier. For example,<br \/>\nsuppose a new ultrasound screening test for pancreatic cancer was developed,<br \/>\nand a group of adults over the age of 50 underwent ultrasound screening every<br \/>\nthree months. In the unscreened population, life expectancy for pancreatic<br \/>\ncancer is six months. In the screened population, tumors were found three<br \/>\nmonths earlier, but were already inoperable. In this screened group, life<br \/>\nexpectancy will be nine months, and it will appear that screening increases<br \/>\nlifee xpectancy by three months (or 50%), although there has been no benefit to<br \/>\nthe screened population. This type of bias is known as lead-time bias.<\/p>\n<p>Another type of bias is caused by the heterogeneous nature of cancer. Consider<br \/>\ntwo different types of prostate cancer: an aggressive, rapidly-fatal disease<br \/>\nthat progresses from no disease to symptomatic to death in three years; and a<br \/>\nrelatively slow-growing type that takes seven years before becoming clinically<br \/>\napparent, if at all. Suppose that a prostate ultrasound screening test is<br \/>\nimplemented in a sample population, to be performed at five-year intervals. In<br \/>\nthe screened population, many slow-growing prostate cancers will be found (as<br \/>\nsurvival is seven years), while many of those with aggressive prostate cancer<br \/>\nwill have gone from no disease to death between the five year screening<br \/>\nintervals. Many of those indolent cases will go undetected in the unscreened<br \/>\ngroup, and survival from prostate cancer in the unscreened group will be<br \/>\nshorter, as those with aggressive disease will predominate. The bias introduced<br \/>\nby screening, in which slow-growing tumors are detected and appear to lengthen<br \/>\nthe survival time, while aggressive tumors causing death between screening<br \/>\nintervals are missed, is called length-time bias.<\/p>\n<p style=\"margin: 0in 0in 0.0001pt;\">Because of lead-time and<br \/>\nlength-time bias, survival time should not be used as a surrogate outcome for<br \/>\nmortality reduction. One simple way to reduce the potential impact of lead-time<br \/>\nbias is to look at prospective studies with prolonged follow-up. The longer the<br \/>\nfollow-up, the less likely lead-time will substantially affect observed<br \/>\ndifferences. However, this does not allow you to quantify the impact of any<br \/>\nlead-time bias; rather, it allows you to assume that the impact of the bias is<br \/>\nless. The only way to avoid these biases completely is to perform randomized<br \/>\ncontrolled trials and use mortality as the outcome.<\/p>\n<p style=\"margin: 0in 0in 0.0001pt;\"><!--[if !supportEmptyParas]-->\u00a0<!--[endif]--><\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>&nbsp; EXCERPTS FROM US PREVENTIVE SERVICES TASK FORCE GUIDES TO CLINICAL PREVENTIVE SERVICES.\u00a0 READ AS PREPARATION FOR STEVE MARTIN\u2019S LECTURE ON SCREENING STATISTICS \u00a0 Excerpt from Methods section Of Guide To Clinical Preventive Services, Second Edition The methodologic issues involved in evaluating screening tests require further elaboration. As mentioned above, a screening test must satisfy&#8230;.<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":1154,"menu_order":0,"comment_status":"open","ping_status":"open","template":"","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_topic_count_hidden":0,"_bbp_reply_count_hidden":0,"_bbp_forum_subforum_count":0,"footnotes":""},"class_list":["post-1158","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/jacobimed.org\/old\/wp-json\/wp\/v2\/pages\/1158","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/jacobimed.org\/old\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/jacobimed.org\/old\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/jacobimed.org\/old\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/jacobimed.org\/old\/wp-json\/wp\/v2\/comments?post=1158"}],"version-history":[{"count":1,"href":"https:\/\/jacobimed.org\/old\/wp-json\/wp\/v2\/pages\/1158\/revisions"}],"predecessor-version":[{"id":1162,"href":"https:\/\/jacobimed.org\/old\/wp-json\/wp\/v2\/pages\/1158\/revisions\/1162"}],"up":[{"embeddable":true,"href":"https:\/\/jacobimed.org\/old\/wp-json\/wp\/v2\/pages\/1154"}],"wp:attachment":[{"href":"https:\/\/jacobimed.org\/old\/wp-json\/wp\/v2\/media?parent=1158"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}