ࡱ> q` MbjbjqPqP .::E&6666666J.R.R.R8fR$RdJ/iTT"UUUUUUhhhhhhh$ihMlh6'WUU'W'Wh66UUhZZZ'W6U6UhZ'WhZZ:^P66_UT p U.R-X&_ _ h0/i0_RmYm_m6_(U>5V,ZaV$VUUUhhZjUUU/i'W'W'W'WJJJK.RJJJ.RJJJ666666 Charlot Rosario May 8, 2003 Presented with the permission of Charlot Rosario who submitted this paper on May 8, 2003 as a course assignment for T7114. Evidence-Based Practice: Efforts to Integrate Research into Practice Introduction Evidence Based Practice is a growing field in the social work arena. The essence of evidence-based practice is placing the clients benefits first by posing specific questions of importance to the client, searching objectively and efficiently for the best evidence, and then using the evidence to guide ones practice. In short, evidence-based practice is the integration of research into practice. In this paper I illustrate the steps of evidence-based practice from the formation of a COPES question to the identification of practice guidelines. COPES Question A COPES question is a specific, answerable, well-built question, which has four corresponding features: client type and problem, intervention, alternate course of action, and outcome. My work as an intensive case manager for emotionally disturbed children has led me to form two COPES questions, one effectiveness and one prevention. One of my clients, Justin, is a 14 year-old African-American male. He has had four arrests. His most recent arrest was for possession of drugs. Furthermore, he is a truant, does not follow household rules, may be abusing drugs, and steals. I recommended that Justin be referred to a residential treatment center (RTC), since adoptive mother cannot manage him. His adoptive mother asked me if an RTC would really help Justin in improving his behavior. Thus, my first COPES question, an effectiveness question, reads as follows: If delinquent youth are exposed to residential based programs as opposed to no such program, will the former result in fewer delinquent behaviors? My second COPES question aroused out of my concern for teen pregnancy. One of my clients, a 17 year-old African-American female, is three months pregnant. I feel I could have prevented this, but it is too late now to prevent her from being a mother at an early age, so my focus should be on how I can help the other adolescents in my caseload from falling into the same trap. Thus, my COPES question is the following: Among adolescents, which safe sex prevention program will result in the lowest pregnancy rates? MOLES MOLES are terms that mark the best evidence for retrieval in any electronic database. I identified MOLES by question type. For example, for the effectiveness question the MOLES were the following: random, controlled, clinical trial, control group, evaluation study, and study design. Because prevention questions use the same MOLES as effectiveness questions, I was able to use the MOLES stated above for my second COPES question. Search Plan After formulating the COPES questions, I selected the best terms that would act as markers in an electronic search by first identifying synonyms for client type and intervention and secondly by using a databases thesaurus to look for terms that are part of a controlled language. I used the thesaurus found in Medline and Psych Info. Next I combined the most important search terms within each category (client type, intervention, and MOLES) with or to create individual sets to help me later locate articles containing the specified search terms. I then combined the individual sets with and, so I could locate the best evidence to answer my COPES questions. This information is illustrates in more detail in the Search Planning Worksheet found on pages eight and nine. Search History To locate evidence based articles I used Social Work Abstracts and Psych Info. I selected these databases because they contain articles of importance to social workers. After I logged onto the web site of each database, I typed in the sets for client type, intervention, and MOLES to search for articles that contained the best evidence. The search history worksheets on pages ten and eleven depict the steps carried out in the search and the number of documents located at the intersect between client type related-terms, intervention-related terms, and MOLES. Evidence For the first COPES question, (If delinquent youth are exposed to residential based programs as opposed to no such program, will the former result in fewer delinquent behaviors?), I found two articles that contained the best evidence to answer my question: Curry, J.F. (1991) Outcome Research on Residential Treatment: Implications and Suggested Directions. American Journal of OrthoPsychiatry,61, 3, 348-357. Cole, J.E., harris, D.P., & Vipand, E. (1986). A psychometric Evaluation of a Residential Treatment Facility. Adolescence, 21, 81, 67-79. For my second COPES question, (Among adolescents, which safe sex prevention program will result in the lowest pregnancy rates?), I found three articles that contained the best evidence to answer my question, but I was only able to access one article: 1) Mudd, E.H., Dickens, H.O., Garcia, C.R. (1978). Adolescent Health Services and Contraceptive Use. American Journal of OrthoPsychiatry, 48, 3, 495-504. Rabin, J. (1991). The long Term Benefits of a Comprehensive Teenage Pregnancy Program. Clinical Pediatrics, 30, 5 305-309. (I was not able to access this article) Reis, J. (1988). Contraceptive Orientation in Young Inner City Adolescents. Journal of Early Adolescence, 8, 2, 157-168. (I was not able to access this article). Evaluation Process Having obtained the articles, the next step was to appraise the quality of the articles. To do this, I used the Quality of Study Rating Form (QSRF). I used these form rather than an appraisal worksheet because it was more comprehensive. I chose to rate the study by Mudd et al. (1978), since this was the only article I was able to access that talked on the best preventative measures for teenage pregnancy. This study showed that access to contraceptives combined with education and emotional support decreased unintended teenage pregnancies. I used The Quality of Study rating Form for rating a prevention study (QSRF-P) to rate the quality of Mudd et al.s (1978) study. I did not evaluate treatment effect size and clinical significance (standardized mean difference between control and experimental group, absolute risk reduction, and number needed to treat) because there was not enough information within the article. The study received a score of 70. A good study averages 60 points and above. Thus, this leads me to conclude that this is a fairly good study. Also because the results of the study apply to my clients (my clients are African-American adolescents from low-income single-head households) and their values and preferences are satisfied by the intervention offered in the study (my clients believe in pre-marital sex but do not want to get pregnant), I feel confident in applying the results of this study to my clients. For more details see the QSRF-P on Mudd et al.s study on page 12. Systematic Reviews Systematic Reviews apply scientific procedures to evaluate a set of studies and be able to draw conclusions from that set of studies. I accessed the Campbell Corporation website to locate systematic reviews on my topics of interests, but I found no results. So I next logged on to the Center for Reviews and Dissemination website to access DARE, a database of quality assessed systematic reviews. In Dare I found no systematic reviews on juvenile delinquency and residential treatment but was successful in locating a systematic review on preventing and reducing the adverse effects of unintended teenage pregnancies. This systematic review outlined four factors that prevent teenage pregnancy: A good general education School based sex education with access to contraceptive services Proper use of contraceptives Increased access to contraceptive clinic services. I logged onto the Cochrane Library website to access more systematic reviews but found no reviews for either COPES question. Meta-Analysis Meta-analysis combine quantitative data and analyze it statistically for effect size. I logged onto the Social Work Abstracts website to locate meta-analysis on both COPES questions but found no results. I had more success in Psych Info. Even though I did not find any meta-analysis for the effectiveness COPES question, I found a meta-analysis for the prevention COPES question. The results of this meta-analysis showed that pregnancy prevention programs are effective in increasing the use of contraceptives and decreasing pregnancy rates. Practice Guidelines Practice guidelines are suggestions for interventions based on the best evidence. I went to the website of Agency for Health Care Research and Quality-Preventive Services (AHRQ) to look for current practice guidelines relevant to any of my COPES question. The practice guideline I found relevant to the effectiveness COPES question was that young people with coexisting substance abuse and emotional problems need specialized residential treatment. This practice guideline will help me with my decision to refer Justin to a residential treatment facility because aside from being a juvenile delinquent he is suspected of using drugs and he has an emotional disturbance. I found no practice guidelines specific to my prevention COPES question. Based on the information I found on the AHRQ website, evidence from studies, and conclusions drawn from systematic reviews as well as meta-analysis, I identified practice guidelines that I will use in my job as a case manager. These practice guidelines are the following: For adolescents in my caseload that are juvenile delinquents with substance abuse and emotional problems, I will refer them to specialized residential treatment with confidence because they have been proven to work (Cole, J.E. et al.s study showed that residential treatment improves the self-concept of juvenile delinquents and, in turn, decreases delinquent behaviors). For adolescents in my case load that are at an age where they can reproduce, I will educate them on sex and how to properly use contraceptives, provide them with contraceptives, and refer them to family planning clinics, such as Planned Parenthood, for counseling, since meta-analysis has shown that pregnancy prevention programs are effective in increasing the use of contraceptives and decreasing unintended pregnancies. Conclusion Evidence-based practice is a growing field, which will encourage and motivate social workers to integrate research into their practice now and in the future. As the time approaches for me to get my M.S.W. and be fully submerged into my career of choice, I hope to continue to use evidence-based practice to help me become better at what I do and serve the clients to the best of my ability. Search Planning Worksheet for Effectiveness COPES Question If delinquent youth are exposed to residential based program as opposed to no such program, will the former result in fewer delinquent behaviors? Column 1: Client Type and ProblemColumn 2: What You Might DoColumn 3: Alternate Course of ActionColumn 4: Intended ResultColumn: MOLES Appropriate to Question Type (Effectiveness, Prevention, Risk, Assessment, Description Row 1: Determine Your Question Type, Then Insert Elements of Your Question in Spaces on RightDelinquent youthResidential based programNo such programFewer delinquent behaviorsLeave Blank Row 2: Synonyms that you can imagineJuvenile offender; juvenile delinquentResidential treatment facility, residential treatment careRow 3: Controlled language from a thesaurus and MOLESJuvenile delinquencyResidential treatmentRandom* or controlled clinical trial* or control group* or evaluation stud* or study designRow 4: Terms chosen and combined in the SearchJuvenile delinquencyResidential treatmentThis table follows Sackett, D. L., Richardson, W. S., Rosenberg, W., & Haynes, R. B. (1997). Evidence-based Medicine: How to practice and teach EBM. New York: Churchill Livingstone. Adapted with permission. Search Planning Worksheet for Prevention COPES Question Among adolescents, which safe sex prevention program will result in the lowest pregnancy rates? Column 1: Client Type and ProblemColumn 2: What You Might DoColumn 3: Alternate Course of ActionColumn 4: Intended ResultColumn: MOLES Appropriate to Question Type (Effectiveness, Prevention, Risk, Assessment, Description Row 1: Determine Your Question Type, Then Insert Elements of Your Question in Spaces on RightAdolescentsSafe sex prevention programNo such programLowest pregnancy ratesLeave Blank Row 2: Synonyms that you can imagineYouth, teenagers, teensPlanned parenthood, safe sex, pregnancy preventionRow 3: Controlled language from a thesaurus and MOLESAdolescents, adolescence, teens, teenagers, youthSafe sex, responsible sex, protected sex; planned parenthood; family planningRandom* or controlled clinical trial* or control group* or evaluation stud* or study designRow 4: Terms chosen and combined in the SearchAdolescents or teenagers or youthPlanned parenthood or family planningThis table follows Sackett, D. L., Richardson, W. S., Rosenberg, W., & Haynes, R. B. (1997). Evidence-based Medicine: How to practice and teach EBM. New York: Churchill Livingstone. Adapted with permission. Search History Worksheet for Effectiveness COPES Question DatabaseSet No.Search TermsNumber of HitsCommentsSocial work abstracts1Random* or controlled clinical trial or control group* or evaluation stud* or study design1,805Social work abstracts 2Juvenile delinquency133Social work abstracts 3Residential treatment321Social work abstracts4#1 and #2 and #30Social work abstracts 5#1 and #26No good articlesSocial work abstracts 6#1 and #316No good articlesPsych Info1Random* or controlled clinical trial or control group* or evaluation stud* or study design39, 528Psych Info2Juvenile delinquency9096Psych Info3Residential treatment or residential care institutions or emotionally disturbed10,601Psych Info4#1 and #2 and #392 good articlesPsych Info5#1 and #2 and #41 good article Search History Worksheet for Prevention COPES Question DatabaseSet No.Search TermsNumber of HitsCommentsSocial work abstracts1Random* or controlled clinical trial or control group* or evaluation stud* or study design1,806Social work abstracts 2Adolescents or teenagers or youth4, 178Social work abstracts 3Planned parenthood or family planning175Social work abstracts 4#1 and #2 and #31Has the potential of being a good articlePsych Info1Random* or controlled clinical trial or control group* or evaluation stud* or study design39,528Psych Info2adolescents55,667Psych Info3Planned parenthood or family planning2,106Psych Info4#1 and #2 and #34Two good articles THE QUALITY OF STUDY RATING FORM Copes Question: Among adolescents, which safe sex prevention program will result in the lowest pregnancy rates? Type of Copes Question: Prevention Study: Mudd, E.H., Dickens, H.O., Garcia, C.R. (1978). Adolescent Health Services and Contraceptive Use. American Journal of OrthoPsychiatry, 48, 3, 495-504. Abstract: A pilot study of a health services program for never-pregnant high-school students, which stresses development of incentives for personal involvement in their own health care, reports a low incidence of unintended pregnancy among girls who requested contraceptives. The social and emotional characteristics of those who continued contraceptive use are compared with the small group who had unintended pregnancies. Who: 161 never-pregnant high-school students. Demographics are unmarried, black, and attending high school. 63% was 16 to 17 years old. 47% were in single-parent households.4 pointsWhat: physical examination, sex education, access to contraceptives, and counseling.4 pointsWhere: family planning educational program in collaboration with high schools.4 pointsWhen: 2 years (1973-1975)4 pointsWhy: Studies show that nearly two-thirds of adolescent pregnancies are unintended but few use contraceptives.4 pointsSubjects randomly assigned: No0 pointsAnalysis shows equal program and control groups before treatment: Yes5 pointsSubjects blind to being in prevention or control group: Yes5 pointsSubjects randomly selected for inclusion in study: Yes4 pointsControl group used: Yes4 pointsNumber of subjects in control or experimental group exceeds 20: Yes4 pointsOutcome measure has face validity: Yes4 pointsTreatment outcome was measured for reliability: No0 pointsReliability measure has value greater than 70%: No0 pointsThose rating outcome rated it blind: Yes5 pointsOutcome of the prevention program was measured after the program was completed: Yes4 pointsTest of statistical significance was made and p<.05: Yes5 pointsFollow-up was greater than 75%: No0 pointsSubstantial improvement in the prevention program group over base rate of the problem prior to the program: Yes15 pointsTotal quality pointsES1Not enough informationES 2Not enough informationNNTNot enough information Should I apply these valid, important results to my clients? Yes Is my client so different from those in the trial that the results do not apply?NoIs the benefit to my clients worth the cost, risk, and effort?YesDo I have a clear assessment of the clients values and preferences?YesDoes this intervention and its potential consequences serve these values?Yes     PAGE  PAGE 16 "MOp\lyj$1YZ`2a2q22A3B3c3d3333333$4%4&4444444444h jCJaJ)h j5B*CJOJQJ\^JaJphh jB*phh j6>*] h j>*h jB* aJphf h jaJ h j6] h j5\h j56\]hKj)h j:   ' ( y z "#()/0h^h8^8$a$MM0BCFGPQRSxytuZ & F ^` & F8dh^88^8dhZ[noc#d#w#x#5&6&O&&&&&^'_'m'n')))),8dh^8hdh`h & F8^8,,--/0000V2W2X2Y2Z2[2\2]2^2_2`2a2b2c2d2e2f2g2$a$^ & F8dh^8g2h2i2j2k2l2m2n2o2p2q2222@3A3B3d3333%4&44444$IfFf$If$a$4444kd$$IfKֈ6 (BC  0)634Kabp $If4444 53545n5o5p5q5r5t5u555364656d66666'7a7b7c7e7f7q77 8 8.8/8J8K8o8p888888O9[9x99999999999:::Ⲡəə h j5\#h j5>*CJOJQJ\^JaJ h j5CJOJQJ\^JaJ h jaJh j)h j5B*CJOJQJ\^JaJphh jCJaJh jB*phh jCJOJQJ^JaJ<4 545o5q5s5t5$If$Ift5u55#$Ifkd$$IfKֈ6 (BC  0)634Kabp 5555546$If4656d6#$Ifkd$$IfKֈ6 (BC  0)634Kabp d6y66666$If66b7#$Ifkd$$IfKֈ6 (BC  0)634Kabp b7c7d7e7f7g7h7i7j7k7l7m7n7o7p7q7 !rkdA$$IfK(  0)634Kabp q7777 8 8 8/8K8p8888O9\9x9999$IfFf $If$a$999#$Ifkd $$IfKֈ <(BC  0)634Kabp 99: :":#:$If: :!:#:$:Z::8;9;h;;;;<H<<<<<<<<BBBBOCeCsCxCCDDDEKLMMMMMMMMM뱟wswswswsh1rJjh1rJUh j6>*] h j6]h j56\] h j5\#h j5>*CJOJQJ\^JaJ h j5CJOJQJ\^JaJh jCJOJQJ^JaJ h jaJ)h j5B*CJOJQJ\^JaJphh jCJaJh jh jB*ph-#:$:Z:#$Ifkd $$IfKֈ <(BC  0)634Kabp Z:::::8;$If8;9;h;#$Ifkd$$IfKֈ <(BC  0)634Kabp h;;;;;;$If;;<#$Ifkd$$IfKֈ <(BC  0)634Kabp <<<<<<<<<<<<<<<}}$If$a$rkd7$$IfK(  0)634Kabp <<<<<==r=x=y=Pkd$$IflLrj U@,"064 la$If y=z=======XRRRRRR$Ifkd$$Iflrj U@,"064 la========XRRRRRR$IfkdJ$$Iflrj U@,"064 la==== >>>XRRRRR$Ifkd$$Iflrj U@,"064 la>>&>'>)>3>5>F>XRRRRRR$Ifkd$$Iflrj U@,"064 laF>G>]>^>`>j>m>~>XRRRRRR$IfkdQ$$Iflrj U@,"064 la~>>>>>>>XRRRRR$Ifkd$$Iflrj U@,"064 la>>>>???XRRRRR$Ifkd$$Iflrj U@,"064 la??%?'?w?~??XRRRRR$IfkdX$$Iflrj U@,"064 la???????XRRRRR$Ifkd$$Iflrj U@,"064 la???????XRRRRR$Ifkd$$Iflrj U@,"064 la???@@"@*@7@F@XSQSKKKK$If$a$kd_$$Iflrj U@,"064 laF@O@P@f@h@@@@Rkd $$Iflrj U@,"064 la$If@@@@@A AAXRRRRRR$Ifkd$$Iflrj U@,"064 laAA%A&A(ANARASAXRRRRRR$Ifkdf$$Iflrj U@,"064 laSATAjAkAmA~AAAXRRRRRR$Ifkd$$Iflrj U@,"064 laAAAABBBXRRRRR$Ifkd$$Iflrj U@,"064 laBB'B)B5BBIBKBqBwBxBXRRRRR$Ifkd$$Iflrj U@,"064 laxByBBBBBBXRRRRR$Ifkd$$Iflrj U@,"064 laBBBBBBBBBBXVVVVVVVVkdt$$Iflrj U@,"064 la BBBBBBBBBBBNCOCrCsCCDDEEEnFwF$If^^ h^h`$a$wFxFFF$Ifnkd! $$Ifl0,"LL064 laFF&G/G$Ifnkd $$Ifl0,"LL064 la/G0GJGSG$Ifnkd/!$$Ifl0,"LL064 laSGTGGG$Ifnkd!$$Ifl0,"LL064 laGGGG$Ifnkd="$$Ifl0,"LL064 laGG;HDH$Ifnkd"$$Ifl0,"LL064 laDHEHHH$IfnkdK#$$Ifl0,"LL064 laHHHH$Ifnkd#$$Ifl0,"LL064 laHHHH$IfnkdY$$$Ifl0,"LL064 laHH2I;I$Ifnkd$$$Ifl0,"LL064 la;I@2 Title$a$5\L^@L Normal (Web)dd[$\$ B*phJC@J Body Text Indent8dh^84 @"4 Footer  !.)@1. Page NumberTR@BT Body Text Indent 28dh^86]E '(yz"#( ) / 0 B C FGPQRSxytuZ[nocdwx56O^_mn!!!!$$%%'((((V*W*X*Y*Z*[*\*]*^*_*`*a*b*c*d*e*f*g*h*i*j*k*l*m*n*o*p*q****@+A+B+d++++%,&,,,,,,,, -4-o-q-s-t-u------4.5.d.y......b/c/d/e/f/g/h/i/j/k/l/m/n/o/p/q//// 0 0 0/0K0p0000O1\1x11111112 2"2#2$2Z222228393h3333333444444444444444444455r5x5y5z55555555555555555 6666&6'6)63656F6G6]6^6`6j6m6~66666666667777%7'7w7~777777777777777788"8*878F8O8P8f8h888888889 999%9&9(9N9R9S9T9j9k9m9~999999::::':):5:<:=:>:I:K:q:w:x:y:::::::::::::::::::::::::N;O;r;s;;<<===n>w>x>>>>&?/?0?J?S?T???????;@D@E@@@@@@@@@@2A;AF>~>>????F@@ASAAB=BxBBBwFF/GSGGGDHHHH;IlIIIJwJJJbKyKKKKhLLLEMUMrMMMMM(*+,-.0123456789;<=>?@ABCDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuwM) !(!!8@0(  B S  ?G|s(/(/I4I4E0/0/Q4Q4E9*urn:schemas-microsoft-com:office:smarttagsState9*urn:schemas-microsoft-com:office:smarttagsplace '>E x||CGz;~;;<EEEEEEEEEEEEEEEEEQb#i|;;DDEEEEEEEEEEEEEEEEE333333333CZ^b$*U*`*n*//4448:::GEuEuExExEyEyEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEDF kUo808^8`0o(.^`.pLp^p`L.@ @ ^@ `.^`.L^`L.^`.^`.PLP^P`L.808^8`0o(.^`o()pLp^p`L.@ @ ^@ `.^`.L^`L.^`.^`.PLP^P`L.D kU kU 6.c        p-DB       Kj)1rJ_ jA+B+d++++%,&,,,,,,,, -4-o-q-s-t-u------4.5.d.y......b/c/ 0 0/0K0p0000O1\1x11111112 2"2#2$2Z222228393h333333344444444455r5x5y5z555555555555555 6666'6)63656F6G6^6`6j6m6~66666666667777%7'7w7~7777777777777778"8*878F8O8P8f8h88888889 999&9(9N9R9S9T9k9m9~999999::::':):5:<:=:>:I:K:q:w:x:y:::::::=n>w>x>>>>&?/?0?J?S?T???????;@D@E@@@@@@@@@@2A;A?@ABCDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxz{|}~Root Entry F0gUData y^.1Table+mWordDocument.SummaryInformation(DocumentSummaryInformation8CompObjq  FMicrosoft Office Word Document MSWordDocWord.Document.89q