[Federal Register Volume 64, Number 191 (Monday, October 4, 1999)] [Notices] [Pages 53848-53851] From the Federal Register Online via the Government Publishing Office [www.gpo.gov] [FR Doc No: 99-25645] [[Page 53847]] _______________________________________________________________________ Part III Department of Justice _______________________________________________________________________ Office of Juvenile Justice and Delinquency Prevention _______________________________________________________________________ Evaluation Facilitation for the Tribal Youth Program; Notice Federal Register / Vol. 64, No. 191 / Monday, October 4, 1999 / Notices [[Page 53848]] DEPARTMENT OF JUSTICE Office of Juvenile Justice and Delinquency Prevention [OJP (OJJDP)-1249] RIN 1121-ZB82 Evaluation Facilitation for the Tribal Youth Program AGENCY: Office of Justice Programs, Office of Juvenile Justice and Delinquency Prevention, Justice. ACTION: Announcement of Discretionary Competitive Cooperative Agreement. ----------------------------------------------------------------------- SUMMARY: The Office of Juvenile Justice and Delinquency Prevention (OJJDP) is requesting applications for the Evaluation Facilitation for the Tribal Youth Program. The Evaluation Facilitator will provide direction, training, and technical assistance to local Program Assessment Teams that will be conducting participatory evaluations of juvenile justice projects under OJJDP's Tribal Youth Program. The Evaluation Facilitator will also conduct an analysis of the juvenile justice system structure and operations in each site. This analysis will address the relationship the juvenile justice activities and responsibilities of tribal, county, State, and Federal governmental entities and the historical, social, and economic context in which they exist. DATES: Applications must be received by November 18, 1999. ADDRESSES: Interested applicants can obtain an application kit from the Juvenile Justice Clearinghouse at 800-638-8736. The application kit is also available at OJJDP's Web site at www.ojjdp.ncjrs.org/grants/ about.html#kit. FOR FURTHER INFORMATION CONTACT: Phelan Wyrick, Program Manager, Office of Juvenile Justice and Delinquency Prevention, 202-353-9254. [This is not a toll-free number.] SUPPLEMENTARY INFORMATION: Purpose The purpose of this program is to provide high quality guidance and direction to up to five local stakeholder teams that will be conducting evaluations of projects supported by the Tribal Youth Program. The Evaluation Facilitator will also conduct an analysis of the structure and operations of the juvenile justice system and tribal justice system at each of these sites. Applications are encouraged from researchers and evaluators who have experience conducting large-scale participatory evaluations and/or working closely with tribal populations. Background The Tribal Youth Program was designed to provide federally recognized Indian tribes 1 with support for juvenile justice activities in one or more of the following categories: --------------------------------------------------------------------------- \1\ Federally recognized Indian tribes are those tribes listed in the Federally Recognized Tribes List Act located in the lower 48 States and Alaska Native villages in Alaska. ---------------------------------------------------------------------------Reduce, control, and prevent crime both by and against tribal youth. Provide interventions for court-involved tribal youth. Improve tribal juvenile justice systems. Provide prevention programs focusing on alcohol and drugs. These categories are broad, allowing applicants for the Tribal Youth Program to customize their applications to the particular needs of their communities. The Tribal Youth Program will fund sites for a project period of 3 years. Funding under this program may be applied toward starting new projects or continuing, expanding, or enhancing existing projects. Applicants responding to this program announcement should review the Tribal Youth Program Guidelines and Application Kit for more detailed information. Copies of that announcement can be obtained by calling OJJDP's Juvenile Justice Clearinghouse at 800-638- 8736 or sending an e-mail request to [email protected]. Fax-on-demand service is also available through the Clearinghouse number listed above (choose option 1, then option 2). OJJDP program announcements are also available online at www.ojjdp.ncjrs.org/grants/current.html. Site Selection Procedures for the Evaluation Of the sites that will be selected to receive funding under the Tribal Youth Program, up to five will be selected to participate in this evaluation. These sites will receive supplemental funding to support their evaluation efforts. To be eligible for this supplemental funding, sites must receive an award under the Tribal Youth Program and must have explicitly applied for inclusion in the evaluation as part of their Tribal Youth Program application. The pool of eligible applicants will then be reviewed by OJJDP and the Evaluation Facilitator selected under this solicitation. Efforts will be made to include at least one Alaska Native village. Criteria for selection will include: Willingness and capacity to use multiple and varied approaches to collect information. Willingness to commit resources (in-kind services). Willingness to involve key stakeholders in decisionmaking around the evaluation. Degree to which the evaluation activity is perceived as being useful to the program's end users. Potential to build an evaluation capacity within the tribal community. Sites will be notified if they are selected for the participatory evaluation and will be given instructions for submitting applications for supplemental funding after the initial Tribal Youth Program awards have been made. Evaluation Strategy Research and program evaluation in Indian country have been criticized for returning little practical information or resources to the people who are the focus of study. Meetings and focus groups with tribal practitioners and researchers in Indian Country have revealed a strong interest in research and evaluation that are driven by members of the community, respectful of tribal values and customs, and geared toward practical application and local utilization of findings. The need for building local research and evaluation capacity has also been highlighted. Under this solicitation, OJJDP will competitively award one cooperative agreement for an Evaluation Facilitator for the participatory evaluation of the Tribal Youth Program. The Evaluation Facilitator's primary role is to guide the process of the participatory evaluation and provide training and technical assistance in each of the selected sites. The secondary role of the Evaluation Facilitator will be to provide an analysis of the structure and operations of the existing juvenile justice system and tribal justice system in each site. Facilitating the Participatory Evaluation The participatory evaluation is designed to assess program implementation and outcomes by forming partnerships between the Evaluation Facilitator and local Program Assessment Teams (PAT's). PAT's will be composed of individuals at each selected evaluation site who have a stake in the program, such as program staff, community residents, tribal leaders/tribal council, elders, native youth, and parents. With the assistance of the Evaluation Facilitator, PAT's will design and implement culturally appropriate process and outcome evaluations of their local projects under the Tribal Youth Program. The Evaluation Facilitator will provide [[Page 53849]] intensive training and technical assistance to PAT's as they move through the evaluation process. This approach is designed to build local evaluation capacity while the evaluation remains community driven and directed toward practical application and utility of findings. Thus, this evaluation is designed to address concerns that have been raised by practitioners and researchers in tribal government and communities. Up to five of the Tribal Youth Program sites will be selected to participate in the evaluation and will receive supplemental funding for evaluation in addition to their Tribal Youth Program awards. PAT's will be formed at each of the evaluation sites. At minimum, PAT's will be composed of one half-time coordinator and several additional volunteer members including program stakeholders and community members, as noted above. PAT members will not be required to have previous evaluation or research experience. However, PAT's will make the final decisions on such issues as the selection of evaluation questions and methods of inquiry, and PAT members will carry out the tasks of data collection and analysis. Throughout the process, PAT's will be responsible for interpreting and adhering to local values and customs with regard to data collection and information sharing. PAT's will also be responsible for reporting their activities to the Evaluation Facilitator. The Evaluation Facilitator will build local evaluation capacity by providing direction, training, and technical assistance over a 3-year project period to PAT members. The Evaluation Facilitator must be able to respond to direct requests for guidance and training. Training should cover areas including, but not limited to, program evaluation design, construction of program logic models, data collection procedures, selection and construction of data collection instruments, data analysis techniques, and reporting. Furthermore, the Evaluation Facilitator must be able to anticipate future and unrecognized needs that the PAT's may have as they conduct their evaluation. Both the Evaluation Facilitator and the PAT's will be responsible for ensuring that the program assessment includes evaluation of both process and outcomes and that the assessment produces results that have direct practical implications for program development. Training visits to each of the sites during the first year of the project will be critical. It is likely that at least one Alaska Native village site will be included in the evaluation, and travel should be budgeted accordingly. Through the Tribal Youth Program, the PAT's will have access to a computer system with Internet access and e-mail capability. It is expected that ongoing communication will take place with the sites and assistance will be given via e-mail, electronic file transfer, telephone, and conventional mail. Since programs are likely to be in early developmental and planning phases during much of the first 12 months, evaluation activities should focus on assembling an effective PAT, planning and implementing a process evaluation, and planning an outcome evaluation. The Evaluation Facilitator will be responsible for providing the necessary direction, training and technical assistance to accomplish these tasks. Analyzing the Existing Juvenile Justice System and Tribal Justice System It is the responsibility of the Evaluation Facilitator to conduct an analysis of the existing juvenile justice system at each of the evaluation sites. A central feature of this analysis will be the relationships between tribal government and county, State, and Federal entities and other tribal governments as they relate to juvenile justice. The analysis should also include indicators of workload within the juvenile justice system and tribal justice system; data management procedures and capabilities; and the relationship between the juvenile and adult criminal components of the system. Minimally, this effort will require review of official documents and interviews with key informants and community members. Additional data collection activities such as field observations or case reviews are encouraged and may be necessary. The local project that is being supported by the Tribal Youth Program should be examined in the context of the existing juvenile justice system and tribal justice system. To do this, the Evaluation Facilitator will have to become familiar with the program activities at the sites as well as the tribal government and tribal body. This familiarity is expected to develop through the preliminary reports from PAT's and close interactions with site personnel through training and technical assistance. The written analysis of the existing juvenile justice system and tribal justice system should include specific recommendations for improving juvenile justice system operations at individual sites and at other county, State, and Federal government entities that share responsibility for handling juvenile offenders. The analytical report should be completed in the first 12 months of the project period, and updates must be provided in each of the subsequent budget periods. Goals The goals for this project are to: Provide direction, training, and technical assistance to local Program Assessment Teams for a participatory evaluation that covers both the process and the outcomes of the Tribal Youth Program. Analyze the existing juvenile justice system and tribal justice system structure and operations at each evaluation site and identify the location and function of the activities under the Tribal Youth Program within the context of this system. Analyze the relationships between tribal government and county, State, and Federal government agencies and other tribal governments as they relate to juvenile justice responsibilities and operations. Objectives The objectives for this project are to: Provide direction, training, and technical assistance necessary for each Program Assessment Team to construct program models and evaluation designs that cover both process and outcomes. Provide direction, training, and technical assistance necessary for each Program Assessment Team to select and carry out procedures for data collection, analysis, and reporting. Document the structure of the existing juvenile justice system and tribal justice system at each site. Document workload, data management procedures and capabilities, and the relationship between the juvenile and adult criminal justice systems in each site. Document the activities of the projects at the sites that are participating in the evaluation of the Tribal Youth Program. Document the relationships between tribal government and county, State, and Federal agencies as they relate to the existing juvenile justice system. Provide reports as indicated below. Products The Evaluation Facilitator will be responsible for supplying PAT's with training materials (e.g., written guidance, sample instruments, instructional materials), as necessary. The Evaluation Facilitator will submit progress reports 6 months and 11 months into the first year of the project. These reports will include discussion of [[Page 53850]] developments or changes in the Program Assessment Teams, training activities to date and plans for future training, progress of local evaluation designs, and progress of the juvenile justice system documentation (required for the first report only). At the conclusion of the first 12-month budget period, the Evaluation Facilitator will submit a separate analytical report covering the juvenile justice system in each of the evaluation sites, the relationships between tribal and nontribal governmental entities in this system, and the location and function of the Tribal Youth Program activities in the context of this system. This report should be suitable for publication as an OJJDP Bulletin. In the second and third years of the project period, PAT's will be responsible for providing written reports on evaluation findings addressing both program process and outcomes. At the end of the second year, the Evaluation Facilitator will provide a preliminary report on progress and early findings from the process and outcome evaluations at each of the sites. Also at this time, the Evaluation Facilitator will provide an updated report on the analysis of the juvenile justice system and tribal justice system at each site. At the end of the third year, the Evaluation Facilitator will integrate the reports provided by the PAT's into a larger document that will include a final site-by-site analysis of the local juvenile justice system and tribal justice system, the role of tribal government or eligible native corporations in this system, and the development and impact of the efforts funded under the Tribal Youth Program. This document will constitute the final report for the Evaulation Facilitator and should include detailed descriptions of evaluation methods and results. A less detailed version of this report will also be created for publication in a form that is suitable for an OJJDP Bulletin. Eligibility Requirements OJJDP invites applications from public and private agencies, organizations, and institutions (including tribal colleges and universities, pursuant to Executive order 13021) and from individuals. Private, for-profit organizations must agree to waive any profit or fee. Joint applications from two or more eligible applicants are welcome; however, one applicant must be clearly indicated as the primary applicant (for correspondence and award purposes) and the others indicated as coapplicants. Project Abstract Applications must include a project abstract that summarizes the problems to be addressed, the goals of the project, project design, and the management and organizational capability of the applicant. The abstract should be double-spaced and no longer than 250 words. Selection Criteria Applications will be evaluated and rated by a peer review panel according to the criteria outlined below. Problem(s) To Be Addressed (20 points) Applicants must include in the project narrative a clear and concise discussion of issues related to conducting research and evaluation in American Indian and Alaska Native communities. Specifically, applicants should discuss approaches to applying evaluation methods in culturally sensitive ways for these populations. Also, applicants should discuss current juvenile justice issues in tribal communities within the framework of the cultural history of these populations. Goals and Objectives (15 points) Applicants must define specific and measurable goals and objectives for coordinating and implementing this project. These should be guided by the requirements in this solicitation, but the applicant should expand and augment them to fit with its approach to the project. Project Design (25 points) The application should describe in detail the overall design of the project. The discussion should include a description of anticipated training and technical assistance activities related to both the process and the outcome evaluation. It is important to describe how the applicant will work directly with the sites in providing guidance for the evaluation process, which includes, but is not limited to, evaluation design, the construction of program logic models, data collection procedures, selection and construction of data collection instruments, data analysis, and reporting. The applicant should also describe in detail the methods to be used to document and analyze the existing juvenile justice systems. This description should include specification of the information and data elements that will be collected. The application must include a timeline that indicates when specific tasks will be started and completed and when products will be submitted. The timeline must be referenced as appropriate in the narrative but should be placed in appendix A of the application. Management and Organizational Capability (30 points) The application must include a discussion of how the applicant will coordinate with Program Assessment Teams and others to achieve evaluation goals and objectives. The applicant's management structure and staffing must be adequate and appropriate for the successful implementation of the project. The applicant must identify responsible individuals and key consultants, their time commitment, and major tasks. Key staff and consultants should have significant experience in training; group facilitation; and program evaluation, including both process and outcome evaluations using both qualitative and quantitative methods. They should demonstrate the ability to work effectively with tribal populations. Staff and key consultant resumes must be attached as part of the appendixes. Budget (10 points) Applicants must provide a proposed budget that is complete, detailed, reasonable, allowable, and cost effective in relation to the activities to be undertaken during the first 12 months of the project period. Applicants should budget for travel to one cross-site cluster meeting in addition to any other travel. A brief budget narrative should also be included. Format The body of the application may not exceed 30 pages in length. These page limits do not include the budget narrative, appendixes, application forms, or assurances. The narrative portion of the application must be submitted on 8\1/2\ by 11-inch paper, double spaced on one side of the paper in a standard 12-point font. These standards are necessary to maintain a fair and uniform standard among all applicants. If the narrative does not conform to these standards, OJJDP will deem the application ineligible for consideration. Award Period This project will be funded in the form of a cooperative agreement with a project period of 36 months. The initial budget period for this application is 12 months. Funding in subsequent budget periods may be at lower levels and will depend upon grantee performance, availability of funds, and other criteria established at the time of award. [[Page 53851]] Award Amount Up to $550,000 is available to the Evaluation Facilitator for the initial 12-month budget period. Of these funds, $150,000 will be awarded by the Evaluation Facilitator during this budget period through contracts with the five PAT sites to support this evaluation activity, including the provision of information and data to the Evaluation Facilitator. Catalog of Federal Domestic Assistance (CFDA) Number For this program, the CFDA number, which is required on Standard Form 424, Application for Federal Assistance, is 16.731. This form is included in OJJDP's Application Kit, which can be obtained by calling the Juvenile Justice Clearinghouse at 800-638-8736 or sending an e-mail request to [email protected]. The Application Kit is also available online at www.ojjdp.ncjrs.org/grants/about.html#kit. Coordination of Federal Efforts To encourage better coordination among Federal agencies in addressing State and local needs, the U.S. Department of Justice is requesting applicants to provide information on the following: (1) active Federal grant awards supporting this or related efforts, including awards from the U.S. Department of Justice; (2) any pending applications for Federal funds for this or related efforts; and (3) plans for coordinating any funds described in items (1) and (2) with the funding sought by this application. For each Federal award, applicants must include the program or project title, the Federal grantor agency, the amount of the award, and a brief description of its purpose. ``Related efforts'' is defined for these purposes as one of the following: Efforts for the same purpose (i.e., the proposed award would supplement, expand, complement, or continue activities funded with other Federal grants). Another phase or component of the same program or project (e.g., to implement a planning effort funded by other Federal funds or to provide a substance abuse treatment or education component within a criminal justice project). Services of some kind (e.g., technical assistance or evaluation) to the program or project described in the application. Delivery Instructions All application packages must be mailed or delivered to the Office of Juvenile Justice and Delinquency Prevention, c/o Juvenile Justice Resource Center, 2277 Research Boulevard, Mail Stop 2K, Rockville, MD 20850; 301-519-5535. Note: In the lower left-hand corner of the envelope, the applicant must clearly write ``Evaluation Facilitation for the Tribal Youth Program.'' Due Date Applicants are responsible for ensuring that the original and five copies of the application package are received by 5 p.m. ET on November 18, 1999. Contact For further information, contact Phelan Wyrick, Research and Program Development Division, 202-353-9254, or send an e-mail inquiry to [email protected]. Suggested Resources Ayers, T. 1987. Stakeholders as partners in evaluation: A stakeholder-collaborative approach. Evaluation and Program Planning 10:263-271. Bureau of Justice Statistics. 1999. American Indians and Crime. U.S. Department of Justice, Office of Justice Programs, Bureau of Justice Statistics. Burke, B. 1998. Evaluating for a change: Reflections on participatory methodology. New Directions in Evaluation 80:43-56. Dugan, M. 1996. Participatory and empowerment evaluation: Lessons learned in training and technical assistance. In Empowerment Evaluation: Knowledge and Tools for Self-Assessment & Accountability, edited by D. Fetterman, S. Kaftearian, and A. Wandersman. Thousand Oaks, CA: Sage. Gaventa, J., Creed, V., and Morrissey, J. 1998. Scaling up: Participatory monitoring and evaluation of a Federal empowerment program. New Directions in Evaluation 80:81-94. Assessment & Accountability, edited by D. Fetterman, S. Kaftearian, and A. Wandersman, Thousand Oaks, CA: Sage. Gaventa, J., Creed, V., and Morrissey, J. 1998. Scaling up: Participatory monitoring and evaluation of a Federal empowerment program. New Directions in Evaluation 80:81-94. Melton, A. 1995. Indigenous justice systems and tribal society. Judicature 79:126-133. Nielsen, M., and Silverman, R. 1996. Native Americans, Crime, and Justice. Boulder, CO: Westview Press. Pommersheim, F. 1995. Braid of feathers: American Indian law and contemporary tribal life. Berkeley: University of California Press. Dated: September 24, 1999. Shay Bilchik, Administrator, Office of Juvenile Justice and Delinquency Prevention. [FR Doc. 99-25645 Filed 10-1-99; 8:45 am] BILLING CODE 4410-18-P