U.S. DEPARTMENT OF LABOR
Employment and Training Administration
Washington, D. C. 20210
February 4, 1999
|DIRECTIVE||:||TRAINING AND EMPLOYMENT INFORMATION NOTICE NO. 18-98|
|TO||:||ALL STATE JTPA LIAISONS
ALL STATE EMPLOYMENT SECURITY AGENCIES
ALL STATE WORKER ADJUSTMENT LIAISONS
ALL ONE-STOP CAREER CENTER SYSTEM LEADS
Office of Regional Management
|SUBJECT||:||Report on Measuring Accountability in the Summer Youth Employment and Training Program (SYETP)|
Purpose. To announce the publication and distribution of a report on Measuring Accountability in the SYETP.
References. Training and Employment Guidance Letter (TEGL) No. 4-97.
Background. The Employment and Training Administration (ETA) continues to implement strategies to strengthen the performance and to increase the accountability of States and local training providers under the SYETP. ETA contracted with Social Policy Research Associates (SPR) to conduct a pilot-test of a procedure for measuring accountability for academic enrichment in the Job Training Partnership Act, Title II-B program. The pilot was conducted during the 1998 summer program for the purpose of determining: (1) how much of an effort it is for service delivery areas (SDAs) and service providers to collect the additional information that is necessary to support the measures of accountability; (2) whether the accountability measures being tested capture key elements of what the SDAs are trying to accomplish and whether they serve as a meaningful yardstick of the SDAs' success; and (3) if it is feasible to implement a uniform system of accountability on a broad scale. Each of these purposes was incorporated into the design of the pilot-test in an effort to conduct a comprehensive investigation into the feasibility and use of an accountability system for the SYETP.
Pilot Report. The report consists of findings based on pilot-tests conducted at eight of the nine SDAs selected to participate in this study. The following SDAs were selected to participate in the pilot:
Region I - New Hampshire
Region II - Middlesex County Employment and Training Department, New Brunswick, NJ
Region III - Philadelphia PIC, Philadelphia, PA
Region IV - Palm Beach County Workforce Board, West Palm Beach, FL
Region V - Southeastern Minnesota SDA
Region VI - City of Houston, Houston, TX
Region VIII - Montana CEP, Helena, MT
Region IX - City of Los Angeles, Los Angeles, CA
Region X - Seattle-King County PIC, Seattle, WA
SPR looked at the diverse assessment instruments used at eight of the nine SDAs to determine whether or not these measures adequately reflect the overall programmatic objectives of each SDA. Because of a conflict in scheduling, Los Angeles was not a part of the pilot. Youth Employability Competencies (YECs) was selected as the accountability system to be piloted. YECs allows SDAs flexibility in carrying out the objectives of their summer programs and was already familiar to the SDAs. The report includes a summary of findings from the eight partici- pating SDAs and it contains an analysis of client-level data from SDAs based on assessments of reading/verbal skills, along with pre-employment/work maturity skills of the sample group.
When looking at academic enrichment and how to assess it, SPR focused on several factors, such as the definition of academic enrichment, which ETA currently defines very broadly in TEGL 4-97, and on the short duration of the program. To address these issues, SPR has recommended that the Department consider the following options: (1) re-define academic enrichment to make it more precise in identifying specific skills or areas of skills that the definition will encompass; and (2) adopt a menu approach to accountability measures, whereby SDAs would be allowed to choose from a list of acceptable measures.
ETA plans to use information contained in the report to formulate policy guidance to States and local providers for the 1999 summer youth program.
Action Required. Inform SDAs that the report is available via the Internet at WWW.WDSC.ORG/SUMMERYOUTH.
Inquiries. Questions should be directed to your Regional Office.
Attachment. "Measuring Accountability in the Summer Youth Program: A Pilot"