Establish a Monitoring and Evaluation (M&E) framework for services that provide alternatives to incarceration

Lead agency: Office of Evaluation, Performance, and Analytics

SIM intercept: 1-5

Population of focus (if applicable): N/A

Summary of planned action: 

Evaluation:

In 2025, OEPA will complete the design evaluation, and begin assessing ATI program implementation (process evaluation). Performance Measurement: OEPA will finalize ATI data reporting tools and analytics and launch ATI Data Stories. ATI Data Stories are designed to show how someone moves through the criminal legal system in San Diego County, and the different touch points that ATI programs and services have throughout a person’s journey. These stories will be published online for the public. 

Data Governance: 

OEPA will explore establishing a Data Steering Committee to help standardize justice-related data and improve coordination between agencies.

Actions taken:

  • Evaluation: In conducting the ATI design evaluation, OEPA did a literature review, key informant interviews, and a review of relevant program documents. As an additional step, OEPA has started work to identify how the evaluation recommendations could be put into practice by considering experiences from other jurisdictions. In March 2025 OEPA and the RAND Corporation jointly applied for funding through Arnold Ventures; however, Arnold Ventures discontinued the funding opportunity in May 2025.  

  • Performance Measurement: OEPA has received quarterly data from January 2024 through September 2025 from ATI partners and co-developed draft data storytelling webpages with the Public Safety Executive Office and the County Communication Office. OEPA has been meeting separately with ATI partners to review the data and refine the storytelling pages, ensuring accuracy and alignment with program outcomes. These efforts aim to strengthen data transparency and enhance how ATI progress is communicated to the public.

  • Data Analysis Governance: OEPA convened a multi-sector Data Steering Committee made up of ATI data-owning partners. The committee refined and approved 15 Key Performance Indicators (KPIs).

Next steps: 

  • Evaluation: Complete the design evaluation and share insights from the evaluation of the ATI initiative’s design with stakeholders, supporting efforts to translate findings into actionable improvements. Continue efforts to assess how the initiative works in practice, and what results are achieved. Explore new impact evaluation funding or partnership opportunities with external researchers.

  • Performance Measurement: Finalize and publish the ATI Data Stories webpages in March 2026, including the 15 Key Performance Indicators (KPIs). Engage community members to review and provide insight to ATI Data Stories website.  

  • Data Governance: Finalize data-sharing agreements with HHSA, BHS, Probation, and the Sheriff’s Office to obtain additional data insights into ATI programs and services. Expand cross-system data integration within the Enterprise Integrated Data Platform (EIDP) to improve efficiency of data sharing and analysis. Develop data governance protocols to ensure the proper use, quality, and security of newly shared data.