scientists have designed and directed hundreds of evaluations of
statewide and provider-level systems of care and served on numerous,
large-scale evaluation projects undertaken by the federal government.
State Division of Substance Abuse
TOPPS I: In this project, DeltaMetrics developed and evaluated a
self-administered version of the Addiction Severity Index (ASI Self)
as well as a supplement to the ASI (ASI PPM) to facilitate treatment
placement decisions consistent with the ASAM criteria.
Both instruments were assessed in controlled clinical trials,
including a clinical outcomes study targeting 12 treatment programs.
TOPPS II: In a consortium of states led by Utah
and consisting of Arkansas,
Rhode Island and New Hampshire, DeltaMetrics developed a
services-based set of patient placement criteria to serve as an
alternative to or supplement for the ASAM PPC-II criteria.
Both sets of criteria, as well as other potential performance
indicators, are being validated in a pilot outcomes evaluation using
instruments and procedures designed for ultimate adoption in the
Outcomes Monitoring System of each state.
DeltaMetrics directed development of an electronic version of a
self-administered ASI that approximately 3,000 to 4,000 subjects will
complete at admission to treatment. During treatment and at discharge,
all subjects will complete a self-administered survey to document the
number and type of services received.
Follow-up surveys will be telephonically administered by
DeltaMetrics at six-months post discharge.
More than 7,000 surveys will be collected, merged and processed
during the course of the project.
Data analysis will focus on the validity of the performance
indicators, including the patient placement criteria, as eventual
predictors of treatment outcomes, as well as the utility of the
instruments for each of the states’ OMS.
State Division of Alcohol and Substance Abuse
I: Two state clinical tracks were evaluated and compared during and
following treatment: the full continuum of care, starting at inpatient
care and continuing through aftercare; and the partial continuum ,
consisting of clients placed initially in intensive outpatient care
and who generally continue through aftercare.
Approximately 200 patients were sampled from each group.
The outcomes evaluation was conducted using the ASI and the
Withdrawal and Craving Measure; the Treatment Services Review
administered on a bi-weekly basis during treatment; and patient
re-evaluation at approximately 30 days post admission, and again in
months 2, 3 and 9 following admission.
Island Public Health Foundation
I: An electronic system to collect and maintain an assessment,
tracking and outcomes database for all public AOD patients was
developed and installed in a number of publicly funded substance abuse
treatment facilities. Pilot performance indicators, instruments and a
methodology for conducting outcomes evaluations were developed and
piloted in treatment programs for parenting women. An outcomes
evaluation targeting a sample of approximately 600 parenting women was
Commission on Alcohol and Drug Abuse
II: DeltaMetrics assisted the State in selecting potential performance
indicators and in developing instruments that will be pilot tested in
a statewide outcomes evaluation.
The instruments include a modified version of the ASI, the
Recent Treatment Scale to collect data on services received during
treatment, a consumer satisfaction survey and a follow-up version of
the ASI. All instruments
include the core data set for the TOPPS II interstate study.
The instruments are being pilot tested in a statewide outcomes
evaluation involving approximately 1,750 clients.
At six months post-discharge, follow-up surveys will be
conducted by DeltaMetrics. Approximately
6,000 surveys will be collected, merged and processed by DeltaMetrics
during the course of the project.
The data analysis
address the validity of the performance indicators as eventual
predictors of outcomes, as well as on the utility of the newly
developed and/or modified survey instruments in a statewide Outcomes
York State Office of Alcoholism and Substance Abuse Services
II: DeltaMetrics is assisting New York in assessing the predictive
validity of a set of performance indicators that are currently
included in New York’s MIS. An
outcomes evaluation involving 25 treatment providers across the state
will be conducted using instruments developed and/or modified with the
assistance of DeltaMetrics. Intake, during-treatment and discharge
data collection will be completed by treatment providers and a six
month, post-discharge follow up survey will be conducted by
6000 surveys from 25 field locations will be collected and processed
by DeltaMetrics during the course of the project.
Department of Mental Health, Mental Retardation, and Substance Abuse
II: DeltaMetrics assisted the Commonwealth in developing and modifying
instruments and performance indicators that will be pilot tested in a
statewide outcomes evaluation. Intake
assessments for the pilot study are being conducted by staff of
treatment providers. DeltaMetrics will conduct telephonic surveys to
collect during-treatment, discharge and follow-up data (at six and 12
months post admission). Over 4,000 surveys administered to
approximately 1,150 consumers will eventually be collected, processed
and analyzed by DeltaMetrics over the course of the project. Data
analysis will address whether performance measures are valid
indicators of outcomes.
In Illinois, DeltaMetrics conducted a pilot study that targeted 8
clinics in the Chicago area (involving approximately 700 clients)
where a version of the ASI was administered by providers at baseline;
Treatment Services Reviews (TSRs) were administered telephonically by
DeltaMetrics interviewers during treatment, and a six-month
post-discharge interview was administered, also by DeltaMetrics
staff. Over 2,000 surveys were collected and processed by DeltaMetrics
over the course of the project. Using the instruments and procedures
that were piloted in the Chicago study, a statewide study was
undertaken involving 2,200 clients from 40 providers statewide and
expanded thereafter to include 500 TANF clients from 5 providers. Four
statewide trainings (approximately 100 staff from treatment programs)
were conducted by DeltaMetrics. Over 6,000 survey instruments were
administered, either by DeltaMetrics or provider staff.
is conducting outcomes research for the Hazeldon Foundation in
Minnesota. This project seeks to examine outcomes for a subset
of the population treated for drug and alcohol abuse at Hazelden to
determine treatment effectiveness.
DeltaMetrics will identify milestones and barriers that occur
during the recovery process for individuals in six specific treatment
groups: (1) Employed Patients; (2) Healthcare Professionals; (3)
People of Means and Prominence; (4) Gay, Lesbian, Bisexual,
Transgender; (5) Older Adults; (6) Smoking Cessation Group. Treatment
effectiveness is measured in absolute terms (e.g., the percentage of
patients abstinent, employed, not engaging in criminal activity, etc.
at the various follow-up points) and in relative terms (e.g., level of
change between baseline and follow up).
A final objective of this study is to compare treatment and
outcomes from the different groups at Hazelden with other treatment
facilities using appropriate samples from the DeltaMetrics national
Security Referral and Monitoring Agency
From January, 1994 through September, 1995, DeltaMetrics performed as
a subcontractor to Maximus, Inc. on the Social Security
Administration's Referral and Monitoring Agency project. DeltaMetrics
designed and implemented a treatment tracking system that measured the
nature and severity of the problems presented by chemically dependent
SSI and SSDI recipients at treatment admission; the types of services
rendered during treatment; and the amount of change recorded during
and immediately following treatment. The organization worked
extensively with state governments and designed and implemented an
electronic data management system that collected and stored
information from thousands of treatment providers nationwide and that
supported analysis of the data and generation of aggregate management
reports. From this project, DeltaMetrics produced the first
standardized set of data documenting the nature and severity of the
multiple problems presented by this group of chemically dependent
AND TECHNICAL ASSISTANCE
Development and Application
is assisting ROW Sciences, Inc. to identify and respond to the
technical assistance needs among KDA grantees.
DeltaMetrics developed a list of consultants to render expert
assistance in the areas of information management, program
administration, outcomes evaluation, program monitoring and other
facets of substance abuse treatment.
DeltaMetrics also assisted in developing two orientation
sessions for Targeted Expansion Capacity grantees (conducted in
December 1998 and December 1999). The organization also developed a manual describing the
design and use of clinical assessment instruments.
The manual will be used by CSAT and treatment program staff.
II Technical Assistance Center
subcontract to Johnson, Bassin and Shaw, DeltaMetrics has assisted the
nineteen states that comprise the TOPPS II Interstate Steering
Committee to consensually develop a core data set that will be
collected by all the states during their pilot outcomes evaluations.
DeltaMetrics developed a research design for the interstate
study and, with JBS, will analyze the interstate data and prepare
final project reports for publication.
DeltaMetrics is also providing technical assistance to
individual TOPPS II states on design and administration of surveys,
management of large databases, data collection methodologies, and data
Effects of Treatment Studies
Westat, DeltaMetrics has established an expert panel to review the
methodology for the project and completed an evaluation of the
feasibility of adding longer-term follow-up surveys to existing CSAT-funded
outcomes evaluations. Currently,
DeltaMetrics is working with a number of states and other units of
local government to build a family of studies to evaluate longer-term
treatment outcomes. DeltaMetrics
will assist in designing the research methodology; in data collection
and tracking of clients, as well analysis of the data to compare the
results across the family of studies.
Approximately 6 or 7 long-term evaluations will eventually be
DeltaMetrics provides state governments, counties and
community-based organizations with ASI training. A sampling of recent
training contracts include:
DeltaMetrics contracted with the Virginia Department of Mental
Health, Mental Retardation and Substance Abuse Services to provide
standard ASI training to over 300 clinicians.
DeltaMetrics contracted with the New York State Office of
Alcoholism and Substance Abuse Services to provide ASI
"Training of Trainers" sessions, boosters and follow-up
DeltaMetrics contracted with the state of Delaware for
consultation and training to support statewide implementation of
Evaluation Data Services II
under subcontract to Caliber Associates, will be providing technical
assistance in this project which involves refinement of an information system consisting of data
collected under CSAT-supported projects.
DeltaMetrics will be participating in analysis and reporting of
this data and the articulation of the findings to provide easily
understood guidance for policy, treatment practice, and future
Institute on Drug Abuse
was awarded a Phase II Small Business Innovation Research (SBIR) grant
to develop and assess new training materials and models for
administration of the Addiction Severity Index. DeltaMetrics developed
a range of competency measures for ASI interviewers; refined current
ASI training models; and empirically evaluated the effectiveness of
three training models on the acquisition, application and retention of
interviewer knowledge. As a result of this grant, DeltaMetrics
produced its ASI Training on Tapes Series, a set of four video training
tapes designed for use with small groups when larger, facilitated
training sessions are not feasible.