80 FR 19321 - Agency Information Collection Activities: Proposed Collection; Comment Request

DEPARTMENT OF HEALTH AND HUMAN SERVICES
Agency for Healthcare Research and Quality

Federal Register Volume 80, Issue 69 (April 10, 2015)

Page Range		19321-19322
FR Document		2015-07700
This notice announces the intention of the Agency for Healthcare Research and Quality (AHRQ) to request that the Office of Management and Budget (OMB) approve the proposed information collection project: ``Assessing the Impact of the National Implementation of TeamSTEPPS Master Training Program.'' In accordance with the Paperwork Reduction Act, 44 U.S.C. 3501-3520, AHRQ invites the public to comment on this proposed information collection.
Federal Register, Volume 80 Issue 69 (Friday, April 10, 2015)
[Federal Register Volume 80, Number 69 (Friday, April 10, 2015)]
[Notices]
[Pages 19321-19322]
From the Federal Register Online  [www.thefederalregister.org]
[FR Doc No: 2015-07700]


=======================================================================
-----------------------------------------------------------------------

DEPARTMENT OF HEALTH AND HUMAN SERVICES

Agency for Healthcare Research and Quality


Agency Information Collection Activities: Proposed Collection; 
Comment Request

AGENCY: Agency for Healthcare Research and Quality, HHS.

ACTION: Notice.

-----------------------------------------------------------------------

SUMMARY: This notice announces the intention of the Agency for 
Healthcare Research and Quality (AHRQ) to request that the Office of 
Management and Budget (OMB) approve the proposed information collection 
project: ``Assessing the Impact of the National Implementation of 
TeamSTEPPS Master Training Program.'' In accordance with the Paperwork 
Reduction Act, 44 U.S.C. 3501-3520, AHRQ invites the public to comment 
on this proposed information collection.

DATES: Comments on this notice must be received by June 9, 2015.

ADDRESSES: Written comments should be submitted to: Doris Lefkowitz, 
Reports Clearance Officer, AHRQ, by email at 
[email protected].
    Copies of the proposed collection plans, data collection 
instruments, and specific details on the estimated burden can be 
obtained from the AHRQ Reports Clearance Officer.

FOR FURTHER INFORMATION CONTACT: Doris Lefkowitz, AHRQ Reports 
Clearance Officer, (301) 427-1477, or by email at 
[email protected].

SUPPLEMENTARY INFORMATION:

Proposed Project

Assessing the Impact of the National Implementation of TeamSTEPPS 
Master Training Program

    AHRQ, in collaboration with the Department of Defense's (DoD) 
Tricare Management Activity (TMA), developed TeamSTEPPS[supreg] (``Team 
Strategies and Tools to Enhance Performance and Patient Safety'') to 
provide an evidence-based suite of tools and strategies for teaching 
teamwork-based patient safety to health care professionals. In 2007, 
AHRQ and DoD coordinated the national implementation of the TeamSTEPPS 
Program. The main objective of this program is to improve patient 
safety by training a select group of stakeholders such as Quality 
Improvement Organization (QIO) personnel, High Reliability Organization 
(HRO) staff, and health care system staff in various teamwork, 
communication, and patient safety concepts, tools, and techniques. 
Ultimately TeamSTEPPS will help to build a national and state-level 
infrastructure for supporting teamwork-based patient safety efforts in 
health care organizations.
    The National Implementation of TeamSTEPPS Master Training Program 
includes the training of ``Master Trainers'' in various health care 
systems capable of stimulating the utilization and adoption of 
TeamSTEPPS in their health care delivery systems, providing technical 
assistance and consultation on implementing TeamSTEPPS, and developing 
various channels of learning (e.g., user networks, various educational 
venues) for continuing support and improvement of teamwork in health 
care. AHRQ has already trained a corps of over 5,000 participants to 
serve as the Master Trainer infrastructure supporting national adoption 
of TeamSTEPPS. An anticipated 2,400 participants who are registering 
for the program will be studied in this assessment. Participants in 
training become Master Trainers in TeamSTEPPS and are afforded the 
opportunity to observe the program's tools and strategies in action. In 
addition to developing a corps of Master Trainers, AHRQ has also 
developed a series of support mechanisms for this effort including a 
data collection Web tool, a TeamSTEPPS call support center, and a 
monthly consortium to address any challenges encountered implementing 
TeamSTEPPS.
    Participants applied to the program as teams representing their 
organizations and were accepted as training participants after having 
completed an organizational readiness assessment. Due to the 
differences among the types of organizations participating in the 
program, each participant has a different potential to apply tools and 
concepts within and/or beyond their home organizations. For example:
     Health care system staff (or implementers) from hospitals, 
home health agencies, nursing homes, large physician practices, and 
other direct care organizations are more likely than other participants 
to implement the TeamSTEPPS materials on a daily basis and will be more 
likely to affect specific work processes being conducted within an 
organization. As a result, health care system participants are likely 
to have a focused and specific impact that is limited to their 
organization.
     QIO\HRO\Hospital Association\State Health Department 
participants (or facilitators) will be more likely to have both an in-
depth and broad impact if they use the TeamSTEPPS materials to assist a 
particular organization inits patient safety activities, as well as to 
provide general patient safety guidance to a large number of 
organizations.
    To clarify the differences among the participants, a logic model 
has been developed that highlights the roles of the different types of 
participants, the types of activities in which they are likely to 
engage post-training, and the potential outcomes that may stem from 
these activities. The logic model served as a guide for developing 
questions for a web-based questionnaire and qualitative interviews to 
ensure that participant and leadership feedback is captured as 
thoroughly and accurately as possible.
    AHRQ is conducting an ongoing evaluation of the National 
Implementation of TeamSTEPPS Master Training Program. The goals of this 
evaluation are to examine the extent to which training participants 
have been able to:
    (1) Implement the TeamSTEPPS products, concepts, tools, and 
techniques in their home organizations and,
    (2) the extent to which participants have spread that training, 
knowledge, and skills to their organizations, local areas, regions, and 
states.
    The National Implementation of TeamSTEPPS program is led by AHRQ 
through its contractor, the Health Research and Educational Trust 
(HRET). This study is being conducted by HRET's subcontractor, IMPAQ 
International. The work is being conducted pursuant to AHRQ's statutory 
authority to conduct and support research, evaluations, and training on 
health care and on systems for the delivery of such care, including 
activities with respect to the quality, effectiveness, efficiency, 
appropriateness and value of health care services and with respect to 
quality measurement and improvement. 42 U.S.C. 299a(a)(1) and (2).

Method of Collection

    To achieve the goals of this assessment the following two data 
collections will be implemented:
    (1) Training participant questionnaires to examine post-training 
activities and teamwork outcomes as a

[[Page 19322]]

result of training from multiple perspectives. The questionnaire is 
directed to all Master Training participants, and will cover post-
training activities, implementation experiences, facilitators and 
barriers to implementation encountered, and perceived outcomes as a 
result of these activities. Advance notice, invitations to participate, 
reminder emails, and thank you letters to respondents are included in 
the participant questionnaire.
    (2) Semi-structured interviews will be conducted with members from 
organizations who participated in the TeamSTEPPS Master Training 
Program. Information gathered from these interviews will be analyzed 
and used to draft a ``lessons learned'' document that will capture 
additional detail on the issues related to participants' and 
organizations' abilities to implement and disseminate TeamSTEPPS post-
training. The organizations will vary in terms of type of organization 
(e.g., QIO or hospital associations versus health care systems) and 
region (i.e., Northeast, Midwest, Southwest, Southeast, Mid-Atlantic, 
West Coast). In addition, we will strive to ensure that the 
distribution of organizations mirrors the distribution of organizations 
in the Master Training population. For example, if the distribution of 
organizations is such that only one out of every five organizations is 
a QIO, we will ensure that a maximum of two organizations in the site 
visit sample are QIOs. The interviews will more accurately reveal the 
degree of training spread for the organizations included. Interviewees 
will be drawn from qualified individuals serving in one of two roles 
(i.e., implementers or facilitators). The interview protocol will be 
adapted for each role based on the respondent group and to some degree, 
for each individual, based on their training and patient safety 
experience. There is also an informed consent form that each 
participant will be required to sign prior to beginning the interview.
    The final product for this evaluation will be a report that 
documents the background, methodology, results (including any patterns 
or themes emerging from the data), limitations of the study, and 
recommendations for future training programs and tool development. The 
results of this evaluation will help AHRQ understand the extent to 
which participants and participating organizations have been able to 
employ various TeamSTEPPS tools and concepts and the barriers and 
facilitators they encountered. This information will help guide AHRQ in 
developing and refining other patient safety tools and future training 
programs for patient safety.

Estimated Annual Respondent Burden

    Exhibit 1 shows the estimated annualized burden hours for the 
respondent's time to participate in the study. Semi-structured 
interviews will be conducted with a maximum of 9 individuals from each 
of 9 participating organizations and will last about one hour each. The 
training participant questionnaire will be completed by approximately 
10 individuals from each of about 240 organizations and is estimated to 
require 20 minutes to complete. The total annualized burden is 
estimated to be 881 hours.
    Exhibit 2 shows the estimated annualized cost burden based on the 
respondents' time to participate in the study. The total cost burden is 
estimated to be $39,240.

                                  Exhibit 1--Estimated Annualized Burden Hours
----------------------------------------------------------------------------------------------------------------
                                                                     Number of
                    Form name                        Number of     responses per     Hours per     Total burden
                                                    respondents     respondent       response          hours
----------------------------------------------------------------------------------------------------------------
Semi-structured interview.......................               9               9           60/60              81
Training participant questionnaire..............             240              10           20/60             800
                                                 ---------------------------------------------------------------
    Total.......................................             249              NA              NA             881
----------------------------------------------------------------------------------------------------------------


                                   Exhibit 2--Estimated Annualized Cost Burden
----------------------------------------------------------------------------------------------------------------
                                                     Total burden   Average hourly    Total cost
     Form name           Number of respondents           hours        wage rate*        burden
--------------------------------------------------------------------------------------------------
Semi-structured     9.............................              81          $44.54          $3,608
 interview
 Training           240...........................             800           44.54          35,632
 participant
 questionnaire
                   ---------------------------------------------------------------------------------------------
    Total.........  249...........................             881              NA          39,240
----------------------------------------------------------------------------------------------------------------
* Based upon the mean of the average wages for all health professionals (29-0000) for the training participant
  questionnaire and for executives, administrators, and managers for the organizational leader questionnaire
  presented in the National Compensation Survey: Occupational Wages in the United States, May 2013, U.S.
  Department of Labor, Bureau of Labor Statistics. http://www.bls.gov/oes/current/oes_nat.htm 35.93 53.15.

Request for Comments

    In accordance with the Paperwork Reduction Act, comments on AHRQ's 
information collection are requested with regard to any of the 
following: (a) Whether the proposed collection of information is 
necessary for the proper performance of AHRQ health care research and 
health care information dissemination functions, including whether the 
information will have practical utility; (b) the accuracy of AHRQ's 
estimate of burden (including hours and costs) of the proposed 
collection(s) of information; (c) ways to enhance the quality, utility, 
and clarity of the information to be collected; and (d) ways to 
minimize the burden of the collection of information upon the 
respondents, including the use of automated collection techniques or 
other forms of information technology.
    Comments submitted in response to this notice will be summarized 
and included in the Agency's subsequent request for OMB approval of the 
proposed information collection. All comments will become a matter of 
public record.

    Dated: March 31, 2015.
Sharon B. Arnold,
Deputy Director.
[FR Doc. 2015-07700 Filed 4-09-15; 8:45 am]
BILLING CODE 4160-90-P
Federal Register / Vol. 80, No. 69 / Friday, April 10, 2015 / Notices 19321

shares of Trinity Capital Corporation, to health care professionals. In 2007, an organization. As a result, health care
and thereby indirectly retain voting AHRQ and DoD coordinated the system participants are likely to have a
shares of Los Alamos National Bank, national implementation of the focused and specific impact that is
both in Los Alamos, New Mexico. TeamSTEPPS Program. The main limited to their organization.
Board of Governors of the Federal Reserve objective of this program is to improve • QIO\HRO\Hospital
System, April 7, 2015. patient safety by training a select group Association\State Health Department
Michael J. Lewandowski, of stakeholders such as Quality participants (or facilitators) will be more
Improvement Organization (QIO) likely to have both an in-depth and
Associate Secretary of the Board.
personnel, High Reliability Organization broad impact if they use the
[FR Doc. 2015–08283 Filed 4–9–15; 8:45 am]
(HRO) staff, and health care system staff TeamSTEPPS materials to assist a
BILLING CODE 6210–01–P
in various teamwork, communication, particular organization inits patient
and patient safety concepts, tools, and safety activities, as well as to provide
techniques. Ultimately TeamSTEPPS general patient safety guidance to a large
DEPARTMENT OF HEALTH AND will help to build a national and state- number of organizations.
HUMAN SERVICES level infrastructure for supporting To clarify the differences among the
teamwork-based patient safety efforts in participants, a logic model has been
Agency for Healthcare Research and health care organizations. developed that highlights the roles of
Quality The National Implementation of the different types of participants, the
TeamSTEPPS Master Training Program types of activities in which they are
Agency Information Collection
includes the training of ‘‘Master likely to engage post-training, and the
Activities: Proposed Collection;
Trainers’’ in various health care systems potential outcomes that may stem from
Comment Request
capable of stimulating the utilization these activities. The logic model served
AGENCY: Agency for Healthcare Research and adoption of TeamSTEPPS in their as a guide for developing questions for
and Quality, HHS. health care delivery systems, providing a web-based questionnaire and
ACTION: Notice. technical assistance and consultation on qualitative interviews to ensure that
implementing TeamSTEPPS, and participant and leadership feedback is
SUMMARY: This notice announces the developing various channels of learning captured as thoroughly and accurately
intention of the Agency for Healthcare (e.g., user networks, various educational as possible.
Research and Quality (AHRQ) to request venues) for continuing support and AHRQ is conducting an ongoing
that the Office of Management and improvement of teamwork in health evaluation of the National
Budget (OMB) approve the proposed care. AHRQ has already trained a corps Implementation of TeamSTEPPS Master
information collection project: of over 5,000 participants to serve as the Training Program. The goals of this
‘‘Assessing the Impact of the National Master Trainer infrastructure supporting evaluation are to examine the extent to
Implementation of TeamSTEPPS Master national adoption of TeamSTEPPS. An which training participants have been
Training Program.’’ In accordance with anticipated 2,400 participants who are able to:
the Paperwork Reduction Act, 44 U.S.C. registering for the program will be (1) Implement the TeamSTEPPS
3501–3520, AHRQ invites the public to studied in this assessment. Participants products, concepts, tools, and
comment on this proposed information in training become Master Trainers in techniques in their home organizations
collection. TeamSTEPPS and are afforded the and,
DATES: Comments on this notice must be opportunity to observe the program’s (2) the extent to which participants
received by June 9, 2015. tools and strategies in action. In have spread that training, knowledge,
ADDRESSES: Written comments should addition to developing a corps of Master and skills to their organizations, local
be submitted to: Doris Lefkowitz, Trainers, AHRQ has also developed a areas, regions, and states.
Reports Clearance Officer, AHRQ, by series of support mechanisms for this The National Implementation of
email at doris.lefkowitz@AHRQ.hhs.gov. effort including a data collection Web TeamSTEPPS program is led by AHRQ
Copies of the proposed collection tool, a TeamSTEPPS call support center, through its contractor, the Health
plans, data collection instruments, and and a monthly consortium to address Research and Educational Trust (HRET).
specific details on the estimated burden any challenges encountered This study is being conducted by
can be obtained from the AHRQ Reports implementing TeamSTEPPS. HRET’s subcontractor, IMPAQ
Clearance Officer. Participants applied to the program as International. The work is being
FOR FURTHER INFORMATION CONTACT:
teams representing their organizations conducted pursuant to AHRQ’s
Doris Lefkowitz, AHRQ Reports and were accepted as training statutory authority to conduct and
Clearance Officer, (301) 427–1477, or by participants after having completed an support research, evaluations, and
email at doris.lefkowitz@AHRQ.hhs.gov. organizational readiness assessment. training on health care and on systems
Due to the differences among the types for the delivery of such care, including
SUPPLEMENTARY INFORMATION:
of organizations participating in the activities with respect to the quality,
Proposed Project program, each participant has a different effectiveness, efficiency,
potential to apply tools and concepts appropriateness and value of health care
Assessing the Impact of the National within and/or beyond their home
Implementation of TeamSTEPPS Master services and with respect to quality
organizations. For example: measurement and improvement. 42
Training Program • Health care system staff (or U.S.C. 299a(a)(1) and (2).
mstockstill on DSK4VPTVN1PROD with NOTICES

AHRQ, in collaboration with the implementers) from hospitals, home
Department of Defense’s (DoD) Tricare health agencies, nursing homes, large Method of Collection
Management Activity (TMA), developed physician practices, and other direct To achieve the goals of this
TeamSTEPPS® (‘‘Team Strategies and care organizations are more likely than assessment the following two data
Tools to Enhance Performance and other participants to implement the collections will be implemented:
Patient Safety’’) to provide an evidence- TeamSTEPPS materials on a daily basis (1) Training participant
based suite of tools and strategies for and will be more likely to affect specific questionnaires to examine post-training
teaching teamwork-based patient safety work processes being conducted within activities and teamwork outcomes as a

VerDate Sep<11>2014 20:09 Apr 09, 2015 Jkt 235001 PO 00000 Frm 00046 Fmt 4703 Sfmt 4703 E:\FR\FM\10APN1.SGM 10APN1
19322 Federal Register / Vol. 80, No. 69 / Friday, April 10, 2015 / Notices

result of training from multiple of organizations in the Master Training participating organizations have been
perspectives. The questionnaire is population. For example, if the able to employ various TeamSTEPPS
directed to all Master Training distribution of organizations is such that tools and concepts and the barriers and
participants, and will cover post- only one out of every five organizations facilitators they encountered. This
training activities, implementation is a QIO, we will ensure that a information will help guide AHRQ in
experiences, facilitators and barriers to maximum of two organizations in the developing and refining other patient
implementation encountered, and site visit sample are QIOs. The safety tools and future training programs
perceived outcomes as a result of these interviews will more accurately reveal for patient safety.
activities. Advance notice, invitations to the degree of training spread for the
participate, reminder emails, and thank organizations included. Interviewees Estimated Annual Respondent Burden
you letters to respondents are included will be drawn from qualified
in the participant questionnaire. individuals serving in one of two roles Exhibit 1 shows the estimated
(2) Semi-structured interviews will be (i.e., implementers or facilitators). The annualized burden hours for the
conducted with members from interview protocol will be adapted for respondent’s time to participate in the
organizations who participated in the each role based on the respondent group study. Semi-structured interviews will
TeamSTEPPS Master Training Program. and to some degree, for each individual, be conducted with a maximum of 9
Information gathered from these based on their training and patient individuals from each of 9 participating
interviews will be analyzed and used to safety experience. There is also an organizations and will last about one
draft a ‘‘lessons learned’’ document that informed consent form that each hour each. The training participant
will capture additional detail on the participant will be required to sign prior questionnaire will be completed by
issues related to participants’ and to beginning the interview. approximately 10 individuals from each
organizations’ abilities to implement The final product for this evaluation of about 240 organizations and is
and disseminate TeamSTEPPS post- will be a report that documents the estimated to require 20 minutes to
training. The organizations will vary in background, methodology, results complete. The total annualized burden
terms of type of organization (e.g., QIO (including any patterns or themes is estimated to be 881 hours.
or hospital associations versus health emerging from the data), limitations of
care systems) and region (i.e., Northeast, the study, and recommendations for Exhibit 2 shows the estimated
Midwest, Southwest, Southeast, Mid- future training programs and tool annualized cost burden based on the
Atlantic, West Coast). In addition, we development. The results of this respondents’ time to participate in the
will strive to ensure that the distribution evaluation will help AHRQ understand study. The total cost burden is estimated
of organizations mirrors the distribution the extent to which participants and to be $39,240.

EXHIBIT 1—ESTIMATED ANNUALIZED BURDEN HOURS
Number of
Number of Hours per Total burden
Form name responses per
respondents response hours
respondent

Semi-structured interview ................................................................................ 9 9 60/60 81
Training participant questionnaire ................................................................... 240 10 20/60 800
Total .......................................................................................................... 249 NA NA 881

EXHIBIT 2—ESTIMATED ANNUALIZED COST BURDEN
Average
Number of Total burden Total cost
Form name hourly wage
respondents hours burden
rate*

Semi-structured interview ................................................................................ 9 81 $44.54 $3,608
Training participant questionnaire ................................................................... 240 800 44.54 35,632
Total .......................................................................................................... 249 881 NA 39,240
* Based upon the mean of the average wages for all health professionals (29–0000) for the training participant questionnaire and for execu-
tives, administrators, and managers for the organizational leader questionnaire presented in the National Compensation Survey: Occupational
Wages in the United States, May 2013, U.S. Department of Labor, Bureau of Labor Statistics. http://www.bls.gov/oes/current/oes_nat.htm 35.93
53.15.

Request for Comments AHRQ’s estimate of burden (including included in the Agency’s subsequent
hours and costs) of the proposed request for OMB approval of the
In accordance with the Paperwork collection(s) of information; (c) ways to proposed information collection. All
Reduction Act, comments on AHRQ’s enhance the quality, utility, and clarity comments will become a matter of
information collection are requested
of the information to be collected; and public record.
mstockstill on DSK4VPTVN1PROD with NOTICES

with regard to any of the following: (a)
(d) ways to minimize the burden of the Dated: March 31, 2015.
Whether the proposed collection of
information is necessary for the proper collection of information upon the
Sharon B. Arnold,
performance of AHRQ health care respondents, including the use of
automated collection techniques or Deputy Director.
research and health care information [FR Doc. 2015–07700 Filed 4–09–15; 8:45 am]
dissemination functions, including other forms of information technology.
BILLING CODE 4160–90–P
whether the information will have Comments submitted in response to
practical utility; (b) the accuracy of this notice will be summarized and

VerDate Sep<11>2014 20:09 Apr 09, 2015 Jkt 235001 PO 00000 Frm 00047 Fmt 4703 Sfmt 9990 E:\FR\FM\10APN1.SGM 10APN1
Document Created: 2018-02-21 10:08:28
Document Modified: 2018-02-21 10:08:28
Category		Regulatory Information
Collection		Federal Register
sudoc Class		AE 2.7: GS 4.107: AE 2.106:
Publisher		Office of the Federal Register, National Archives and Records Administration
Section		Notices
Action		Notice.
Dates		Comments on this notice must be received by June 9, 2015.
Contact		Doris Lefkowitz, AHRQ Reports Clearance Officer, (301) 427-1477, or by email at [email protected]
FR Citation		80 FR 19321
80 FR 19321 - Agency Information Collection Activities: Proposed Collection; Comment Request

DEPARTMENT OF HEALTH AND HUMAN SERVICESAgency for Healthcare Research and Quality

Federal Register Volume 80, Issue 69 (April 10, 2015)

DEPARTMENT OF HEALTH AND HUMAN SERVICES
Agency for Healthcare Research and Quality
