81_FR_33778 81 FR 33675 - Agency Information Collection Activities: Proposed Collection; Comment Request

81 FR 33675 - Agency Information Collection Activities: Proposed Collection; Comment Request

DEPARTMENT OF HEALTH AND HUMAN SERVICES
Agency for Healthcare Research and Quality

Federal Register Volume 81, Issue 103 (May 27, 2016)

Page Range33675-33678
FR Document2016-12532

This notice announces the intention of the Agency for Healthcare Research and Quality (AHRQ) to request that the Office of Management and Budget (OMB) approve the proposed information collection project: ``Eisenberg Center Voluntary Customer Survey Generic Clearance.'' In accordance with the Paperwork Reduction Act, 44 U.S.C. 3501-3521, AHRQ invites the public to comment on this proposed information collection.

Federal Register, Volume 81 Issue 103 (Friday, May 27, 2016)
[Federal Register Volume 81, Number 103 (Friday, May 27, 2016)]
[Notices]
[Pages 33675-33678]
From the Federal Register Online  [www.thefederalregister.org]
[FR Doc No: 2016-12532]


=======================================================================
-----------------------------------------------------------------------

DEPARTMENT OF HEALTH AND HUMAN SERVICES

Agency for Healthcare Research and Quality


Agency Information Collection Activities: Proposed Collection; 
Comment Request

AGENCY: Agency for Healthcare Research and Quality, HHS.

ACTION: Notice.

-----------------------------------------------------------------------

SUMMARY: This notice announces the intention of the Agency for 
Healthcare Research and Quality (AHRQ) to request that the Office of 
Management and Budget (OMB) approve the proposed information collection 
project: ``Eisenberg Center Voluntary Customer Survey Generic 
Clearance.'' In accordance with the Paperwork Reduction Act, 44 U.S.C. 
3501-3521, AHRQ invites the public to comment on this proposed 
information collection.

DATES: Comments on this notice must be received by July 26, 2016.

ADDRESSES: Written comments should be submitted to: Doris Lefkowitz, 
Reports Clearance Officer, AHRQ, by email at 
[email protected].
    Copies of the proposed collection plans, data collection 
instruments, and specific details on the estimated burden can be 
obtained from the AHRQ Reports Clearance Officer.

FOR FURTHER INFORMATION CONTACT: Doris Lefkowitz, AHRQ Reports 
Clearance Officer, (301) 427-1477, or by email at 
[email protected].

SUPPLEMENTARY INFORMATION: 

Proposed Project

Eisenberg Center Voluntary Customer Survey Generic Clearance

    The Agency for Healthcare Research and Quality (AHRQ) requests that 
the Office of Management and Budget (OMB) renew under the Paperwork 
Reduction Act of 1995 AHRQ's Generic Clearance to collect information 
from users of work products and services produced by AHRQ's John M. 
Eisenberg Center for Clinical Decisions and Communications Science 
(Eisenberg Center). The Eisenberg Center is an innovative effort aimed 
at improving communication of findings to a variety of audiences 
(``customers''), including consumers, clinicians, and health care 
policymakers. The Eisenberg Center compiles research results into a 
variety of useful formats for stakeholders.
    This effort has the following goals:
    (1) Conduct research into effective communication of research 
findings in order to improve the usability and rapid incorporation of 
findings into medical practice and decision making.
    (2) Conduct research into effective strategies for disseminating 
evidence-based products, tools, and resources to consumers, clinicians, 
and other health care professionals, and policymakers.
    (3) Evaluate outcomes reported by clinicians and other health care 
professionals resulting from participation in continuing medical 
education (CME) initiatives and activities.
    (4) Conduct research into factors associated with successful 
collaboration between AHRQ and partnering institutions and 
organizations in synthesizing, translating, and disseminating evidence-
based research.
    Clearance is being requested to cover a three-year period in which 
differing numbers of products and research activities may be conducted 
during each year. The collections proposed include activities to assist 
in the development of materials to be disseminated through the 
Eisenberg Center and to provide feedback to AHRQ on the extent to which 
these products meet customer needs. These materials include summary 
documents that summarize and translate the findings of research reports 
for various decision-making audiences, such as consumers, clinicians, 
and policymakers. The summaries are designed to help these decision 
makers use research evidence to maximize the benefits of health care, 
minimize harm, and optimize the use of health care resources. In 
addition, each year, a unique research project will be undertaken to 
study successful approaches to disseminating AHRQ

[[Page 33676]]

products in various health care settings and clinical environments. 
Also, each year, the Eisenberg Center will develop one interactive 
decision aid for clinical problems identified from selected research 
reports. The intent is for the decision aid to increase the decision 
maker's knowledge of the health condition, options, and risk/benefits; 
lead to greater assurance in making a decision; increase the congruence 
between values and choices; and enhance involvement in the decision 
making process. Information collections conducted under this generic 
clearance are not required by regulation and will not be used to 
regulate or sanction customers. Data collections will be entirely 
voluntary, and information provided by respondents will be combined and 
summarized so that no individually identifiable information will be 
released.
    This study is being conducted by AHRQ through its contractor, 
Baylor College of Medicine, pursuant to AHRQ's statutory authority to 
conduct and support research on health care and on systems for the 
delivery of such care, including activities with respect to the 
quality, effectiveness, efficiency, appropriateness and value of health 
care services and with respect to quality measurement and improvement. 
42 U.S.C. 299a(a)(1) and (2).

Method of Collection

    The data collections listed below will be implemented to achieve 
project goals. Note: Assessments such as interviews and surveys are 
here denoted formative if conducted prior to product development or 
determination of dissemination channels; usability testing or 
pretesting if conducted while reviewing a draft product, proposed 
dissemination approach, or other proposed content/strategy; and 
evaluation if conducted for summative evaluation or to assess 
satisfaction after the product has been in use or the dissemination 
campaign, learning activity, or other initiative undertaken.
    Data collections will include the following:
    (1) Interviews for Product and Decision Aid Development, Testing, 
and Use. Individual interviews will be conducted with clinical 
professionals, patients, or other health care consumers, or health 
policymakers. In some cases focus groups may be substituted for patient 
interviews. These formative and pretesting/cognitive interviews will 
allow for (1) collecting input from target audiences regarding the 
development of summary products and decision aids; (2) determining if 
intended information and messages are being delivered effectively 
through products that are developed and disseminated through the 
Eisenberg Center; (3) assessing whether changes in topical knowledge 
levels can be identified following exposure to Eisenberg Center 
informational or instructional products or aids; (4) identifying 
product strengths and weaknesses to facilitate improvements that are 
practical and feasible; and (5) assessing decision support from the 
perspective of each audience. In addition, the Eisenberg Center will 
conduct a new research project annually to inform the enhancement of 
existing health information products, beyond what is currently being 
provided. The accompanying assessments will likely consist of 
interviews conducted with target audience members and may be integrated 
into the existing product interviews discussed above.
    (2) Interviews for Dissemination Activities. Interviews will be 
conducted with leadership and staff of health systems, hospitals, and/
or clinics in which dissemination activities are conducted to explore, 
prior to initiating the project, those pathways holding the greatest 
potential for successful uptake of the AHRQ materials. Interviews will 
be conducted again after project conclusion with administrators and 
product users (e.g., consumers, clinicians) to assess success of 
dissemination efforts, perceptions around product access, challenges 
that arose, and strategies to facilitate future successful 
dissemination initiatives.
    (3) Survey for Decision Aids. Following delivery of the decision 
aid, a user survey will be completed to explore subjects' impressions 
of the tool, including ease of use, clarity of presentation, length, 
balance of information, rating of interactive features, and overall 
satisfaction. Both clinicians and patients/consumers will be surveyed. 
For patients, the customer satisfaction survey may include decisional 
outcome measures (e.g., decisional conflict, desire for involvement in 
decision-making), measures of attitudes and self-efficacy, and 
indicators of choice intention or actual choice made. If the aid is 
evaluated within a clinical context, measures of physician-patient 
interaction will also be considered. Additionally, clinicians may be 
interviewed about the impact of the aid on decision making, clinical 
flow, and patient outcomes.
    (4) Survey for Summary Products (initial, follow up). Very brief 
surveys will be offered to health care professionals, consumers, and 
policymakers that use the online summaries. Immediately upon accessing 
the summaries, visitors will be asked to complete a brief survey 
assessing for whom they were seeking information, how the product might 
be used, and an email address for a follow-up survey. Respondents will 
subsequently be sent an email asking them to complete a follow-up 
online survey assessing how the information has been used, whether it 
influenced health care practices, and any barriers to use or 
suggestions for improvement.
    (5) Survey of Patient and Consumer Advocacy Organizations. Each 
project year, representatives from consumer and patient advocacy 
organizations will be invited to attend a meeting and participate in 
ongoing activities to facilitate engagement in AHRQ systematic review, 
translation, and dissemination activities. Surveys by phone or online 
questionnaire will be used to assess the quality of the in-person 
meeting and ongoing activities, the impact and value of engaging with 
AHRQ, the value of research and translation products for the target 
audiences, how partners and their constituents are using the products, 
and ways to make the products and partnerships with AHRQ more useful 
for partners and have a broader reach.
    (6) Survey of AHRQ Partners. AHRQ, through the Evidence-based 
Practice Center (EPC) Program and Eisenberg Center, works in 
partnership with organizations when developing, translating, and/or 
disseminating research reports and related products. AHRQ's partners 
include developers of clinical practice guidelines, payers, other 
Government agencies, private companies, consumer and patient advocacy 
groups, and health care systems. Surveys by phone or online 
questionnaire, followed by targeted interviews, will be used to assess 
the impact and value of AHRQ research products for the target 
audiences, determine how partners are using the products, and identify 
ways to make the products and partnerships more useful for partners and 
have a broader reach.
    (7) CME Outcomes Survey. AHRQ through the Eisenberg Center will 
offer AMA PRA Category 1 CME credit for certain products that it 
develops. Clinicians wishing to claim credit must complete an outcome 
assessment survey delivered online two months after completing the 
activity.
    (8) Interviews and Surveys for Dissemination Research Project. Each 
project year the Eisenberg Center will propose and conduct a unique 
research project aimed at disseminating products. As part of that 
project, formative interviews and potentially

[[Page 33677]]

cognitive testing will be conducted with consumers, clinicians, and 
administrators from participating health systems, hospitals, and/or 
clinics for purposes of assessing current dissemination initiatives, 
similar products available to their consumers, ways to optimize 
dissemination, and other indicators as determined by the project aims. 
These three audiences may also be asked to complete follow-up surveys 
and/or participate in interviews to document project outcomes and 
lessons learned from the study.
    The information will be used to develop, improve and/or maintain 
high quality health care informational products and services for the 
lay public and health care professionals. Each product previously 
developed by the Eisenberg Center was proposed, drafted, tested, and 
revised with heavy reliance on data collected in a manner similar to 
those approaches described in this clearance. This includes data 
collected at the formative stage when ideas for the product and its 
information parameters are being developed, through draft testing and 
revisions, and finally product implementation and evaluation of its 
usefulness in practice. Work on implementing and evaluating 
dissemination strategies and approaches will complement the development 
activities in optimizing delivery to the targeted audiences.

Estimated Annual Respondent Burden

    Exhibit 1 shows the estimated total burden for the respondents' 
time to participate in this research. These estimates assume a maximum 
of 141 Summary products over 3 years with separate products developed 
for clinicians, policymakers, and consumers.
    Formative interviews, and in some cases focus groups, will be used 
to conduct needs assessment and will be held with clinicians and 
consumers for development of the products and decision aids, and 
additionally with policymakers for those products in which policy 
recommendations are applicable. Interviews will be conducted with no 
more than 2,115 persons for product development, 180 persons for 
decision aid development, and 180 persons for development of 
dissemination initiatives over 3 years, and each will last about 60 
minutes.
    Once the products are developed they will be subjected to in-person 
or telephone interviews for purposes of usability and product testing 
with clinicians, policymakers and consumers. In-person/telephone 
interviews will be conducted with about 2,115 persons for products and 
180 persons for decision aids over 3 years and will take about 60 
minutes on average. A second round of interviews will be conducted only 
occasionally with one or more of the targeted populations if necessary 
due to substantial product revisions. These interviews may also be used 
to inform product enhancements in relation to the annual enhancement 
study. Because these specifications cannot be determined in advance, 
clearance is being requested for two testing rounds with every product 
and every audience.
    Evaluation surveys will be conducted with approximately 6,000 
representatives across the targeted audiences (i.e., consumer, 
clinician, policymaker) for the health information products and 2,400 
persons who have used the decision aids over the 3-year period. The 
product surveys will take about 5 minutes to complete, and the decision 
aid surveys about 10 minutes. A follow-up survey will be completed for 
the product evaluations, which will also last about 5 minutes, while a 
subset of 180 of those having used the decision aids will be asked to 
participate in a follow-up evaluation interview lasting an hour.
    Those involved in or targeted by the dissemination initiatives will 
be asked to participate in evaluation interviews, which will include up 
to 480 persons completing interviews across the 3 project years. Note: 
Because the timing of interviews with persons at the 6 total partner 
organizations has not yet been finalized, AHRQ is requesting that all 
dissemination-related interviews be approved for the first project 
year. For simplicity, the interviews are presented as annualized in 
Exhibits 1 and 2.
    The unique dissemination research project to be proposed and 
completed annually will include 135 formative interviews with 
consumers, clinicians, and administrators, with each lasting 1 hour. 
Follow-up evaluation surveys and interviews will be conducted with 360 
and 180 persons, respectively.
    AHRQ partners will be asked to complete surveys and interviews in 
relation to their prior or ongoing collaborative work with AHRQ. These 
will include 150 people completing surveys and 60 follow-up interviews. 
Similar types of surveys designed with the goal of improving products 
and expanding their research will be completed by 90 representatives of 
advocacy organizations across the 3 years, with each survey lasting 
about 10 minutes.
    Clinicians that have completed CME accrediting requirements and are 
requesting CME credit will be asked to complete a follow-up outcomes 
survey two months following completion of the online activity. These 
will be completed by no more than 27,000 clinicians over 3 years and 
will require 5 minutes to complete.
    The total burden hours are estimated to be 13,875 annually or 
41,625 over 3 years. The total annual cost burden is $237,604.

                                  Exhibit 1--Estimated Annualized Burden Hours
----------------------------------------------------------------------------------------------------------------
                                                                     Number of
                    Form name                        Number of     responses per     Hours per     Total burden
                                                    respondents     respondent       response          hours
----------------------------------------------------------------------------------------------------------------
Product Formative Interviews....................             705               1               1             705
Product Pretesting Interviews...................             705               2               1           1,410
Product Evaluation Surveys......................           2,000               2            5/60             333
Dissemination Formative Interviews..............              40               1               1              40
Dissemination Evaluation Interviews.............             120               1               1             120
Decision Aid Formative Interviews...............              60               1               1              60
Decision Aid Pretesting Interviews..............              60               1               1              60
Decision Aid Evaluation Interviews..............              60               1               1              60
Decision Aid Evaluation Surveys.................             800               1           10/60             133
Research Project Formative Interviews...........              45               1               1              45
Research Project Evaluation Surveys.............             120               1           10/60              20
Research Project Evaluation Interviews..........              60               1               1              60
Partnership Evaluation Surveys..................              50               1           10/60               8
Partnership Evaluation Interviews...............              20               1               1              20

[[Page 33678]]

 
Advocacy Meeting Evaluation Surveys.............              30               1           10/60               5
CME Outcomes Surveys............................           9,000               1            5/60             750
                                                 ---------------------------------------------------------------
    Total.......................................          13,875              na              na           3,830
----------------------------------------------------------------------------------------------------------------
* For the 3-year contract period, product formative interviews and product testing interviews will each comprise
  300 consumers, 300 clinicians, and 105 policymakers; product evaluation surveys will include 800 consumers,
  800 clinicians, and 400 policymakers; dissemination-related formative interviews will include 40 health system/
  hospital/clinic administrators; dissemination-related evaluation interviews will include 40 consumers, 40
  clinicians, and 40 administrators; formative interviews, pretesting interviews, and evaluation interviews for
  the decision aids will each include 30 consumers and 30 clinicians; evaluation surveys for the decision aids
  will include 400 consumers and 400 clinicians; formative interviews for the annual dissemination research
  project will include 15 consumers, 15 clinicians, and 15 administrators; evaluation surveys for the research
  project will include 50 consumers, 50 clinicians, and 20 administrators; evaluation interviews for the
  research project will include 20 consumers, 20 clinicians, and 20 administrators; the AHRQ partner surveys
  will include 50 partners; the AHRQ partner evaluation interviews will include 20 partners; the health
  advocates surveys will include 30 participants; and CME outcomes surveys will include 500 clinicians for each
  of 18 CME activities.


                                   Exhibit 2--Estimated Annualized Cost Burden
----------------------------------------------------------------------------------------------------------------
                                                     Number of     Total burden   Average hourly    Total cost
                    Form name                       respondents        hours        wage rate *       burden
----------------------------------------------------------------------------------------------------------------
Product Formative Interviews....................             705             705      \a\ $54.81         $38,641
Product Pretesting Interviews...................             705           1,410       \a\ 54.81          77,282
Product Evaluation Surveys......................           2,000             333       \a\ 54.00          17,982
Dissemination Formative Interviews..............              40              40       \a\ 49.84           1,994
Dissemination Evaluation Interviews.............             120             120       \a\ 54.74           6,568
Decision Aid Formative Interviews...............              60              60       \a\ 57.19           3,431
Decision Aid Pretesting Interviews..............              60              60       \a\ 57.19           3,431
Decision Aid Evaluation Interviews..............              60              60       \a\ 57.19           3,431
Decision Aid Evaluation Surveys.................             800             133       \a\ 57.19           7,606
Research Project Formative Interviews...........              45              45       \b\ 54.74           2,463
Research Project Evaluation Surveys.............             120              20       \b\ 55.96           1,119
Research Project Evaluation Interviews..........              60              60       \b\ 54.74           3,284
AHRQ Partner Evaluation Surveys.................              50               8       \c\ 54.50             436
AHRQ Partner Evaluation Interviews..............              20              20       \c\ 54.50           1,090
Advocacy Meeting Evaluation Surveys.............              30               5       \d\ 21.21             106
CME Outcomes Surveys............................           9,000             750       \e\ 91.66          68,745
                                                 ---------------------------------------------------------------
    Total.......................................          13,875           3,830              na         237,604
----------------------------------------------------------------------------------------------------------------
* National Compensation Survey: Occupational wages in the United States May 2014, ``U.S. Department of Labor,
  Bureau of Labor Statistics.''
\a\ Based on the mean and/or weighted mean wages for various combinations of consumers (00-0000 all
  occupations), clinicians (29-1060 physicians and surgeons, 29-1062 family and general practitioners), and
  health policymakers (11-0000 management occupations, 11-3111 compensation & benefits managers, 13-1141
  compensation, benefits & job analysis specialists, 11-9111 medical and health service managers, 13-2053
  insurance underwriters and 15-2011 actuaries).
\b\ Based on the mean and/or weighted mean wages for various combinations of consumers (00-0000 all
  occupations), clinicians (29-1060 physicians and surgeons, 29-1062 family and general practitioners), and
  health system/hospital/clinic administrators (11-9111 medical and health services managers).
\c\ Based on the mean wages for AHRQ partners (25-1071 health specialties teachers, postsecondary, 11-1021
  general and operations managers, 21-0091 health educators, 21-1093 social and human service assistants, 11-
  9111 medical and health services managers).
\d\ Based on the mean wages for health advocacy organizations (21-1093 social and human service assistants
  [social advocacy organizations], 21-0091 health educators).
\e\ Based on the mean wages for clinicians (29-1060 physicians and surgeons, 29-1062 family and general
  practitioners).

    Exhibit 2 depicts the estimated total cost burden associated with 
the respondents' time to participate in this research. The cost burden 
is estimated to be $237,604 annually.

Request for Comments

    In accordance with the Paperwork Reduction Act, comments on AHRQ's 
information collection are requested with regard to any of the 
following: (a) Whether the proposed collection of information is 
necessary for the proper performance of AHRQ health care research and 
health care information dissemination functions, including whether the 
information will have practical utility; (b) the accuracy of AHRQ's 
estimate of burden (including hours and costs) of the proposed 
collection(s) of information; (c) ways to enhance the quality, utility, 
and clarity of the information to be collected; and (d) ways to 
minimize the burden of the collection of information upon the 
respondents, including the use of automated collection techniques or 
other forms of information technology.
    Comments submitted in response to this notice will be summarized 
and included in the Agency's subsequent request for OMB approval of the 
proposed information collection. All comments will become a matter of 
public record.

Sharon B. Arnold,
Deputy Director.
[FR Doc. 2016-12532 Filed 5-26-16; 8:45 am]
BILLING CODE 4160-90-P



                                                                                Federal Register / Vol. 81, No. 103 / Friday, May 27, 2016 / Notices                                            33675

                                                check www.regulations.gov,                              information on those who are to                       Proposed Project
                                                approximately two to three days after                   respond, through the use of appropriate
                                                                                                                                                              Eisenberg Center Voluntary Customer
                                                submission to verify posting (except                    technological collection techniques or
                                                                                                                                                              Survey Generic Clearance
                                                allow 30 days for posting of comments                   other forms of information technology.
                                                submitted by mail).                                        Obtaining Copies of Proposals:                        The Agency for Healthcare Research
                                                FOR FURTHER INFORMATION CONTACT: Mr.                    Requesters may obtain a copy of the                   and Quality (AHRQ) requests that the
                                                Michael O. Jackson, Procurement                         information collection documents from                 Office of Management and Budget
                                                Analyst, Office of Acquisition Policy, at               the General Services Administration,                  (OMB) renew under the Paperwork
                                                telephone 202–208–4949 or via email to                  Regulatory Secretariat Division (MVCB),               Reduction Act of 1995 AHRQ’s Generic
                                                michaelo.jackson@gsa.gov.                               1800 F Street NW., Washington, DC                     Clearance to collect information from
                                                                                                        20405, telephone 202–501–4755. Please                 users of work products and services
                                                SUPPLEMENTARY INFORMATION:
                                                                                                        cite OMB Control No. 9000–0173,                       produced by AHRQ’s John M. Eisenberg
                                                A. Purpose                                              Limitations on Pass-Through Charges, in               Center for Clinical Decisions and
                                                  To enable contracting officers to                     all correspondence.                                   Communications Science (Eisenberg
                                                verify that pass-through charges are not                                                                      Center). The Eisenberg Center is an
                                                                                                          Dated: May 23, 2016.                                innovative effort aimed at improving
                                                excessive, the provision at 52.215–22
                                                                                                        Lorin S. Curit,                                       communication of findings to a variety
                                                requires offerors submitting a proposal
                                                for a contract, task order, or delivery                 Director, Federal Acquisition Policy Division,        of audiences (‘‘customers’’), including
                                                                                                        Office of Governmentwide Acquisition Policy,          consumers, clinicians, and health care
                                                order to provide the following                          Office of Acquisition Policy, Office of
                                                information with its proposal: (1) The                                                                        policymakers. The Eisenberg Center
                                                                                                        Governmentwide Policy.                                compiles research results into a variety
                                                percent of effort the offeror intends to                [FR Doc. 2016–12554 Filed 5–26–16; 8:45 am]
                                                perform and the percent expected to be                                                                        of useful formats for stakeholders.
                                                                                                        BILLING CODE 6820–EP–P                                   This effort has the following goals:
                                                performed by each subcontractor. (2) If
                                                                                                                                                                 (1) Conduct research into effective
                                                the offeror intends to subcontract more
                                                                                                                                                              communication of research findings in
                                                than 70 percent of the total cost of work
                                                                                                                                                              order to improve the usability and rapid
                                                to be performed—(i) The amount of the                   DEPARTMENT OF HEALTH AND                              incorporation of findings into medical
                                                offeror’s indirect costs and profit/fee                 HUMAN SERVICES                                        practice and decision making.
                                                applicable to the work to be performed                                                                           (2) Conduct research into effective
                                                by the subcontractor(s); and (ii) A                     Agency for Healthcare Research and                    strategies for disseminating evidence-
                                                description of the value added by the                   Quality                                               based products, tools, and resources to
                                                offeror as related to the work to be                                                                          consumers, clinicians, and other health
                                                performed by the subcontractor(s). (3) If               Agency Information Collection                         care professionals, and policymakers.
                                                any subcontractor intends to                            Activities: Proposed Collection;                         (3) Evaluate outcomes reported by
                                                subcontract to a lower-tier subcontractor               Comment Request                                       clinicians and other health care
                                                more than 70 percent of the total cost of                                                                     professionals resulting from
                                                work to be performed under its                          AGENCY: Agency for Healthcare Research
                                                                                                        and Quality, HHS.                                     participation in continuing medical
                                                subcontract—(i) The amount of the                                                                             education (CME) initiatives and
                                                subcontractor’s indirect costs and profit/              ACTION: Notice.                                       activities.
                                                fee applicable to the work to be                                                                                 (4) Conduct research into factors
                                                performed by the lower-tier                             SUMMARY:   This notice announces the                  associated with successful collaboration
                                                subcontractor(s); and (ii) A description                intention of the Agency for Healthcare                between AHRQ and partnering
                                                of the value added by the subcontractor                 Research and Quality (AHRQ) to request                institutions and organizations in
                                                as related to the work to be performed                  that the Office of Management and                     synthesizing, translating, and
                                                by the lower-tier subcontractor(s).                     Budget (OMB) approve the proposed                     disseminating evidence-based research.
                                                                                                        information collection project:                          Clearance is being requested to cover
                                                B. Annual Reporting Burden                              ‘‘Eisenberg Center Voluntary Customer                 a three-year period in which differing
                                                  Respondents: 4,638.                                   Survey Generic Clearance.’’ In                        numbers of products and research
                                                  Responses per Respondent: 8.7.                        accordance with the Paperwork                         activities may be conducted during each
                                                  Total Responses: 40,347.                              Reduction Act, 44 U.S.C. 3501–3521,
                                                  Hours per Response: 2.                                                                                      year. The collections proposed include
                                                                                                        AHRQ invites the public to comment on                 activities to assist in the development of
                                                  Total Burden Hours: 80,694.                           this proposed information collection.
                                                  Frequency of Collection: On Occasion.                                                                       materials to be disseminated through
                                                  Affected Public: Businesses or other                  DATES: Comments on this notice must be                the Eisenberg Center and to provide
                                                for-profit and not-for-profit institutions.             received by July 26, 2016.                            feedback to AHRQ on the extent to
                                                                                                        ADDRESSES: Written comments should                    which these products meet customer
                                                C. Public Comments                                                                                            needs. These materials include
                                                                                                        be submitted to: Doris Lefkowitz,
                                                  Public comments are particularly                      Reports Clearance Officer, AHRQ, by                   summary documents that summarize
                                                invited on: Whether this collection of                  email at doris.lefkowitz@AHRQ.hhs.gov.                and translate the findings of research
                                                information is necessary for the proper                    Copies of the proposed collection                  reports for various decision-making
                                                performance of functions of the FAR,                    plans, data collection instruments, and               audiences, such as consumers,
                                                and whether it will have practical                      specific details on the estimated burden              clinicians, and policymakers. The
                                                utility; whether our estimate of the                                                                          summaries are designed to help these
sradovich on DSK3TPTVN1PROD with NOTICES




                                                                                                        can be obtained from the AHRQ Reports
                                                public burden of this collection of                     Clearance Officer.                                    decision makers use research evidence
                                                information is accurate, and based on                                                                         to maximize the benefits of health care,
                                                valid assumptions and methodology;                      FOR FURTHER INFORMATION CONTACT:                      minimize harm, and optimize the use of
                                                ways to enhance the quality, utility, and               Doris Lefkowitz, AHRQ Reports                         health care resources. In addition, each
                                                clarity of the information to be                        Clearance Officer, (301) 427–1477, or by              year, a unique research project will be
                                                collected; and ways in which we can                     email at doris.lefkowitz@AHRQ.hhs.gov.                undertaken to study successful
                                                minimize the burden of the collection of                SUPPLEMENTARY INFORMATION:                            approaches to disseminating AHRQ


                                           VerDate Sep<11>2014   18:00 May 26, 2016   Jkt 238001   PO 00000   Frm 00022   Fmt 4703   Sfmt 4703   E:\FR\FM\27MYN1.SGM   27MYN1


                                                33676                           Federal Register / Vol. 81, No. 103 / Friday, May 27, 2016 / Notices

                                                products in various health care settings                effectively through products that are                 summaries. Immediately upon accessing
                                                and clinical environments. Also, each                   developed and disseminated through                    the summaries, visitors will be asked to
                                                year, the Eisenberg Center will develop                 the Eisenberg Center; (3) assessing                   complete a brief survey assessing for
                                                one interactive decision aid for clinical               whether changes in topical knowledge                  whom they were seeking information,
                                                problems identified from selected                       levels can be identified following                    how the product might be used, and an
                                                research reports. The intent is for the                 exposure to Eisenberg Center                          email address for a follow-up survey.
                                                decision aid to increase the decision                   informational or instructional products               Respondents will subsequently be sent
                                                maker’s knowledge of the health                         or aids; (4) identifying product strengths            an email asking them to complete a
                                                condition, options, and risk/benefits;                  and weaknesses to facilitate                          follow-up online survey assessing how
                                                lead to greater assurance in making a                   improvements that are practical and                   the information has been used, whether
                                                decision; increase the congruence                       feasible; and (5) assessing decision                  it influenced health care practices, and
                                                between values and choices; and                         support from the perspective of each                  any barriers to use or suggestions for
                                                enhance involvement in the decision                     audience. In addition, the Eisenberg                  improvement.
                                                making process. Information collections                 Center will conduct a new research                       (5) Survey of Patient and Consumer
                                                conducted under this generic clearance                  project annually to inform the                        Advocacy Organizations. Each project
                                                are not required by regulation and will                 enhancement of existing health                        year, representatives from consumer and
                                                not be used to regulate or sanction                     information products, beyond what is                  patient advocacy organizations will be
                                                customers. Data collections will be                     currently being provided. The                         invited to attend a meeting and
                                                entirely voluntary, and information                     accompanying assessments will likely                  participate in ongoing activities to
                                                provided by respondents will be                         consist of interviews conducted with                  facilitate engagement in AHRQ
                                                combined and summarized so that no                      target audience members and may be                    systematic review, translation, and
                                                individually identifiable information                   integrated into the existing product                  dissemination activities. Surveys by
                                                will be released.                                       interviews discussed above.                           phone or online questionnaire will be
                                                  This study is being conducted by                         (2) Interviews for Dissemination                   used to assess the quality of the in-
                                                AHRQ through its contractor, Baylor                     Activities. Interviews will be conducted              person meeting and ongoing activities,
                                                College of Medicine, pursuant to                        with leadership and staff of health                   the impact and value of engaging with
                                                AHRQ’s statutory authority to conduct                   systems, hospitals, and/or clinics in                 AHRQ, the value of research and
                                                and support research on health care and                 which dissemination activities are                    translation products for the target
                                                on systems for the delivery of such care,               conducted to explore, prior to initiating             audiences, how partners and their
                                                including activities with respect to the                the project, those pathways holding the               constituents are using the products, and
                                                quality, effectiveness, efficiency,                     greatest potential for successful uptake              ways to make the products and
                                                appropriateness and value of health care                of the AHRQ materials. Interviews will                partnerships with AHRQ more useful
                                                services and with respect to quality                    be conducted again after project                      for partners and have a broader reach.
                                                measurement and improvement. 42                         conclusion with administrators and                       (6) Survey of AHRQ Partners. AHRQ,
                                                U.S.C. 299a(a)(1) and (2).                              product users (e.g., consumers,                       through the Evidence-based Practice
                                                                                                        clinicians) to assess success of                      Center (EPC) Program and Eisenberg
                                                Method of Collection                                                                                          Center, works in partnership with
                                                                                                        dissemination efforts, perceptions
                                                   The data collections listed below will               around product access, challenges that                organizations when developing,
                                                be implemented to achieve project                       arose, and strategies to facilitate future            translating, and/or disseminating
                                                goals. Note: Assessments such as                        successful dissemination initiatives.                 research reports and related products.
                                                interviews and surveys are here denoted                    (3) Survey for Decision Aids.                      AHRQ’s partners include developers of
                                                formative if conducted prior to product                 Following delivery of the decision aid,               clinical practice guidelines, payers,
                                                development or determination of                         a user survey will be completed to                    other Government agencies, private
                                                dissemination channels; usability                       explore subjects’ impressions of the                  companies, consumer and patient
                                                testing or pretesting if conducted while                tool, including ease of use, clarity of               advocacy groups, and health care
                                                reviewing a draft product, proposed                     presentation, length, balance of                      systems. Surveys by phone or online
                                                dissemination approach, or other                        information, rating of interactive                    questionnaire, followed by targeted
                                                proposed content/strategy; and                          features, and overall satisfaction. Both              interviews, will be used to assess the
                                                evaluation if conducted for summative                   clinicians and patients/consumers will                impact and value of AHRQ research
                                                evaluation or to assess satisfaction after              be surveyed. For patients, the customer               products for the target audiences,
                                                the product has been in use or the                      satisfaction survey may include                       determine how partners are using the
                                                dissemination campaign, learning                        decisional outcome measures (e.g.,                    products, and identify ways to make the
                                                activity, or other initiative undertaken.               decisional conflict, desire for                       products and partnerships more useful
                                                   Data collections will include the                    involvement in decision-making),                      for partners and have a broader reach.
                                                following:                                              measures of attitudes and self-efficacy,                 (7) CME Outcomes Survey. AHRQ
                                                   (1) Interviews for Product and                       and indicators of choice intention or                 through the Eisenberg Center will offer
                                                Decision Aid Development, Testing, and                  actual choice made. If the aid is                     AMA PRA Category 1 CME credit for
                                                Use. Individual interviews will be                      evaluated within a clinical context,                  certain products that it develops.
                                                conducted with clinical professionals,                  measures of physician-patient                         Clinicians wishing to claim credit must
                                                patients, or other health care consumers,               interaction will also be considered.                  complete an outcome assessment survey
                                                or health policymakers. In some cases                   Additionally, clinicians may be                       delivered online two months after
                                                focus groups may be substituted for                     interviewed about the impact of the aid               completing the activity.
sradovich on DSK3TPTVN1PROD with NOTICES




                                                patient interviews. These formative and                 on decision making, clinical flow, and                   (8) Interviews and Surveys for
                                                pretesting/cognitive interviews will                    patient outcomes.                                     Dissemination Research Project. Each
                                                allow for (1) collecting input from target                 (4) Survey for Summary Products                    project year the Eisenberg Center will
                                                audiences regarding the development of                  (initial, follow up). Very brief surveys              propose and conduct a unique research
                                                summary products and decision aids;                     will be offered to health care                        project aimed at disseminating
                                                (2) determining if intended information                 professionals, consumers, and                         products. As part of that project,
                                                and messages are being delivered                        policymakers that use the online                      formative interviews and potentially


                                           VerDate Sep<11>2014   18:00 May 26, 2016   Jkt 238001   PO 00000   Frm 00023   Fmt 4703   Sfmt 4703   E:\FR\FM\27MYN1.SGM   27MYN1


                                                                                       Federal Register / Vol. 81, No. 103 / Friday, May 27, 2016 / Notices                                                     33677

                                                cognitive testing will be conducted with                           held with clinicians and consumers for                     follow-up evaluation interview lasting
                                                consumers, clinicians, and                                         development of the products and                            an hour.
                                                administrators from participating health                           decision aids, and additionally with                          Those involved in or targeted by the
                                                systems, hospitals, and/or clinics for                             policymakers for those products in                         dissemination initiatives will be asked
                                                purposes of assessing current                                      which policy recommendations are                           to participate in evaluation interviews,
                                                dissemination initiatives, similar                                 applicable. Interviews will be                             which will include up to 480 persons
                                                products available to their consumers,                             conducted with no more than 2,115                          completing interviews across the 3
                                                ways to optimize dissemination, and                                persons for product development, 180                       project years. Note: Because the timing
                                                other indicators as determined by the                              persons for decision aid development,                      of interviews with persons at the 6 total
                                                project aims. These three audiences may                            and 180 persons for development of                         partner organizations has not yet been
                                                also be asked to complete follow-up                                dissemination initiatives over 3 years,                    finalized, AHRQ is requesting that all
                                                surveys and/or participate in interviews                           and each will last about 60 minutes.                       dissemination-related interviews be
                                                to document project outcomes and                                      Once the products are developed they                    approved for the first project year. For
                                                lessons learned from the study.                                    will be subjected to in-person or                          simplicity, the interviews are presented
                                                   The information will be used to                                 telephone interviews for purposes of                       as annualized in Exhibits 1 and 2.
                                                develop, improve and/or maintain high                              usability and product testing with                            The unique dissemination research
                                                quality health care informational                                  clinicians, policymakers and                               project to be proposed and completed
                                                products and services for the lay public                           consumers. In-person/telephone                             annually will include 135 formative
                                                and health care professionals. Each                                interviews will be conducted with about                    interviews with consumers, clinicians,
                                                product previously developed by the                                2,115 persons for products and 180                         and administrators, with each lasting 1
                                                Eisenberg Center was proposed, drafted,                            persons for decision aids over 3 years                     hour. Follow-up evaluation surveys and
                                                tested, and revised with heavy reliance                            and will take about 60 minutes on                          interviews will be conducted with 360
                                                on data collected in a manner similar to                           average. A second round of interviews                      and 180 persons, respectively.
                                                those approaches described in this                                 will be conducted only occasionally                           AHRQ partners will be asked to
                                                clearance. This includes data collected                            with one or more of the targeted                           complete surveys and interviews in
                                                at the formative stage when ideas for the                          populations if necessary due to                            relation to their prior or ongoing
                                                product and its information parameters                             substantial product revisions. These                       collaborative work with AHRQ. These
                                                are being developed, through draft                                 interviews may also be used to inform                      will include 150 people completing
                                                testing and revisions, and finally                                 product enhancements in relation to the                    surveys and 60 follow-up interviews.
                                                product implementation and evaluation                              annual enhancement study. Because                          Similar types of surveys designed with
                                                of its usefulness in practice. Work on                             these specifications cannot be                             the goal of improving products and
                                                implementing and evaluating                                        determined in advance, clearance is                        expanding their research will be
                                                dissemination strategies and approaches                            being requested for two testing rounds                     completed by 90 representatives of
                                                will complement the development                                    with every product and every audience.                     advocacy organizations across the 3
                                                activities in optimizing delivery to the                              Evaluation surveys will be conducted                    years, with each survey lasting about 10
                                                targeted audiences.                                                with approximately 6,000                                   minutes.
                                                                                                                   representatives across the targeted                           Clinicians that have completed CME
                                                Estimated Annual Respondent Burden
                                                                                                                   audiences (i.e., consumer, clinician,                      accrediting requirements and are
                                                   Exhibit 1 shows the estimated total                             policymaker) for the health information                    requesting CME credit will be asked to
                                                burden for the respondents’ time to                                products and 2,400 persons who have                        complete a follow-up outcomes survey
                                                participate in this research. These                                used the decision aids over the 3-year                     two months following completion of the
                                                estimates assume a maximum of 141                                  period. The product surveys will take                      online activity. These will be completed
                                                Summary products over 3 years with                                 about 5 minutes to complete, and the                       by no more than 27,000 clinicians over
                                                separate products developed for                                    decision aid surveys about 10 minutes.                     3 years and will require 5 minutes to
                                                clinicians, policymakers, and                                      A follow-up survey will be completed                       complete.
                                                consumers.                                                         for the product evaluations, which will                       The total burden hours are estimated
                                                   Formative interviews, and in some                               also last about 5 minutes, while a subset                  to be 13,875 annually or 41,625 over 3
                                                cases focus groups, will be used to                                of 180 of those having used the decision                   years. The total annual cost burden is
                                                conduct needs assessment and will be                               aids will be asked to participate in a                     $237,604.

                                                                                                        EXHIBIT 1—ESTIMATED ANNUALIZED BURDEN HOURS
                                                                                                                                                                             Number of                         Total
                                                                                                                                                            Number of                           Hours per
                                                                                            Form name                                                                      responses per                      burden
                                                                                                                                                           respondents                          response
                                                                                                                                                                             respondent                        hours

                                                Product Formative Interviews ..........................................................................              705                 1                1         705
                                                Product Pretesting Interviews ..........................................................................             705                 2                1       1,410
                                                Product Evaluation Surveys ............................................................................            2,000                 2             5/60         333
                                                Dissemination Formative Interviews ................................................................                   40                 1                1          40
                                                Dissemination Evaluation Interviews ...............................................................                  120                 1                1         120
                                                Decision Aid Formative Interviews ..................................................................                  60                 1                1          60
sradovich on DSK3TPTVN1PROD with NOTICES




                                                Decision Aid Pretesting Interviews ..................................................................                 60                 1                1          60
                                                Decision Aid Evaluation Interviews ..................................................................                 60                 1                1          60
                                                Decision Aid Evaluation Surveys .....................................................................                800                 1            10/60         133
                                                Research Project Formative Interviews ...........................................................                     45                 1                1          45
                                                Research Project Evaluation Surveys .............................................................                    120                 1            10/60          20
                                                Research Project Evaluation Interviews ..........................................................                     60                 1                1          60
                                                Partnership Evaluation Surveys ......................................................................                 50                 1            10/60           8
                                                Partnership Evaluation Interviews ...................................................................                 20                 1                1          20



                                           VerDate Sep<11>2014      18:00 May 26, 2016       Jkt 238001     PO 00000      Frm 00024     Fmt 4703     Sfmt 4703   E:\FR\FM\27MYN1.SGM   27MYN1


                                                33678                                       Federal Register / Vol. 81, No. 103 / Friday, May 27, 2016 / Notices

                                                                                                   EXHIBIT 1—ESTIMATED ANNUALIZED BURDEN HOURS—Continued
                                                                                                                                                                                           Number of                               Total
                                                                                                                                                                          Number of                             Hours per
                                                                                                 Form name                                                                               responses per                            burden
                                                                                                                                                                         respondents                            response
                                                                                                                                                                                           respondent                              hours

                                                Advocacy Meeting Evaluation Surveys ...........................................................                                     30                  1             10/60                  5
                                                CME Outcomes Surveys .................................................................................                           9,000                  1              5/60                750

                                                      Total ..........................................................................................................          13,875                 na                   na            3,830
                                                   * For the 3-year contract period, product formative interviews and product testing interviews will each comprise 300 consumers, 300 clinicians,
                                                and 105 policymakers; product evaluation surveys will include 800 consumers, 800 clinicians, and 400 policymakers; dissemination-related form-
                                                ative interviews will include 40 health system/hospital/clinic administrators; dissemination-related evaluation interviews will include 40 consumers,
                                                40 clinicians, and 40 administrators; formative interviews, pretesting interviews, and evaluation interviews for the decision aids will each include
                                                30 consumers and 30 clinicians; evaluation surveys for the decision aids will include 400 consumers and 400 clinicians; formative interviews for
                                                the annual dissemination research project will include 15 consumers, 15 clinicians, and 15 administrators; evaluation surveys for the research
                                                project will include 50 consumers, 50 clinicians, and 20 administrators; evaluation interviews for the research project will include 20 consumers,
                                                20 clinicians, and 20 administrators; the AHRQ partner surveys will include 50 partners; the AHRQ partner evaluation interviews will include 20
                                                partners; the health advocates surveys will include 30 participants; and CME outcomes surveys will include 500 clinicians for each of 18 CME
                                                activities.

                                                                                                                EXHIBIT 2—ESTIMATED ANNUALIZED COST BURDEN
                                                                                                                                                                                              Total              Average
                                                                                                                                                                          Number of                                              Total cost
                                                                                                 Form name                                                                                   burden            hourly wage
                                                                                                                                                                         respondents                                              burden
                                                                                                                                                                                              hours               rate *

                                                Product Formative Interviews ..........................................................................                            705                 705         a $54.81          $38,641
                                                Product Pretesting Interviews ..........................................................................                           705               1,410           a 54.81          77,282
                                                Product Evaluation Surveys ............................................................................                          2,000                 333           a 54.00          17,982
                                                Dissemination Formative Interviews ................................................................                                 40                  40           a 49.84           1,994
                                                Dissemination Evaluation Interviews ...............................................................                                120                 120           a 54.74           6,568
                                                Decision Aid Formative Interviews ..................................................................                                60                  60           a 57.19           3,431
                                                Decision Aid Pretesting Interviews ..................................................................                               60                  60           a 57.19           3,431
                                                Decision Aid Evaluation Interviews ..................................................................                               60                  60           a 57.19           3,431
                                                Decision Aid Evaluation Surveys .....................................................................                              800                 133           a 57.19           7,606
                                                Research Project Formative Interviews ...........................................................                                   45                  45           b 54.74           2,463
                                                Research Project Evaluation Surveys .............................................................                                  120                  20           b 55.96           1,119
                                                Research Project Evaluation Interviews ..........................................................                                   60                  60           b 54.74           3,284
                                                AHRQ Partner Evaluation Surveys ..................................................................                                  50                   8           c 54.50             436
                                                AHRQ Partner Evaluation Interviews ..............................................................                                   20                  20           c 54.50           1,090
                                                Advocacy Meeting Evaluation Surveys ...........................................................                                     30                   5           d 21.21             106
                                                CME Outcomes Surveys .................................................................................                           9,000                 750           e 91.66          68,745

                                                      Total ..........................................................................................................          13,875               3,830                  na       237,604
                                                   * National Compensation Survey: Occupational wages in the United States May 2014, ‘‘U.S. Department of Labor, Bureau of Labor Statistics.’’
                                                   a Based on the mean and/or weighted mean wages for various combinations of consumers (00–0000 all occupations), clinicians (29–1060 phy-
                                                sicians and surgeons, 29–1062 family and general practitioners), and health policymakers (11–0000 management occupations, 11–3111 com-
                                                pensation & benefits managers, 13–1141 compensation, benefits & job analysis specialists, 11–9111 medical and health service managers, 13–
                                                2053 insurance underwriters and 15–2011 actuaries).
                                                   b Based on the mean and/or weighted mean wages for various combinations of consumers (00–0000 all occupations), clinicians (29–1060 phy-
                                                sicians and surgeons, 29–1062 family and general practitioners), and health system/hospital/clinic administrators (11–9111 medical and health
                                                services managers).
                                                   c Based on the mean wages for AHRQ partners (25–1071 health specialties teachers, postsecondary, 11–1021 general and operations man-
                                                agers, 21–0091 health educators, 21–1093 social and human service assistants, 11–9111 medical and health services managers).
                                                   d Based on the mean wages for health advocacy organizations (21–1093 social and human service assistants [social advocacy organizations],
                                                21–0091 health educators).
                                                   e Based on the mean wages for clinicians (29–1060 physicians and surgeons, 29–1062 family and general practitioners).




                                                  Exhibit 2 depicts the estimated total                                     dissemination functions, including                              included in the Agency’s subsequent
                                                cost burden associated with the                                             whether the information will have                               request for OMB approval of the
                                                respondents’ time to participate in this                                    practical utility; (b) the accuracy of                          proposed information collection. All
                                                research. The cost burden is estimated                                      AHRQ’s estimate of burden (including                            comments will become a matter of
                                                to be $237,604 annually.                                                    hours and costs) of the proposed                                public record.
                                                                                                                            collection(s) of information; (c) ways to
                                                Request for Comments                                                                                                                        Sharon B. Arnold,
                                                                                                                            enhance the quality, utility, and clarity
                                                  In accordance with the Paperwork                                          of the information to be collected; and                         Deputy Director.
sradovich on DSK3TPTVN1PROD with NOTICES




                                                Reduction Act, comments on AHRQ’s                                           (d) ways to minimize the burden of the                          [FR Doc. 2016–12532 Filed 5–26–16; 8:45 am]
                                                information collection are requested                                        collection of information upon the                              BILLING CODE 4160–90–P
                                                with regard to any of the following: (a)                                    respondents, including the use of
                                                Whether the proposed collection of                                          automated collection techniques or
                                                information is necessary for the proper                                     other forms of information technology.
                                                performance of AHRQ health care                                               Comments submitted in response to
                                                research and health care information                                        this notice will be summarized and


                                           VerDate Sep<11>2014        18:00 May 26, 2016           Jkt 238001      PO 00000        Frm 00025        Fmt 4703       Sfmt 9990   E:\FR\FM\27MYN1.SGM    27MYN1



Document Created: 2018-02-07 15:09:30
Document Modified: 2018-02-07 15:09:30
CategoryRegulatory Information
CollectionFederal Register
sudoc ClassAE 2.7:
GS 4.107:
AE 2.106:
PublisherOffice of the Federal Register, National Archives and Records Administration
SectionNotices
ActionNotice.
DatesComments on this notice must be received by July 26, 2016.
ContactDoris Lefkowitz, AHRQ Reports Clearance Officer, (301) 427-1477, or by email at [email protected]
FR Citation81 FR 33675 

2025 Federal Register | Disclaimer | Privacy Policy
USC | CFR | eCFR