80 FR 13868 - Proposed Data Collection Submitted for Public Comment and Recommendations

DEPARTMENT OF HEALTH AND HUMAN SERVICES
Centers for Disease Control and Prevention

Federal Register Volume 80, Issue 51 (March 17, 2015)

Page Range		13868-13869
FR Document		2015-06050

The Centers for Disease Control and Prevention (CDC), as part of its continuing efforts to reduce public burden and maximize the utility of government information, invites the general public and other Federal agencies to take this opportunity to comment on proposed and/or continuing information collections, as required by the Paperwork Reduction Act of 1995. This notice invites comment on the Questionnaire Design Research Laboratory (QDRL)generic clearance request, which encompasses general questionnaire development and pre-testing activities to be carried out in 2014-2017.

Federal Register, Volume 80 Issue 51 (Tuesday, March 17, 2015)

[Federal Register Volume 80, Number 51 (Tuesday, March 17, 2015)]
[Notices]
[Pages 13868-13869]
From the Federal Register Online  [www.thefederalregister.org]
[FR Doc No: 2015-06050]


-----------------------------------------------------------------------

DEPARTMENT OF HEALTH AND HUMAN SERVICES

Centers for Disease Control and Prevention

[60Day-15-0222; Docket No. CDC-2015-0007]


Proposed Data Collection Submitted for Public Comment and 
Recommendations

AGENCY: Centers for Disease Control and Prevention (CDC), Department of 
Health and Human Services (HHS).

ACTION: Notice with comment period.

-----------------------------------------------------------------------

SUMMARY: The Centers for Disease Control and Prevention (CDC), as part 
of its continuing efforts to reduce public burden and maximize the 
utility of government information, invites the general public and other 
Federal agencies to take this opportunity to comment on proposed and/or 
continuing information collections, as required by the Paperwork 
Reduction Act of 1995. This notice invites comment on the Questionnaire 
Design Research Laboratory (QDRL)generic clearance request, which 
encompasses general questionnaire development and pre-testing 
activities to be carried out in 2014-2017.

DATES: Written comments must be received on or before May 18, 2015.

ADDRESSES: You may submit comments, identified by Docket No. CDC-2015-
0007 by any of the following methods:
     Federal eRulemaking Portal: Regulation.gov. Follow the 
instructions for submitting comments.
     Mail: Leroy A. Richardson, Information Collection Review 
Office, Centers for Disease Control and Prevention, 1600 Clifton Road 
NE., MS-D74, Atlanta, Georgia 30329.
    Instructions: All submissions received must include the agency name 
and Docket Number. All relevant comments received will be posted 
without change to Regulations.gov, including any personal information 
provided. For access to the docket to read background documents or 
comments received, go to Regulations.gov.

    Please note:  All public comment should be submitted through the 
Federal eRulemaking portal (Regulations.gov) or by U.S. mail to the 
address listed above.


FOR FURTHER INFORMATION CONTACT: To request more information on the 
proposed project or to obtain a copy of the information collection plan 
and instruments, contact the Information Collection Review Office, 
Centers for Disease Control and Prevention, 1600 Clifton Road NE., MS-
D74, Atlanta, Georgia 30329; phone: 404-639-7570; Email: [email protected].

SUPPLEMENTARY INFORMATION: Under the Paperwork Reduction Act of 1995 
(PRA) (44 U.S.C. 3501-3520), Federal agencies must obtain approval from 
the Office of Management and Budget (OMB) for each collection of 
information they conduct or sponsor. In addition, the PRA also requires 
Federal agencies to provide a 60-day notice in the Federal Register 
concerning each proposed collection of information, including each new 
proposed collection, each proposed extension of existing collection of 
information, and each reinstatement of previously approved information 
collection before submitting the collection to OMB for approval. To 
comply with this requirement, we are publishing this notice of a 
proposed data collection as described below.
    Comments are invited on: (a) Whether the proposed collection of 
information is necessary for the proper performance of the functions of 
the agency, including whether the information shall have practical 
utility; (b) the accuracy of the agency's estimate of the burden of the 
proposed collection of information; (c) ways to enhance the quality, 
utility, and clarity of the information to be collected; (d) ways to 
minimize the burden of the collection of information on respondents, 
including through the use of automated collection techniques or other 
forms of information technology; and (e) estimates of capital or start-
up costs and costs of operation, maintenance, and purchase of services 
to provide information. Burden means the total time, effort, or 
financial resources expended by persons to generate, maintain, retain, 
disclose or provide information to or for a Federal agency. This 
includes the time needed to review instructions; to develop, acquire, 
install and utilize technology and systems for the purpose of 
collecting, validating and verifying information, processing and 
maintaining information, and disclosing and providing information; to 
train personnel and to be able to respond to a collection of 
information, to search data sources, to complete and review the 
collection of information; and to transmit or otherwise disclose the 
information.

Proposed Project

    Questionnaire Design Research Laboratory (QDRL) (OMB No. 0920-0222, 
expires 6/30/2015)--Revision--National Center for Health Statistics 
(NCHS), Centers for Disease Control and Prevention (CDC).

Background and Brief Description

    Section 306 of the Public Health Service (PHS) Act (42 U.S.C. 
242k), as amended, authorizes that the Secretary of Health and Human 
Services (DHHS), acting through NCHS, shall undertake and support (by 
grant or contract) research, demonstrations, and evaluations respecting 
new or improved methods for obtaining current data to support 
statistical and epidemiological activities for the purpose of improving 
the effectiveness, efficiency, and quality of health services in the 
United States.
    The Questionnaire Design Research Laboratory (QDRL) is the focal 
point within NCHS for questionnaire development, pre-testing, and 
evaluation activities for CDC surveys (such as the NCHS National Health 
Interview Survey, OMB No. 0920-0214) and other federally sponsored 
surveys; however, question development and evaluation activities are 
conducted throughout NCHS. NCHS is requesting 3

[[Page 13869]]

years of OMB Clearance for this generic submission.
    The QDRL and other NCHS programs conduct cognitive interviews, 
focus groups, in-depth or ethnographic interviews, usability tests, 
field tests/pilot interviews, and experimental research in laboratory 
and field settings, both for applied questionnaire development and 
evaluation as well as more basic research on response errors in 
surveys.
    Various techniques to evaluate interviewer administered, self-
administered, telephone, Computer Assisted Personal Interviewing 
(CAPI), Computer Assisted Self-Interviewing (CASI), Audio Computer-
Assisted Self-Interviewing (ACASI), and web-based questionnaires are 
used.
    The most common questionnaire evaluation method is the cognitive 
interview. These evaluations are conducted by the QDRL. The interview 
structure consists of respondents first answering a draft survey 
question and then providing textual information to reveal the processes 
involved in answering the test question. Specifically, cognitive 
interview respondents are asked to describe how and why they answered 
the question as they did. Through the interviewing process, various 
types of question-response problems that would not normally be 
identified in a traditional survey interview, such as interpretive 
errors and recall accuracy, are uncovered. By conducting a comparative 
analysis of cognitive interviews, it is also possible to determine 
whether particular interpretive patterns occur within particular sub-
groups of the population. Interviews are generally conducted in small 
rounds of 20-30 interviews; ideally, the questionnaire is re-worked 
between rounds, and revisions are tested iteratively until interviews 
yield relatively few new insights.
    Cognitive interviewing is inexpensive and provides useful data on 
questionnaire performance while minimizing respondent burden. Cognitive 
interviewing offers a detailed depiction of meanings and processes used 
by respondents to answer questions--processes that ultimately produce 
the survey data. As such, the method offers an insight that can 
transform understanding of question validity and response error. 
Documented findings from these studies represent tangible evidence of 
how the question performs. Such documentation also serves CDC data 
users, allowing them to be critical users in their approach and 
application of the data.
    In addition to cognitive interviewing, a number of other 
qualitative and quantitative methods are used to investigate and 
research survey response errors and the survey response process. These 
methods include conducting focus groups, usability tests, in-depth or 
ethnographic interviews, and the administration and analysis of 
questions in both representative and non-representative field tests. 
Focus groups are conducted by the QDRL. They are group interviews whose 
primary purpose is to elicit the basic sociocultural understandings and 
terminology that form the basis of questionnaire design. Each group 
typically consists of one moderator and 4 to 10 participants, depending 
on the research question. In-depth or ethnographic interviews are one-
on-one interviews designed to elicit the understandings or terminology 
that are necessary for question design, as well as to gather detailed 
information that can contribute to the analysis of both qualitative and 
quantitative data. Usability tests are typically one-on-one interviews 
that are used to determine how a given survey or information collection 
tool functions in the field, and how the mode and layout of the 
instrument itself may contribute to survey response error and the 
survey response process.
    In addition to these qualitative methods, NCHS also uses various 
tools to obtain quantitative data, which can be analyzed alone or 
analyzed alongside qualitative data to give a much fuller accounting of 
the survey response process. For instance, phone, internet, mail, and 
in-person follow-up interviews of previous NCHS survey respondents may 
be used to test the validity of survey questions and questionnaires and 
to obtain more detailed information that cannot be gathered on the 
original survey. Additionally, field or pilot tests may be conducted on 
both representative and non-representative samples, including those 
obtained from commercial survey and web panel vendors. Beyond looking 
at traditional measures of survey errors (such as missing rates, item 
non-response, and don't know rates), these pilot tests can be used to 
run experimental designs in order to capture how different questions 
function in a field setting.
    Similar methodology has been adopted by other federal agencies, as 
well as by academic and commercial survey organizations. There are no 
costs to respondents other than their time. The total estimated annual 
burden hours are 13,150.

                                        Estimated Annualized Burden Hours
----------------------------------------------------------------------------------------------------------------
                                                                                      Average
                                                     Number of       Number of      burden per     Total burden
      Type of respondent            Form name       respondents    responses per   response  (in       hours
                                                                    respondent        hours)
----------------------------------------------------------------------------------------------------------------
Individuals or households.....  Eligibility               12,000               1            5/60           1,000
                                 Screening.
Individuals or households.....  Questionnaire             11,700               1               1          11,700
                                 Development
                                 Studies.
Individuals or households.....  Focus groups....             300               1           90/60             450
                                                 ---------------------------------------------------------------
    Total.....................  ................  ..............  ..............  ..............          13,150
----------------------------------------------------------------------------------------------------------------


Leroy A. Richardson,
Chief, Information Collection Review Office, Office of Scientific 
Integrity, Office of the Associate Director for Science, Office of the 
Director, Centers for Disease Control and Prevention.
[FR Doc. 2015-06050 Filed 3-16-15; 8:45 am]
 BILLING CODE 4163-18-P

Federal Register / Vol. 80, No. 51 / Tuesday, March 17, 2015 / Notices 13869

years of OMB Clearance for this generic ideally, the questionnaire is re-worked necessary for question design, as well as
submission. between rounds, and revisions are to gather detailed information that can
The QDRL and other NCHS programs tested iteratively until interviews yield contribute to the analysis of both
conduct cognitive interviews, focus relatively few new insights. qualitative and quantitative data.
groups, in-depth or ethnographic Cognitive interviewing is inexpensive Usability tests are typically one-on-one
interviews, usability tests, field tests/ and provides useful data on interviews that are used to determine
pilot interviews, and experimental questionnaire performance while how a given survey or information
research in laboratory and field settings, minimizing respondent burden. collection tool functions in the field,
both for applied questionnaire Cognitive interviewing offers a detailed and how the mode and layout of the
development and evaluation as well as depiction of meanings and processes instrument itself may contribute to
more basic research on response errors used by respondents to answer survey response error and the survey
in surveys. questions—processes that ultimately response process.
Various techniques to evaluate produce the survey data. As such, the In addition to these qualitative
interviewer administered, self- method offers an insight that can methods, NCHS also uses various tools
administered, telephone, Computer
transform understanding of question to obtain quantitative data, which can
Assisted Personal Interviewing (CAPI),
validity and response error. be analyzed alone or analyzed alongside
Computer Assisted Self-Interviewing
Documented findings from these studies qualitative data to give a much fuller
(CASI), Audio Computer-Assisted Self-
represent tangible evidence of how the accounting of the survey response
Interviewing (ACASI), and web-based
question performs. Such documentation process. For instance, phone, internet,
questionnaires are used.
The most common questionnaire also serves CDC data users, allowing mail, and in-person follow-up
evaluation method is the cognitive them to be critical users in their interviews of previous NCHS survey
interview. These evaluations are approach and application of the data. respondents may be used to test the
conducted by the QDRL. The interview In addition to cognitive interviewing, validity of survey questions and
structure consists of respondents first a number of other qualitative and questionnaires and to obtain more
answering a draft survey question and quantitative methods are used to detailed information that cannot be
then providing textual information to investigate and research survey gathered on the original survey.
reveal the processes involved in response errors and the survey response Additionally, field or pilot tests may be
answering the test question. process. These methods include conducted on both representative and
Specifically, cognitive interview conducting focus groups, usability tests, non-representative samples, including
respondents are asked to describe how in-depth or ethnographic interviews, those obtained from commercial survey
and why they answered the question as and the administration and analysis of and web panel vendors. Beyond looking
they did. Through the interviewing questions in both representative and at traditional measures of survey errors
process, various types of question- non-representative field tests. Focus (such as missing rates, item non-
response problems that would not groups are conducted by the QDRL. response, and don’t know rates), these
normally be identified in a traditional They are group interviews whose pilot tests can be used to run
survey interview, such as interpretive primary purpose is to elicit the basic experimental designs in order to capture
errors and recall accuracy, are sociocultural understandings and how different questions function in a
uncovered. By conducting a terminology that form the basis of field setting.
comparative analysis of cognitive questionnaire design. Each group Similar methodology has been
interviews, it is also possible to typically consists of one moderator and adopted by other federal agencies, as
determine whether particular 4 to 10 participants, depending on the well as by academic and commercial
interpretive patterns occur within research question. In-depth or survey organizations. There are no costs
particular sub-groups of the population. ethnographic interviews are one-on-one to respondents other than their time.
Interviews are generally conducted in interviews designed to elicit the The total estimated annual burden
small rounds of 20–30 interviews; understandings or terminology that are hours are 13,150.

ESTIMATED ANNUALIZED BURDEN HOURS
Average
Number of Total
Number of burden per
Type of respondent Form name responses per burden
respondents response
respondent hours
(in hours)

Individuals or households ................. Eligibility Screening .......................... 12,000 1 5/60 1,000
Individuals or households ................. Questionnaire Development Studies 11,700 1 1 11,700
Individuals or households ................. Focus groups ................................... 300 1 90/60 450

Total ........................................... ........................................................... ........................ ........................ ........................ 13,150

Leroy A. Richardson,
Chief, Information Collection Review Office,
mstockstill on DSK4VPTVN1PROD with NOTICES

Office of Scientific Integrity, Office of the
Associate Director for Science, Office of the
Director, Centers for Disease Control and
Prevention.
[FR Doc. 2015–06050 Filed 3–16–15; 8:45 am]
BILLING CODE 4163–18–P

VerDate Sep<11>2014 18:09 Mar 16, 2015 Jkt 235001 PO 00000 Frm 00048 Fmt 4703 Sfmt 9990 E:\FR\FM\17MRN1.SGM 17MRN1

Document Created: 2015-12-18 12:01:56
Document Modified: 2015-12-18 12:01:56

Category		Regulatory Information
Collection		Federal Register
sudoc Class		AE 2.7: GS 4.107: AE 2.106:
Publisher		Office of the Federal Register, National Archives and Records Administration
Section		Notices
Action		Notice with comment period.
Dates		Written comments must be received on or before May 18, 2015.
Contact		To request more information on the proposed project or to obtain a copy of the information collection plan and instruments, contact the Information Collection Review Office, Centers for Disease Control and Prevention, 1600 Clifton Road NE., MS- D74, Atlanta, Georgia 30329; phone: 404-639-7570; Email: [email protected]
FR Citation		80 FR 13868

80 FR 13868 - Proposed Data Collection Submitted for Public Comment and Recommendations

DEPARTMENT OF HEALTH AND HUMAN SERVICESCenters for Disease Control and Prevention

Federal Register Volume 80, Issue 51 (March 17, 2015)

DEPARTMENT OF HEALTH AND HUMAN SERVICES
Centers for Disease Control and Prevention