80 FR 34644 - Agency Forms Undergoing Paperwork Reduction Act Review

DEPARTMENT OF HEALTH AND HUMAN SERVICES
Centers for Disease Control and Prevention

Federal Register Volume 80, Issue 116 (June 17, 2015)

Page Range		34644-34645
FR Document		2015-14786

Federal Register, Volume 80 Issue 116 (Wednesday, June 17, 2015)

[Federal Register Volume 80, Number 116 (Wednesday, June 17, 2015)]
[Notices]
[Pages 34644-34645]
From the Federal Register Online [www.thefederalregister.org]
[FR Doc No: 2015-14786]

-----------------------------------------------------------------------

DEPARTMENT OF HEALTH AND HUMAN SERVICES

Centers for Disease Control and Prevention

[30-Day-15-0222]

Agency Forms Undergoing Paperwork Reduction Act Review

The Centers for Disease Control and Prevention (CDC) has submitted
the following information collection request to the Office of
Management and Budget (OMB) for review and approval in accordance with
the Paperwork Reduction Act of 1995. The notice for the proposed
information collection is published to obtain comments from the public
and affected agencies.
Written comments and suggestions from the public and affected
agencies concerning the proposed collection of information are
encouraged. Your comments should address any of the following: (a)
Evaluate whether the proposed collection of information is necessary
for the proper performance of the functions of the agency, including
whether the information will have practical utility; (b) Evaluate the
accuracy of the agencies estimate of the burden of the proposed
collection of information, including the validity of the methodology
and assumptions used; (c) Enhance the quality, utility, and clarity of
the information to be collected; (d) Minimize the burden of the
collection of information on those who are to respond, including
through the use of appropriate automated, electronic, mechanical, or
other technological collection techniques or other forms of information
technology, e.g., permitting electronic submission of responses; and
(e) Assess information collection costs.
To request additional information on the proposed project or to
obtain a copy of the information collection plan and instruments, call
(404) 639-7570 or send an email to omb@cdc.gov. Written comments and/or
suggestions regarding the items contained in this notice should be
directed to the Attention: CDC Desk Officer, Office of Management and
Budget, Washington, DC 20503 or by fax to (202) 395-5806. Written
comments should be received within 30 days of this notice.

Proposed Project

Questionnaire Design Research Laboratory (QDRL)--(OMB No. 0920-
0222, expires 6/30/2015)--Revision--National Center for Health
Statistics (NCHS), Centers for Disease Control and Prevention (CDC).

Background and Brief Description

The Questionnaire Design Research Laboratory (QDRL) is the focal
point within NCHS for questionnaire development, pre-testing, and
evaluation activities for CDC surveys (such as the NCHS National Health
Interview Survey, OMB No. 0920-0214) and other federally sponsored
surveys; however, question development and evaluation activities are
conducted throughout NCHS. NCHS is requesting 3 years of OMB Clearance
for this generic submission. This revision is a request for additional
burden hours due to anticipated increase in the number and size of
projects being undertaken in the next three years.
The QDRL and other NCHS programs conduct cognitive interviews,
focus groups, in-depth or ethnographic interviews, usability tests,
field tests/pilot interviews, and experimental research in laboratory
and field settings, both for applied questionnaire development and
evaluation as well as more basic research on response errors in
surveys.
Various techniques to evaluate interviewer administered, self-
administered, telephone, Computer Assisted Personal Interviewing
(CAPI), Computer Assisted Self-Interviewing (CASI), Audio Computer-
Assisted Self-Interviewing (ACASI), and web-based questionnaires are
used.
The most common questionnaire evaluation method is the cognitive
interview. These evaluations are conducted by the QDRL. The interview
structure consists of respondents first answering a draft survey
question and then providing textual information to reveal the processes
involved in answering the test question. Specifically, cognitive
interview respondents are asked to describe how and why they answered
the question as they did. Through the interviewing process, various
types of question-response problems that would not normally be
identified in a traditional survey interview, such as interpretive
errors and recall accuracy, are uncovered. By conducting a comparative
analysis of cognitive interviews, it is also possible to determine
whether particular interpretive patterns occur within particular sub-
groups of the population. Interviews are generally conducted in small
rounds of 20-30 interviews; ideally, the questionnaire is re-worked
between rounds, and revisions are tested iteratively until interviews
yield relatively few new insights.
Cognitive interviewing is inexpensive and provides useful data on
questionnaire performance while minimizing respondent burden. Cognitive
interviewing offers a detailed depiction of meanings and processes used
by respondents to answer questions--processes that ultimately produce
the survey data. As such, the method offers an insight that can
transform understanding of question validity and response error.
Documented findings from these studies represent tangible evidence of
how the question performs. Such documentation also serves CDC data
users, allowing them to be critical users in their approach and
application of the data.
In addition to cognitive interviewing, a number of other
qualitative and quantitative methods are used to investigate and
research survey response errors and the survey response process. These
methods include conducting focus groups, usability tests, in-depth or
ethnographic interviews, and the administration and analysis of
questions in both representative and non-representative field tests.
Focus groups are conducted by the NCHS QDRL. They are group interviews
whose primary purpose is to elicit the basic sociocultural
understandings and terminology that form the basis of questionnaire
design. Each group

[[Page 34645]]

typically consists of one moderator and 4 to 10 participants, depending
on the research question. In-depth or ethnographic interviews are one-
on-one interviews designed to elicit the understandings or terminology
that are necessary for question design, as well as to gather detailed
information that can contribute to the analysis of both qualitative and
quantitative data. Usability tests are typically one-on-one interviews
that are used to determine how a given survey or information collection
tool functions in the field, and how the mode and layout of the
instrument itself may contribute to survey response error and the
survey response process.
In addition to these qualitative methods, NCHS also uses various
tools to obtain quantitative data, which can be analyzed alone or
analyzed alongside qualitative data to give a much fuller accounting of
the survey response process. For instance, phone, internet, mail, and
in-person follow-up interviews of previous NCHS survey respondents may
be used to test the validity of survey questions and questionnaires and
to obtain more detailed information that cannot be gathered on the
original survey. Additionally, field or pilot tests may be conducted on
both representative and non-representative samples, including those
obtained from commercial survey and web panel vendors. Beyond looking
at traditional measures of survey errors (such as missing rates, item
non-response, and don't know rates), these pilot tests can be used to
run experimental designs in order to capture how different questions
function in a field setting.
There are no costs to respondents other than their time. The total
estimated annual burden hours are 4,383.

Estimated Annualized Burden Hours
----------------------------------------------------------------------------------------------------------------
Number of Average burden
Type of respondents Form name Number of responses per per response
respondents respondent (in hrs.)
----------------------------------------------------------------------------------------------------------------
Individuals or households............ Eligibility Screeners... 4,000 1 5/60
Individuals or households............ Developmental 3,900 1 1
Questionnaires.
Individuals or households............ Focus group documents... 100 1 1.5
----------------------------------------------------------------------------------------------------------------

Leroy A. Richardson,
Chief, Information Collection Review Office, Office of Scientific
Integrity, Office of the Associate Director for Science, Office of the
Director, Centers for Disease Control and Prevention.
[FR Doc. 2015-14786 Filed 6-16-15; 8:45 am]
BILLING CODE 4163-18-P

34644 Federal Register / Vol. 80, No. 116 / Wednesday, June 17, 2015 / Notices

NCHS survey data collection burden of the proposed collection of Computer Assisted Self-Interviewing
instruments using cognitive laboratory information, including the validity of (CASI), Audio Computer-Assisted Self-
methods and related innovative the methodology and assumptions used; Interviewing (ACASI), and web-based
questionnaire evaluation methods; (6) (c) Enhance the quality, utility, and questionnaires are used.
provides consultation and technical clarity of the information to be The most common questionnaire
assistance to NCHS’ data systems on collected; (d) Minimize the burden of evaluation method is the cognitive
questionnaire design issues and other the collection of information on those interview. These evaluations are
related data collection procedures; (7) who are to respond, including through conducted by the QDRL. The interview
conducts a program of reimbursable the use of appropriate automated, structure consists of respondents first
applied and basic research, technical electronic, mechanical, or other answering a draft survey question and
assistance, and consultation on technological collection techniques or then providing textual information to
questionnaire design and cognitive other forms of information technology, reveal the processes involved in
aspects of survey methods. e.g., permitting electronic submission of answering the test question.
Research Data Center (CPCHD). (1) responses; and (e) Assess information Specifically, cognitive interview
Facilitates the access of restricted use collection costs. respondents are asked to describe how
data to the research community; (2) To request additional information on and why they answered the question as
conducts research in areas related to the the proposed project or to obtain a copy they did. Through the interviewing
development, linkage, analysis, and of the information collection plan and process, various types of question-
dissemination of survey data; (3) instruments, call (404) 639–7570 or response problems that would not
provides consultation and technical send an email to omb@cdc.gov. Written normally be identified in a traditional
assistance to programs on data comments and/or suggestions regarding survey interview, such as interpretive
collection procedures, confidentiality, the items contained in this notice errors and recall accuracy, are
disclosure limitation, data linkage, and should be directed to the Attention: uncovered. By conducting a
dissemination; (4) serves as NCHS’ CDC Desk Officer, Office of Management comparative analysis of cognitive
primary venue for disseminating and Budget, Washington, DC 20503 or interviews, it is also possible to
restricted use data to the research by fax to (202) 395–5806. Written determine whether particular
community; (5) supports scientific comments should be received within 30 interpretive patterns occur within
research on disclosure limitation of days of this notice. particular sub-groups of the population.
surveys using micro-data files. Interviews are generally conducted in
Proposed Project small rounds of 20–30 interviews;
James Seligman, Questionnaire Design Research ideally, the questionnaire is re-worked
Acting Chief Operating Officer, Centers for Laboratory (QDRL)—(OMB No. 0920– between rounds, and revisions are
Disease Control and Prevention. 0222, expires 6/30/2015)—Revision— tested iteratively until interviews yield
[FR Doc. 2015–14808 Filed 6–16–15; 8:45 am] National Center for Health Statistics relatively few new insights.
BILLING CODE 4160–18–P (NCHS), Centers for Disease Control and Cognitive interviewing is inexpensive
Prevention (CDC). and provides useful data on
questionnaire performance while
Background and Brief Description minimizing respondent burden.
DEPARTMENT OF HEALTH AND
HUMAN SERVICES The Questionnaire Design Research Cognitive interviewing offers a detailed
Laboratory (QDRL) is the focal point depiction of meanings and processes
Centers for Disease Control and within NCHS for questionnaire used by respondents to answer
Prevention development, pre-testing, and questions—processes that ultimately
[30-Day–15–0222]
evaluation activities for CDC surveys produce the survey data. As such, the
(such as the NCHS National Health method offers an insight that can
Agency Forms Undergoing Paperwork Interview Survey, OMB No. 0920–0214) transform understanding of question
Reduction Act Review and other federally sponsored surveys; validity and response error.
however, question development and Documented findings from these studies
The Centers for Disease Control and evaluation activities are conducted represent tangible evidence of how the
Prevention (CDC) has submitted the throughout NCHS. NCHS is requesting 3 question performs. Such documentation
following information collection request years of OMB Clearance for this generic also serves CDC data users, allowing
to the Office of Management and Budget submission. This revision is a request them to be critical users in their
(OMB) for review and approval in for additional burden hours due to approach and application of the data.
accordance with the Paperwork anticipated increase in the number and In addition to cognitive interviewing,
Reduction Act of 1995. The notice for size of projects being undertaken in the a number of other qualitative and
the proposed information collection is next three years. quantitative methods are used to
published to obtain comments from the The QDRL and other NCHS programs investigate and research survey
public and affected agencies. conduct cognitive interviews, focus response errors and the survey response
Written comments and suggestions groups, in-depth or ethnographic process. These methods include
from the public and affected agencies interviews, usability tests, field tests/ conducting focus groups, usability tests,
concerning the proposed collection of pilot interviews, and experimental in-depth or ethnographic interviews,
information are encouraged. Your research in laboratory and field settings, and the administration and analysis of
asabaliauskas on DSK5VPTVN1PROD with NOTICES

comments should address any of the both for applied questionnaire questions in both representative and
following: (a) Evaluate whether the development and evaluation as well as non-representative field tests. Focus
proposed collection of information is more basic research on response errors groups are conducted by the NCHS
necessary for the proper performance of in surveys. QDRL. They are group interviews whose
the functions of the agency, including Various techniques to evaluate primary purpose is to elicit the basic
whether the information will have interviewer administered, self- sociocultural understandings and
practical utility; (b) Evaluate the administered, telephone, Computer terminology that form the basis of
accuracy of the agencies estimate of the Assisted Personal Interviewing (CAPI), questionnaire design. Each group

VerDate Sep<11>2014 18:47 Jun 16, 2015 Jkt 235001 PO 00000 Frm 00039 Fmt 4703 Sfmt 4703 E:\FR\FM\17JNN1.SGM 17JNN1

Federal Register / Vol. 80, No. 116 / Wednesday, June 17, 2015 / Notices 34645

typically consists of one moderator and survey response error and the survey Additionally, field or pilot tests may be
4 to 10 participants, depending on the response process. conducted on both representative and
research question. In-depth or In addition to these qualitative non-representative samples, including
ethnographic interviews are one-on-one methods, NCHS also uses various tools those obtained from commercial survey
interviews designed to elicit the to obtain quantitative data, which can and web panel vendors. Beyond looking
understandings or terminology that are be analyzed alone or analyzed alongside at traditional measures of survey errors
necessary for question design, as well as qualitative data to give a much fuller (such as missing rates, item non-
to gather detailed information that can accounting of the survey response response, and don’t know rates), these
contribute to the analysis of both process. For instance, phone, internet, pilot tests can be used to run
qualitative and quantitative data. mail, and in-person follow-up experimental designs in order to capture
Usability tests are typically one-on-one interviews of previous NCHS survey how different questions function in a
interviews that are used to determine respondents may be used to test the field setting.
how a given survey or information validity of survey questions and There are no costs to respondents
collection tool functions in the field, questionnaires and to obtain more other than their time. The total
and how the mode and layout of the detailed information that cannot be estimated annual burden hours are
instrument itself may contribute to gathered on the original survey. 4,383.

ESTIMATED ANNUALIZED BURDEN HOURS
Number of Average burden
Number of
Type of respondents Form name responses per per response
respondents respondent (in hrs.)

Individuals or households .............................. Eligibility Screeners ....................................... 4,000 1 5/60
Individuals or households .............................. Developmental Questionnaires ..................... 3,900 1 1
Individuals or households .............................. Focus group documents ............................... 100 1 1.5

Leroy A. Richardson, collection entitled ‘‘Foreign Quarantine (44 U.S.C. 3501–3520), Federal agencies
Chief, Information Collection Review Office, Regulations (42 CFR part 71)’’. must obtain approval from the Office of
Office of Scientific Integrity, Office of the DATES: Written comments must be Management and Budget (OMB) for each
Associate Director for Science, Office of the received on or before August 17, 2015. collection of information they conduct
Director, Centers for Disease Control and or sponsor. In addition, the PRA also
Prevention. ADDRESSES: You may submit comments,
identified by Docket No. CDC–2015– requires Federal agencies to provide a
[FR Doc. 2015–14786 Filed 6–16–15; 8:45 am] 60-day notice in the Federal Register
0039 by any of the following methods:
BILLING CODE 4163–18–P
• Federal eRulemaking Portal: concerning each proposed collection of
Regulation.gov. Follow the instructions information, including each new
for submitting comments. proposed collection, each proposed
DEPARTMENT OF HEALTH AND extension of existing collection of
HUMAN SERVICES • Mail: Leroy A. Richardson,
Information Collection Review Office, information, and each reinstatement of
Centers for Disease Control and Centers for Disease Control and previously approved information
Prevention Prevention, 1600 Clifton Road NE., MS– collection before submitting the
D74, Atlanta, Georgia 30329. collection to OMB for approval. To
[60-Day–15–0134; Docket No. CDC–2015– comply with this requirement, we are
Instructions: All submissions received
0039] publishing this notice of a proposed
must include the agency name and
Docket Number. All relevant comments data collection as described below.
Proposed Data Collection Submitted
received will be posted without change Comments are invited on: (a) Whether
for Public Comment and
to Regulations.gov, including any the proposed collection of information
Recommendations
personal information provided. For is necessary for the proper performance
AGENCY: Centers for Disease Control and access to the docket to read background of the functions of the agency, including
Prevention (CDC), Department of Health documents or comments received, go to whether the information shall have
and Human Services (HHS). Regulations.gov. practical utility; (b) the accuracy of the
ACTION: Notice with comment period. agency’s estimate of the burden of the
Please note: All public comment should be
submitted through the Federal eRulemaking
proposed collection of information; (c)
SUMMARY: The Centers for Disease portal (Regulations.gov) or by U.S. mail to the ways to enhance the quality, utility, and
Control and Prevention (CDC), as part of address listed above. clarity of the information to be
its continuing efforts to reduce public collected; (d) ways to minimize the
burden and maximize the utility of FOR FURTHER INFORMATION CONTACT: To burden of the collection of information
government information, invites the request more information on the on respondents, including through the
general public and other Federal proposed project or to obtain a copy of use of automated collection techniques
agencies to take this opportunity to the information collection plan and or other forms of information
asabaliauskas on DSK5VPTVN1PROD with NOTICES

comment on proposed and/or instruments, contact the Information technology; and (e) estimates of capital
continuing information collections, as Collection Review Office, Centers for or start-up costs and costs of operation,
required by the Paperwork Reduction Disease Control and Prevention, 1600 maintenance, and purchase of services
Act of 1995. This notice invites Clifton Road NE., MS–D74, Atlanta, to provide information. Burden means
comment on a revision to several of the Georgia 30329; phone: 404–639–7570; the total time, effort, or financial
information collections pertaining to the Email: omb@cdc.gov. resources expended by persons to
importation of dogs as outlined in the SUPPLEMENTARY INFORMATION: Under the generate, maintain, retain, disclose or
currently approved information Paperwork Reduction Act of 1995 (PRA) provide information to or for a Federal

VerDate Sep<11>2014 18:47 Jun 16, 2015 Jkt 235001 PO 00000 Frm 00040 Fmt 4703 Sfmt 4703 E:\FR\FM\17JNN1.SGM 17JNN1

Document Created: 2015-12-15 14:22:32
Document Modified: 2015-12-15 14:22:32

Category		Regulatory Information
Collection		Federal Register
sudoc Class		AE 2.7: GS 4.107: AE 2.106:
Publisher		Office of the Federal Register, National Archives and Records Administration
Section		Notices
FR Citation		80 FR 34644

80 FR 34644 - Agency Forms Undergoing Paperwork Reduction Act Review

DEPARTMENT OF HEALTH AND HUMAN SERVICESCenters for Disease Control and Prevention

Federal Register Volume 80, Issue 116 (June 17, 2015)

DEPARTMENT OF HEALTH AND HUMAN SERVICES
Centers for Disease Control and Prevention