83 FR 8875 - Proposed Data Collections Submitted for Public Comment and Recommendations
DEPARTMENT OF HEALTH AND HUMAN SERVICES
Centers for Disease Control and Prevention Federal Register Volume 83, Issue 41 (March 1, 2018)
Centers for Disease Control and Prevention
Federal Register Volume 83, Issue 41 (March 1, 2018)
| Page Range | 8875-8876 | |
| FR Document | 2018-04152 |
[Federal Register Volume 83, Number 41 (Thursday, March 1, 2018)] [Notices] [Pages 8875-8876] From the Federal Register Online [www.thefederalregister.org] [FR Doc No: 2018-04152] ----------------------------------------------------------------------- DEPARTMENT OF HEALTH AND HUMAN SERVICES Centers for Disease Control and Prevention [60Day-18-0222; Docket No. CDC-2018-0014] Proposed Data Collections Submitted for Public Comment and Recommendations AGENCY: Centers for Disease Control and Prevention (CDC), Department of Health and Human Services (HHS). ACTION: Notice with comment period. ----------------------------------------------------------------------- SUMMARY: The Centers for Disease Control and Prevention (CDC), as part of its continuing effort to reduce public burden and maximize the utility of government information, invites the general public and other Federal agencies the opportunity to comment on a proposed and/or continuing information collection, as required by the Paperwork Reduction Act of 1995. This notice invites comment on a proposed information collection project titled the Collaborating Center for Questionnaire Design and Evaluation Research (CCQDER), formerly the Questionnaire Design Research Laboratory (QDRL), generic clearance request, which encompasses general questionnaire development, pre- testing, and measurement-error reduction activities to be carried out in 2018-2020. DATES: CDC must receive written comments on or before April 30, 2018. ADDRESSES: You may submit comments, identified by Docket No. CDC-2018- 0014 by any of the following methods:Federal eRulemaking Portal: Regulations.gov. Follow the instructions for submitting comments. Mail: Leroy A. Richardson, Information Collection Review Office, Centers for Disease Control and Prevention, 1600 Clifton Road NE, MS-D74, Atlanta, Georgia 30329. Instructions: All submissions received must include the agency name and Docket Number. CDC will post, without change, all relevant comments to Regulations.gov. Please note: Submit all comments through the Federal eRulemaking portal (regulations.gov) or by U.S. mail to the address listed above. FOR FURTHER INFORMATION CONTACT: To request more information on the proposed project or to obtain a copy of the information collection plan and instruments, contact Leroy A. Richardson, Information Collection Review Office, Centers for Disease Control and Prevention, 1600 Clifton Road NE, MS-D74, Atlanta, Georgia 30329; phone: 404-639-7570; Email: [email protected]. SUPPLEMENTARY INFORMATION: Under the Paperwork Reduction Act of 1995 (PRA) (44 U.S.C. 3501-3520), Federal agencies must obtain approval from the Office of Management and Budget (OMB) for each collection of information they conduct or sponsor. In addition, the PRA also requires Federal agencies to provide a 60-day notice in the Federal Register concerning each proposed collection of information, including each new proposed collection, each proposed extension of existing collection of information, and each reinstatement of previously approved information collection before submitting the collection to the OMB for approval. To comply with this requirement, we are publishing this notice of a proposed data collection as described below. The OMB is particularly interested in comments that will help: 1. Evaluate whether the proposed collection of information is necessary for the proper performance of the functions of the agency, including whether the information will have practical utility; 2. Evaluate the accuracy of the agency's estimate of the burden of the proposed collection of information, including the validity of the methodology and assumptions used; 3. Enhance the quality, utility, and clarity of the information to be collected; and 4. Minimize the burden of the collection of information on those who are to respond, including through the use of appropriate automated, electronic, mechanical, or other technological collection techniques or other forms of information technology, e.g., permitting electronic submissions of responses. 5. Assess information collection costs. Proposed Project The Collaborating Center for Questionnaire Design and Evaluation Research (CCQDER) (OMB Control Number 0920-0222, Expiration 07/31/ 2018)--Revision--National Center for Health Statistics (NCHS), Centers for Disease Control and Prevention (CDC). Background and Brief Description Section 306 of the Public Health Service (PHS) Act (42 U.S.C. 242k), as amended, authorizes that the Secretary of Health and Human Services (DHHS), acting through NCHS, shall undertake and support (by grant or contract) research, demonstrations, and evaluations respecting new or improved methods for obtaining current data to support statistical and epidemiological activities for the purpose of improving the effectiveness, efficiency, and quality of health services in the United States. The Collaborating Center for Questionnaire Design and Evaluation Research (CCQDER) is the focal point within NCHS for questionnaire and survey development, pre-testing, and evaluation activities for CDC surveys (such as the NCHS National Health Interview Survey, OMB No. 0920-0214) and other federally sponsored surveys. NCHS is requesting 3 years of OMB Clearance for this generic submission. The CCQDER and other NCHS programs conduct cognitive interviews, focus groups, in-depth or ethnographic interviews, usability tests, field tests/pilot interviews, and experimental research in laboratory and field settings, both for applied questionnaire development and evaluation as well as more basic research on measurement errors and survey response. [[Page 8876]] Various techniques to evaluate interviewer administered, self- administered, telephone, Computer Assisted Personal Interviewing (CAPI), Computer Assisted Self-Interviewing (CASI), Audio Computer- Assisted Self-Interviewing (ACASI), and web-based questionnaires are used. The most common questionnaire evaluation method is the cognitive interview. These evaluations are conducted by the CCQDER. The interview structure consists of respondents first answering a draft survey question and then providing textual information to reveal the processes involved in answering the test question. Specifically, cognitive interview respondents are asked to describe how and why they answered the question as they did. Through the interviewing process, various types of question-response problems that would not normally be identified in a traditional survey interview, such as interpretive errors and recall accuracy, are uncovered. By conducting a comparative analysis of cognitive interviews, it is also possible to determine whether particular interpretive patterns occur within particular sub- groups of the population. Interviews are generally conducted in small rounds totaling 40-100 interviews; ideally, the questionnaire is re- worked between rounds, and revisions are tested iteratively until interviews yield relatively few new insights. Cognitive interviewing is inexpensive and provides useful data on questionnaire performance while minimizing respondent burden. Cognitive interviewing offers a detailed depiction of meanings and processes used by respondents to answer questions--processes that ultimately produce the survey data. As such, the method offers an insight that can transform understanding of question validity and response error. Documented findings from these studies represent tangible evidence of how the question performs. Such documentation also serves CDC data users, allowing them to be critical users in their approach and application of the data. In addition to cognitive interviewing, a number of other qualitative and quantitative methods are used to investigate and research measurement errors and the survey response process. These methods include conducting focus groups, usability tests, in-depth or ethnographic interviews, and the administration and analysis of questions in both representative and non-representative field tests. Focus groups are conducted by the CCQDER. They are group interviews whose primary purpose is to elicit the basic sociocultural understandings and terminology that form the basis of questionnaire design. Each group typically consists of one moderator and 4 to 10 participants, depending on the research question. In-depth or ethnographic interviews are one-on-one interviews designed to elicit the understandings or terminology that are necessary for question design, as well as to gather detailed information that can contribute to the analysis of both qualitative and quantitative data. Usability tests are typically one-on-one interviews that are used to determine how a given survey or information collection tool functions in the field, and how the mode and layout of the instrument itself may contribute to survey response error and the survey response process. In addition to these qualitative methods, NCHS also uses various tools to obtain quantitative data, which can be analyzed alone or analyzed alongside qualitative data to give a much fuller accounting of the survey response process. For instance, phone, internet, mail, and in-person follow-up interviews of previous NCHS survey respondents may be used to test the validity of survey questions and questionnaires and to obtain more detailed information that cannot be gathered on the original survey. Additionally, field or pilot tests may be conducted on both representative and non-representative samples, including those obtained from commercial survey and web panel vendors. Beyond looking at traditional measures of survey errors (such as item missing rates and non-response, and don't know rates), these pilot tests can be used to run experimental designs in order to capture how different questions function in a field setting. Similar methodology has been adopted by other federal agencies, as well as by academic and commercial survey organizations. There are no costs to respondents other than their time. The total estimated annual burden hours are 23,350. Estimated Annualized Burden Hours ---------------------------------------------------------------------------------------------------------------- Number of Average burden Type of respondents Form name Number of responses per per response Total burden respondents respondent (in hours) (in hours) ---------------------------------------------------------------------------------------------------------------- Individuals or households..... Eligibility 4,000 1 5/60 333 Screening. Individuals or households..... Questionnaire 7,300 1 55/60 6,692 Development Studies. Individuals or households..... Respondent Data 7,300 1 5/60 608 Collection Sheet. Individuals or households..... Focus groups.... 100 1 1.5 150 --------------------------------------------------------------- Total..................... ................ .............. .............. .............. 7,783 ---------------------------------------------------------------------------------------------------------------- Leroy A. Richardson, Chief, Information Collection Review Office, Office of Scientific Integrity, Office of the Associate Director for Science, Office of the Director, Centers for Disease Control and Prevention. [FR Doc. 2018-04152 Filed 2-28-18; 8:45 am] BILLING CODE 4163-18-P
![Federal Register / Vol. 83, No. 41 / Thursday, March 1, 2018 / Notices 8875
Law 92–463. The grant applications and This notice invites comment on a 1. Evaluate whether the proposed
the discussions could disclose proposed information collection project collection of information is necessary
confidential trade secrets or commercial titled the Collaborating Center for for the proper performance of the
property such as patentable material, Questionnaire Design and Evaluation functions of the agency, including
and personal information concerning Research (CCQDER), formerly the whether the information will have
individuals associated with the grant Questionnaire Design Research practical utility;
applications, the disclosure of which Laboratory (QDRL), generic clearance 2. Evaluate the accuracy of the
would constitute a clearly unwarranted request, which encompasses general agency’s estimate of the burden of the
invasion of personal privacy. questionnaire development, pre-testing, proposed collection of information,
Name of Committee: Disease, and measurement-error reduction including the validity of the
Disability, and Injury Prevention and activities to be carried out in 2018– methodology and assumptions used;
Control Special Emphasis Panel (SEP) 2020. 3. Enhance the quality, utility, and
IP18–002, Economic Studies of clarity of the information to be
DATES: CDC must receive written collected; and
Immunization Policies and Practices. comments on or before April 30, 2018.
Date: April 3, 2018. 4. Minimize the burden of the
Time: 10:00 a.m.–3:00 p.m., EDT. ADDRESSES: You may submit comments, collection of information on those who
Place: Teleconference. identified by Docket No. CDC–2018– are to respond, including through the
Agenda: To review and evaluate grant 0014 by any of the following methods: use of appropriate automated,
applications. • Federal eRulemaking Portal: electronic, mechanical, or other
Regulations.gov. Follow the instructions technological collection techniques or
FOR FURTHER INFORMATION CONTACT:
for submitting comments. other forms of information technology,
Gregory Anderson, MS, MPH, Scientific
• Mail: Leroy A. Richardson, e.g., permitting electronic submissions
Review Officer, CDC, 1600 Clifton Road
Information Collection Review Office, of responses.
NE, Mailstop E60, Atlanta, Georgia
Centers for Disease Control and 5. Assess information collection costs.
30333, (404) 718–8833, gca5@cdc.gov.
Prevention, 1600 Clifton Road NE, MS–
The Director, Management Analysis Proposed Project
D74, Atlanta, Georgia 30329.
and Services Office, has been delegated The Collaborating Center for
Instructions: All submissions received
the authority to sign Federal Register Questionnaire Design and Evaluation
must include the agency name and
notices pertaining to announcements of Research (CCQDER) (OMB Control
Docket Number. CDC will post, without
meetings and other committee Number 0920–0222, Expiration 07/31/
change, all relevant comments to
management activities, for both the 2018)—Revision—National Center for
Regulations.gov.
Centers for Disease Control and Health Statistics (NCHS), Centers for
Please note: Submit all comments
Prevention and the Agency for Toxic Disease Control and Prevention (CDC).
through the Federal eRulemaking portal
Substances and Disease Registry.
(regulations.gov) or by U.S. mail to the Background and Brief Description
Elaine L. Baker, address listed above.
Section 306 of the Public Health
Director, Management Analysis and Services FOR FURTHER INFORMATION CONTACT: To
Office, Centers for Disease Control and Service (PHS) Act (42 U.S.C. 242k), as
request more information on the amended, authorizes that the Secretary
Prevention. proposed project or to obtain a copy of
[FR Doc. 2018–04134 Filed 2–28–18; 8:45 am]
of Health and Human Services (DHHS),
the information collection plan and acting through NCHS, shall undertake
BILLING CODE 4163–18–P instruments, contact Leroy A. and support (by grant or contract)
Richardson, Information Collection research, demonstrations, and
Review Office, Centers for Disease evaluations respecting new or improved
DEPARTMENT OF HEALTH AND Control and Prevention, 1600 Clifton
HUMAN SERVICES methods for obtaining current data to
Road NE, MS–D74, Atlanta, Georgia support statistical and epidemiological
30329; phone: 404–639–7570; Email: activities for the purpose of improving
Centers for Disease Control and
omb@cdc.gov. the effectiveness, efficiency, and quality
Prevention
SUPPLEMENTARY INFORMATION: Under the of health services in the United States.
[60Day–18–0222; Docket No. CDC–2018– Paperwork Reduction Act of 1995 (PRA) The Collaborating Center for
0014] (44 U.S.C. 3501–3520), Federal agencies Questionnaire Design and Evaluation
must obtain approval from the Office of Research (CCQDER) is the focal point
Proposed Data Collections Submitted
Management and Budget (OMB) for each within NCHS for questionnaire and
for Public Comment and
collection of information they conduct survey development, pre-testing, and
Recommendations
or sponsor. In addition, the PRA also evaluation activities for CDC surveys
AGENCY: Centers for Disease Control and requires Federal agencies to provide a (such as the NCHS National Health
Prevention (CDC), Department of Health 60-day notice in the Federal Register Interview Survey, OMB No. 0920–0214)
and Human Services (HHS). concerning each proposed collection of and other federally sponsored surveys.
ACTION: Notice with comment period. information, including each new NCHS is requesting 3 years of OMB
proposed collection, each proposed Clearance for this generic submission.
SUMMARY: The Centers for Disease extension of existing collection of The CCQDER and other NCHS
Control and Prevention (CDC), as part of information, and each reinstatement of programs conduct cognitive interviews,
its continuing effort to reduce public previously approved information focus groups, in-depth or ethnographic
amozie on DSK30RV082PROD with NOTICES
burden and maximize the utility of collection before submitting the interviews, usability tests, field tests/
government information, invites the collection to the OMB for approval. To pilot interviews, and experimental
general public and other Federal comply with this requirement, we are research in laboratory and field settings,
agencies the opportunity to comment on publishing this notice of a proposed both for applied questionnaire
a proposed and/or continuing data collection as described below. development and evaluation as well as
information collection, as required by The OMB is particularly interested in more basic research on measurement
the Paperwork Reduction Act of 1995. comments that will help: errors and survey response.
VerDate Sep<11>2014 17:26 Feb 28, 2018 Jkt 244001 PO 00000 Frm 00046 Fmt 4703 Sfmt 4703 E:\FR\FM\01MRN1.SGM 01MRN1](https://thefederalregister.org/doc/83_FR_8916/page/1.svg)
![8876 Federal Register / Vol. 83, No. 41 / Thursday, March 1, 2018 / Notices
Various techniques to evaluate minimizing respondent burden. Usability tests are typically one-on-one
interviewer administered, self- Cognitive interviewing offers a detailed interviews that are used to determine
administered, telephone, Computer depiction of meanings and processes how a given survey or information
Assisted Personal Interviewing (CAPI), used by respondents to answer collection tool functions in the field,
Computer Assisted Self-Interviewing questions—processes that ultimately and how the mode and layout of the
(CASI), Audio Computer-Assisted Self- produce the survey data. As such, the instrument itself may contribute to
Interviewing (ACASI), and web-based method offers an insight that can survey response error and the survey
questionnaires are used. transform understanding of question response process.
The most common questionnaire validity and response error.
In addition to these qualitative
evaluation method is the cognitive Documented findings from these studies
methods, NCHS also uses various tools
interview. These evaluations are represent tangible evidence of how the
conducted by the CCQDER. The to obtain quantitative data, which can
question performs. Such documentation
interview structure consists of be analyzed alone or analyzed alongside
also serves CDC data users, allowing
respondents first answering a draft qualitative data to give a much fuller
them to be critical users in their
survey question and then providing accounting of the survey response
approach and application of the data.
textual information to reveal the In addition to cognitive interviewing, process. For instance, phone, internet,
processes involved in answering the test a number of other qualitative and mail, and in-person follow-up
question. Specifically, cognitive quantitative methods are used to interviews of previous NCHS survey
interview respondents are asked to investigate and research measurement respondents may be used to test the
describe how and why they answered errors and the survey response process. validity of survey questions and
the question as they did. Through the These methods include conducting questionnaires and to obtain more
interviewing process, various types of focus groups, usability tests, in-depth or detailed information that cannot be
question-response problems that would ethnographic interviews, and the gathered on the original survey.
not normally be identified in a administration and analysis of questions Additionally, field or pilot tests may be
traditional survey interview, such as in both representative and non- conducted on both representative and
interpretive errors and recall accuracy, representative field tests. Focus groups non-representative samples, including
are uncovered. By conducting a are conducted by the CCQDER. They are those obtained from commercial survey
comparative analysis of cognitive group interviews whose primary and web panel vendors. Beyond looking
interviews, it is also possible to purpose is to elicit the basic at traditional measures of survey errors
determine whether particular sociocultural understandings and (such as item missing rates and non-
interpretive patterns occur within terminology that form the basis of response, and don’t know rates), these
particular sub-groups of the population. questionnaire design. Each group pilot tests can be used to run
Interviews are generally conducted in typically consists of one moderator and experimental designs in order to capture
small rounds totaling 40–100 4 to 10 participants, depending on the how different questions function in a
interviews; ideally, the questionnaire is research question. In-depth or field setting.
re-worked between rounds, and ethnographic interviews are one-on-one Similar methodology has been
revisions are tested iteratively until interviews designed to elicit the adopted by other federal agencies, as
interviews yield relatively few new understandings or terminology that are well as by academic and commercial
insights. necessary for question design, as well as survey organizations. There are no costs
Cognitive interviewing is inexpensive to gather detailed information that can to respondents other than their time.
and provides useful data on contribute to the analysis of both The total estimated annual burden
questionnaire performance while qualitative and quantitative data. hours are 23,350.
ESTIMATED ANNUALIZED BURDEN HOURS
Number of Average Total
Number of burden per
Type of respondents Form name responses per burden
respondents response
respondent (in hours)
(in hours)
Individuals or households ................. Eligibility Screening .......................... 4,000 1 5/60 333
Individuals or households ................. Questionnaire Development Studies 7,300 1 55/60 6,692
Individuals or households ................. Respondent Data Collection Sheet .. 7,300 1 5/60 608
Individuals or households ................. Focus groups ................................... 100 1 1.5 150
Total ........................................... ........................................................... ........................ ........................ ........................ 7,783
Leroy A. Richardson,
Chief, Information Collection Review Office,
Office of Scientific Integrity, Office of the
Associate Director for Science, Office of the
Director, Centers for Disease Control and
Prevention.
amozie on DSK30RV082PROD with NOTICES
[FR Doc. 2018–04152 Filed 2–28–18; 8:45 am]
BILLING CODE 4163–18–P
VerDate Sep<11>2014 17:26 Feb 28, 2018 Jkt 244001 PO 00000 Frm 00047 Fmt 4703 Sfmt 9990 E:\FR\FM\01MRN1.SGM 01MRN1](https://thefederalregister.org/doc/83_FR_8916/page/2.svg)
Document Created: 2018-02-28 23:57:56
Document Modified: 2018-02-28 23:57:56
| Category | Regulatory Information | |
| Collection | Federal Register | |
| sudoc Class | AE 2.7: GS 4.107: AE 2.106: | |
| Publisher | Office of the Federal Register, National Archives and Records Administration | |
| Section | Notices | |
| Action | Notice with comment period. | |
| Dates | CDC must receive written comments on or before April 30, 2018. | |
| Contact | To request more information on the proposed project or to obtain a copy of the information collection plan and instruments, contact Leroy A. Richardson, Information Collection Review Office, Centers for Disease Control and Prevention, 1600 Clifton Road NE, MS-D74, Atlanta, Georgia 30329; phone: 404-639-7570; Email: [email protected] | |
| FR Citation | 83 FR 8875 |
2025 Federal Register | Disclaimer | Privacy Policy
USC | CFR | eCFR