80_FR_10763 80 FR 10724 - Notice of Intent To Seek Approval To Establish an Information Collection

80 FR 10724 - Notice of Intent To Seek Approval To Establish an Information Collection

NATIONAL SCIENCE FOUNDATION

Federal Register Volume 80, Issue 39 (February 27, 2015)

Page Range10724-10726
FR Document2015-04097

Under the Paperwork Reduction Act of 1995, Public Law 104-13 (44 U.S.C. 3501 et seq.), and as part of its continuing effort to reduce paperwork and respondent burden, the National Science Foundation (NSF) is inviting the general public and other Federal agencies to comment on this proposed information collection. Comments: Comments are invited on: (a) Whether the proposed collection of information is necessary for the proper performance of the functions of the Foundation, including whether the information will have practical utility; (b) the accuracy of the Foundation's estimate of the burden of the proposed collection of information; (c) ways to enhance the quality, utility, and clarity of the information to be collected; and (d) ways to minimize the burden of the collection of information on those who are to respond, including through the use of automated collection techniques or other forms of information technology.

Federal Register, Volume 80 Issue 39 (Friday, February 27, 2015)
[Federal Register Volume 80, Number 39 (Friday, February 27, 2015)]
[Notices]
[Pages 10724-10726]
From the Federal Register Online  [www.thefederalregister.org]
[FR Doc No: 2015-04097]


=======================================================================
-----------------------------------------------------------------------

NATIONAL SCIENCE FOUNDATION


Notice of Intent To Seek Approval To Establish an Information 
Collection

AGENCY: National Science Foundation.

ACTION: Notice and request for comments.

-----------------------------------------------------------------------

SUMMARY: Under the Paperwork Reduction Act of 1995, Public Law 104-13 
(44 U.S.C. 3501 et seq.), and as part of its continuing effort to 
reduce paperwork and respondent burden, the National Science Foundation 
(NSF) is inviting the general public and other Federal agencies to 
comment on this proposed information collection.
    Comments: Comments are invited on: (a) Whether the proposed 
collection of information is necessary for the proper performance of 
the functions of the Foundation, including whether the information will 
have practical utility; (b) the accuracy of the Foundation's estimate 
of the burden of the proposed collection of information; (c) ways to 
enhance the quality, utility, and clarity of the information to be 
collected; and (d) ways to minimize the burden of the collection of 
information on those who are to respond, including through the use of 
automated collection techniques or other forms of information 
technology.

DATES: Written comments on this notice must be received by April 28, 
2015, to be assured consideration. Comments received after that date 
will be considered to the extent practicable. Send comments to address 
below.

FOR FURTHER INFORMATION CONTACT: Ms. Suzanne H. Plimpton, Reports 
Clearance Officer, National Science Foundation, 4201 Wilson Boulevard, 
Suite 1265, Arlington, Virginia 22230; telephone (703) 292-7556; or 
send email to [email protected]. Individuals who use a 
telecommunications device for the deaf (TDD) may call the Federal 
Information Relay Service (FIRS) at 1-800-877-8339, which is accessible 
24 hours a day, 7 days a week, 365 days a year (including federal 
holidays).

SUPPLEMENTARY INFORMATION: 
    Title Of Collection: Generic Clearance of Survey Improvement 
Projects From the National Science Foundation.
    OMB Number: 3145--NEW.
    Expiration Date of Approval: Not applicable.
    Type of Request: Intent to seek approval to establish a generic 
clearance for survey improvement projects for the National Science 
Foundation.
    Abstract: The National Science Foundation (NSF) requests that the 
Office of Management and Budget (OMB) grant a generic clearance that 
will allow NSF to rigorously develop, test, and evaluate its survey 
instruments and methodologies. NSF has a mandate to ``provide a central 
clearinghouse for the collection, interpretation, and analysis of data 
on scientific and engineering resources and to provide a source of 
information for policy formulation by other agencies of the Federal 
Government.'' This request is part of an ongoing initiative to improve 
NSF surveys as recommended by both its own guidelines and those of 
OMB.\1\
---------------------------------------------------------------------------

    \1\ NSF Information Quality Guidelines are available on http://www.nsf.gov/policies/infoqual.jsp. OMB Information Quality 
Guidelines are available on http://www.whitehouse.gov/omb/inforeg/infopoltech.html. OMB standards and guidelines for statistical 
surveys are available on http://www.whitehouse.gov/omb/inforeg/statpolicy/standards_stat_surveys.pdf.
---------------------------------------------------------------------------

    In the last decade, state-of-the art data collection and analysis 
methods have been increasingly instituted by NSF and other federal 
agencies, and are now routinely used to improve the quality and 
timeliness of data and analyses. These new methods or techniques many 
times help reduce respondents' cognitive workload and burden. The 
purpose of this generic clearance is to allow NSF to continue to adopt 
and use these methods or techniques to improve its current data 
collections on science, engineering, and technology inputs, outputs and 
outcomes. They will be used to improve the content of existing surveys, 
to aid in the development of new data collections to capture changes in 
the U.S. science and engineering (S&E) enterprise, and to fill gaps in 
coverage of the S&E enterprise in the existing NSF portfolio.
    Following standard OMB requirements, NSF will submit to OMB an 
individual request for each survey improvement project it undertakes 
under this generic clearance. NSF will request OMB approval in advance 
and provide OMB with a copy of the questionnaire (if one is used) and 
materials describing the project.
    NSF envisions using a variety of survey improvement techniques, as 
appropriate to the individual projects, such as focus groups, cognitive 
and usability laboratory and field techniques, exploratory interviews, 
behavior coding, respondent debriefing, pilot studies, pretests and 
split-panel tests. NSF has used such techniques in previous activities 
conducted under generic clearances granted to individual divisions.
    a. Focus Groups. A qualitative methodology that brings together a 
small number of relatively homogenous subjects to discuss pre-
identified topics. A protocol containing questions or topics focused on 
a particular issue or issues is used to guide these sessions, and is 
administered by a trained facilitator. Focus groups are useful for 
exploring and identifying issues with either respondents or 
stakeholders. Focus groups are a good choice during the development of 
a survey or survey topic, when a pre-existing questionnaire or survey 
questions on the topic do not yet exist. NSF has used focus groups for 
several projects under the Science Resources Statistics generic 
clearance (OMB Control Number 3145-0174) to assist with redesign of 
surveys when it became evident that the content of a survey was 
outdated and did not reflect current issues or the context that 
respondents were facing.
    b. Cognitive and Usability Laboratory and Field Techniques. A 
qualitative methodology that refers to a set of tools employed to study 
and identify errors that are introduced during the survey process. 
These techniques are generally conducted by a researcher with an 
individual respondent, though observers may sometimes be present. 
Cognitive techniques are generally used to understand the question-
response process, whereas usability is generally used to understand 
respondent reactions to the features of an electronic survey 
instrument, for instance, its display and navigation. In concurrent 
interviews, respondents are asked to think aloud as they actually 
answer the survey. In retrospective interviews, respondents answer the 
survey as they would normally, then `think aloud' afterwards. Other 
techniques, which are described in the literature and which will be 
employed as appropriate include: Follow-up probing, memory cue tasks, 
paraphrasing, confidence rating, response latency measurements, free 
and dimensional sort classification tasks, and vignette 
classifications. The objective of all of these techniques is to aid in 
the development of surveys that work with respondents' thought 
processes, thus reducing response error and burden. These techniques 
are generally very useful for studying and revising a pre-existing 
questionnaire. NSF has used cognitive and usability testing in previous 
generic clearance projects (OMB Control Numbers 3145-

[[Page 10725]]

0157 and 3145-0174) to improve existing survey items, to develop and 
refine new content on existing surveys, and to explore content for new 
surveys.
    c. Exploratory Interviews. A technique where interviews are 
conducted with individuals to gather information about a topical area. 
These may be used in the very early stages of developing a new survey. 
They may cover discussions related to administrative records, subject 
matter, definitions, etc. Exploratory interviews may also be used to 
investigate whether there are sufficient issues related to an existing 
data collection to consider a redesign. NSF has used such interviews 
extensively in recordkeeping studies with respondents to several of its 
establishment surveys to determine both what types of records 
institutions keep (and therefore what types of information they can 
supply), as well as where and in what format such records are kept.
    d. Respondent Debriefing. A technique in which individuals are 
queried about how they have responded to a particular survey, question, 
or series of questions. The purpose of the debriefing is to determine 
if the original survey questions are understood as intended, to learn 
about respondents' form filling behavior and recordkeeping systems, or 
to elicit respondents' satisfaction with the survey. This information 
can then be used (especially if it is triangulated with other 
information) to improve the survey. This technique can be used as a 
qualitative or quantitative measurement, depending on how it is 
administered. This technique has been employed in NSF generic clearance 
projects (OMB Control Number 3145-0174) to identify potential problems 
with existing survey items both quantitatively (response behavior 
study, or RBS, using web survey questions with respondents to the 
Survey of Graduate Students and Post-doctorates in Science and 
Engineering, or GSS) and qualitatively (interviews using semi-
structured protocols with Higher Education R&D Survey respondents).
    e. Pilot Studies/Pretests. These methodologies are used to test a 
preliminary version of the data collection instrument, as was done with 
the Early Career Doctorate Project. Pretests are used to gather data to 
refine questionnaire items and scales and assess reliability, validity, 
or other survey measurement issues. Pilot studies are also used to test 
aspects of implementation procedures. The sample may be purposive in 
nature, or limited to particular groups for whom the information is 
most needed. Alternatively, small samples can be selected to 
statistically represent at least some aspect of the survey population.
    f. Split Panel Tests. A technique for controlled experimental 
testing of alternatives. Thus, they allow one to choose from among 
competing questions, questionnaires, definitions, error messages, 
surveys, or survey improvement methodologies with greater confidence 
than other methods alone. Split panel tests conducted during the actual 
fielding of the survey are superior in that they support both internal 
validity (controlled comparisons of variables under investigation) and 
external validity (represent the population under study). Nearly any of 
the previously mentioned survey improvement methods can be strengthened 
when teamed with this method.
    g. Behavior Coding. A quantitative technique in which a standard 
set of codes is systematically applied to respondent/interviewer 
interactions in interviewer-administered surveys or respondent/
questionnaire interactions in self-administered surveys. Though this 
technique can quantifiably identify problems with the wording of 
questions, it does not necessarily illuminate the underlying causes.
    Use of the Information: The information obtained from these efforts 
will be used to develop new NSF surveys and improve current ones. These 
surveys will generally be used to monitor outputs and outcomes of NSF 
funding over time (particularly data that is not being collected in 
annual and final reports), and manage and improve programs. Data 
collected through survey questionnaires can be used in program 
evaluation studies and can be matched to administrative data to 
understand NSF's portfolio of investments. Specifically, the 
information from the survey questionnaire improvement projects will be 
used to reduce respondent burden and to improve the quality of the data 
collected in these surveys. These objectives are met when respondents 
are presented with plain, coherent, and unambiguous questionnaires 
asking for data compatible with respondents' memory and/or current 
reporting and recordkeeping practices. The purpose of the survey 
improvement projects will be to ensure that NSF surveys are 
continuously attempting to meet these standards of excellence. Improved 
NSF surveys will help policy makers make decisions on R&D funding, 
graduate education, scientific and technical workforce, innovation, as 
well as contribute to increased agency efficiency and reduced survey 
costs. In addition, methodological findings have broader implications 
for survey research and may be presented in technical papers at 
conferences or published in the proceedings of conferences or in 
journals.
    Estimate of Burden: NSF estimates that a total reporting burden of 
171,000 hours over the three years of the requested generic clearance 
is possible from working to evaluate/improve existing surveys and to 
develop new ones. This includes both the burden placed on respondents 
participating in each activity as well as burden imposed on potential 
respondents during screening activities. Table 1 provides a list of 
potential improvement projects for which generic clearance activities 
might be conducted, along with estimates of the number of respondents 
and burden hours that might be involved in each.
---------------------------------------------------------------------------

    \2\ Number of respondents listed for any individual survey may 
represent several methodological improvement projects.

                 Table 1--Potential Improvement Projects
------------------------------------------------------------------------
                                             Number of
        Improvement project type            respondents        Hours
                                                \2\
------------------------------------------------------------------------
Cognitive Testing.......................           5,000          15,000
Focus Groups............................           5,000          10,000
Card Sorting............................           5,000           5,000
Interviews..............................           5,000           5,000
Panelist Survey.........................           7,000          12,000
Past Awardee Survey.....................           9,000          14,000
Usability Testing.......................           5,000          10,000

[[Page 10726]]

 
Additional surveys not specified........          35,000         100,000
                                         -------------------------------
    Total...............................          76,000         171,000
------------------------------------------------------------------------

    Respondents: The respondents are PIs, program coordinators, or 
participants in NSF activities.

Estimates of Annualized Cost to Respondents for the Hour Burdens

    The cost to respondents generated by the list of potential projects 
is estimated to be $3,205,680 over the three years of the clearance. No 
one year's cost would exceed $3,205,680. In other words, if all work 
were done in one year, costs in that one year would be $3,205,680 and 
the costs in each of the other 2 years would be zero. As in previous 
requests for generic clearance authority, the total cost was estimated 
by summing all the hours that might be used on all projects over the 
three years (76,000) and multiplying that figure by the hourly wage 
($42.18) of the level of employee who typically answers NSF 
questionnaires or attends NSF workshops. This wage amount is the May 
2011 national cross-industry estimate of the mean hourly wage for a 
financial analyst, or Job Category 13-2051, by the Bureau of 
Statistics. http://www.bls.gov/oes/#data. The total hours are based on 
similar NSF projects over the past few years.
    There are no capital, startup, operation or maintenance costs to 
the respondents. The costs generated by future data collections will be 
described in the clearance request for each specific data collection. 
NSF does not anticipate any capital, startup, operation, or maintenance 
costs for future surveys.

    Dated: February 23, 2015.
Suzanne H. Plimpton,
Reports Clearance Officer, National Science Foundation.
[FR Doc. 2015-04097 Filed 2-26-15; 8:45 am]
BILLING CODE 7555-01-P



                                                  10724                         Federal Register / Vol. 80, No. 39 / Friday, February 27, 2015 / Notices

                                                  accommodate the scheduling priorities                      OMB Number: 3145—NEW.                              behavior coding, respondent debriefing,
                                                  of the key participants.                                   Expiration Date of Approval: Not                   pilot studies, pretests and split-panel
                                                                                                          applicable.                                           tests. NSF has used such techniques in
                                                  Harmony R. Myers,                                          Type of Request: Intent to seek                    previous activities conducted under
                                                  Acting Advisory Committee Management                    approval to establish a generic clearance             generic clearances granted to individual
                                                  Officer, National Aeronautics and Space                 for survey improvement projects for the               divisions.
                                                  Administration.
                                                                                                          National Science Foundation.                             a. Focus Groups. A qualitative
                                                  [FR Doc. 2015–04104 Filed 2–26–15; 8:45 am]                Abstract: The National Science                     methodology that brings together a
                                                  BILLING CODE 7510–13–P                                  Foundation (NSF) requests that the                    small number of relatively homogenous
                                                                                                          Office of Management and Budget                       subjects to discuss pre-identified topics.
                                                                                                          (OMB) grant a generic clearance that                  A protocol containing questions or
                                                  NATIONAL SCIENCE FOUNDATION                             will allow NSF to rigorously develop,                 topics focused on a particular issue or
                                                                                                          test, and evaluate its survey instruments             issues is used to guide these sessions,
                                                  Notice of Intent To Seek Approval To                    and methodologies. NSF has a mandate                  and is administered by a trained
                                                  Establish an Information Collection                     to ‘‘provide a central clearinghouse for              facilitator. Focus groups are useful for
                                                        National Science Foundation.
                                                  AGENCY:                                                 the collection, interpretation, and                   exploring and identifying issues with
                                                        Notice and request for
                                                  ACTION:                                                 analysis of data on scientific and                    either respondents or stakeholders.
                                                  comments.                                               engineering resources and to provide a                Focus groups are a good choice during
                                                                                                          source of information for policy                      the development of a survey or survey
                                                  SUMMARY:    Under the Paperwork                         formulation by other agencies of the                  topic, when a pre-existing questionnaire
                                                  Reduction Act of 1995, Public Law 104–                  Federal Government.’’ This request is                 or survey questions on the topic do not
                                                  13 (44 U.S.C. 3501 et seq.), and as part                part of an ongoing initiative to improve              yet exist. NSF has used focus groups for
                                                  of its continuing effort to reduce                      NSF surveys as recommended by both                    several projects under the Science
                                                  paperwork and respondent burden, the                    its own guidelines and those of OMB.1                 Resources Statistics generic clearance
                                                  National Science Foundation (NSF) is                       In the last decade, state-of-the art data          (OMB Control Number 3145–0174) to
                                                  inviting the general public and other                   collection and analysis methods have                  assist with redesign of surveys when it
                                                  Federal agencies to comment on this                     been increasingly instituted by NSF and               became evident that the content of a
                                                  proposed information collection.                        other federal agencies, and are now                   survey was outdated and did not reflect
                                                     Comments: Comments are invited on:                   routinely used to improve the quality                 current issues or the context that
                                                  (a) Whether the proposed collection of                  and timeliness of data and analyses.                  respondents were facing.
                                                  information is necessary for the proper                 These new methods or techniques many                     b. Cognitive and Usability Laboratory
                                                  performance of the functions of the                     times help reduce respondents’                        and Field Techniques. A qualitative
                                                  Foundation, including whether the                       cognitive workload and burden. The                    methodology that refers to a set of tools
                                                  information will have practical utility;                purpose of this generic clearance is to               employed to study and identify errors
                                                  (b) the accuracy of the Foundation’s                    allow NSF to continue to adopt and use                that are introduced during the survey
                                                  estimate of the burden of the proposed                  these methods or techniques to improve                process. These techniques are generally
                                                  collection of information; (c) ways to                  its current data collections on science,              conducted by a researcher with an
                                                  enhance the quality, utility, and clarity               engineering, and technology inputs,                   individual respondent, though observers
                                                  of the information to be collected; and                 outputs and outcomes. They will be                    may sometimes be present. Cognitive
                                                  (d) ways to minimize the burden of the                  used to improve the content of existing               techniques are generally used to
                                                  collection of information on those who                  surveys, to aid in the development of                 understand the question-response
                                                  are to respond, including through the                   new data collections to capture changes               process, whereas usability is generally
                                                  use of automated collection techniques                  in the U.S. science and engineering                   used to understand respondent
                                                  or other forms of information                           (S&E) enterprise, and to fill gaps in                 reactions to the features of an electronic
                                                  technology.                                             coverage of the S&E enterprise in the                 survey instrument, for instance, its
                                                                                                          existing NSF portfolio.                               display and navigation. In concurrent
                                                  DATES: Written comments on this notice
                                                                                                             Following standard OMB                             interviews, respondents are asked to
                                                  must be received by April 28, 2015, to                                                                        think aloud as they actually answer the
                                                  be assured consideration. Comments                      requirements, NSF will submit to OMB
                                                                                                          an individual request for each survey                 survey. In retrospective interviews,
                                                  received after that date will be                                                                              respondents answer the survey as they
                                                  considered to the extent practicable.                   improvement project it undertakes
                                                                                                          under this generic clearance. NSF will                would normally, then ‘think aloud’
                                                  Send comments to address below.                                                                               afterwards. Other techniques, which are
                                                  FOR FURTHER INFORMATION CONTACT: Ms.
                                                                                                          request OMB approval in advance and
                                                                                                          provide OMB with a copy of the                        described in the literature and which
                                                  Suzanne H. Plimpton, Reports Clearance                                                                        will be employed as appropriate
                                                  Officer, National Science Foundation,                   questionnaire (if one is used) and
                                                                                                          materials describing the project.                     include: Follow-up probing, memory
                                                  4201 Wilson Boulevard, Suite 1265,                                                                            cue tasks, paraphrasing, confidence
                                                                                                             NSF envisions using a variety of
                                                  Arlington, Virginia 22230; telephone                                                                          rating, response latency measurements,
                                                                                                          survey improvement techniques, as
                                                  (703) 292–7556; or send email to                                                                              free and dimensional sort classification
                                                                                                          appropriate to the individual projects,
                                                  splimpto@nsf.gov. Individuals who use                                                                         tasks, and vignette classifications. The
                                                                                                          such as focus groups, cognitive and
                                                  a telecommunications device for the                                                                           objective of all of these techniques is to
                                                                                                          usability laboratory and field
                                                  deaf (TDD) may call the Federal                                                                               aid in the development of surveys that
                                                                                                          techniques, exploratory interviews,
                                                  Information Relay Service (FIRS) at 1–
mstockstill on DSK4VPTVN1PROD with NOTICES




                                                                                                                                                                work with respondents’ thought
                                                  800–877–8339, which is accessible 24                      1 NSF Information Quality Guidelines are            processes, thus reducing response error
                                                  hours a day, 7 days a week, 365 days a                  available on http://www.nsf.gov/policies/             and burden. These techniques are
                                                  year (including federal holidays).                      infoqual.jsp. OMB Information Quality Guidelines      generally very useful for studying and
                                                  SUPPLEMENTARY INFORMATION:                              are available on http://www.whitehouse.gov/omb/       revising a pre-existing questionnaire.
                                                                                                          inforeg/infopoltech.html. OMB standards and
                                                     Title Of Collection: Generic Clearance               guidelines for statistical surveys are available on
                                                                                                                                                                NSF has used cognitive and usability
                                                  of Survey Improvement Projects From                     http://www.whitehouse.gov/omb/inforeg/statpolicy/     testing in previous generic clearance
                                                  the National Science Foundation.                        standards_stat_surveys.pdf.                           projects (OMB Control Numbers 3145–


                                             VerDate Sep<11>2014   18:05 Feb 26, 2015   Jkt 235001   PO 00000   Frm 00065   Fmt 4703   Sfmt 4703   E:\FR\FM\27FEN1.SGM   27FEN1


                                                                                           Federal Register / Vol. 80, No. 39 / Friday, February 27, 2015 / Notices                                                                               10725

                                                  0157 and 3145–0174) to improve                                                 e. Pilot Studies/Pretests. These                                          is not being collected in annual and
                                                  existing survey items, to develop and                                       methodologies are used to test a                                             final reports), and manage and improve
                                                  refine new content on existing surveys,                                     preliminary version of the data                                              programs. Data collected through survey
                                                  and to explore content for new surveys.                                     collection instrument, as was done with                                      questionnaires can be used in program
                                                     c. Exploratory Interviews. A technique                                   the Early Career Doctorate Project.                                          evaluation studies and can be matched
                                                  where interviews are conducted with                                         Pretests are used to gather data to refine                                   to administrative data to understand
                                                  individuals to gather information about                                     questionnaire items and scales and                                           NSF’s portfolio of investments.
                                                  a topical area. These may be used in the                                    assess reliability, validity, or other                                       Specifically, the information from the
                                                  very early stages of developing a new                                       survey measurement issues. Pilot                                             survey questionnaire improvement
                                                  survey. They may cover discussions                                          studies are also used to test aspects of                                     projects will be used to reduce
                                                  related to administrative records,                                          implementation procedures. The sample                                        respondent burden and to improve the
                                                  subject matter, definitions, etc.                                           may be purposive in nature, or limited                                       quality of the data collected in these
                                                  Exploratory interviews may also be used                                     to particular groups for whom the                                            surveys. These objectives are met when
                                                  to investigate whether there are                                            information is most needed.                                                  respondents are presented with plain,
                                                  sufficient issues related to an existing                                    Alternatively, small samples can be                                          coherent, and unambiguous
                                                  data collection to consider a redesign.                                     selected to statistically represent at least
                                                                                                                                                                                                           questionnaires asking for data
                                                  NSF has used such interviews                                                some aspect of the survey population.
                                                  extensively in recordkeeping studies                                           f. Split Panel Tests. A technique for                                     compatible with respondents’ memory
                                                  with respondents to several of its                                          controlled experimental testing of                                           and/or current reporting and
                                                  establishment surveys to determine both                                     alternatives. Thus, they allow one to                                        recordkeeping practices. The purpose of
                                                  what types of records institutions keep                                     choose from among competing                                                  the survey improvement projects will be
                                                  (and therefore what types of information                                    questions, questionnaires, definitions,                                      to ensure that NSF surveys are
                                                  they can supply), as well as where and                                      error messages, surveys, or survey                                           continuously attempting to meet these
                                                  in what format such records are kept.                                       improvement methodologies with                                               standards of excellence. Improved NSF
                                                     d. Respondent Debriefing. A                                              greater confidence than other methods                                        surveys will help policy makers make
                                                  technique in which individuals are                                          alone. Split panel tests conducted                                           decisions on R&D funding, graduate
                                                  queried about how they have responded                                       during the actual fielding of the survey                                     education, scientific and technical
                                                  to a particular survey, question, or series                                 are superior in that they support both                                       workforce, innovation, as well as
                                                  of questions. The purpose of the                                            internal validity (controlled                                                contribute to increased agency
                                                  debriefing is to determine if the original                                  comparisons of variables under                                               efficiency and reduced survey costs. In
                                                  survey questions are understood as                                          investigation) and external validity                                         addition, methodological findings have
                                                  intended, to learn about respondents’                                       (represent the population under study).                                      broader implications for survey research
                                                  form filling behavior and recordkeeping                                     Nearly any of the previously mentioned                                       and may be presented in technical
                                                  systems, or to elicit respondents’                                          survey improvement methods can be                                            papers at conferences or published in
                                                  satisfaction with the survey. This                                          strengthened when teamed with this                                           the proceedings of conferences or in
                                                  information can then be used (especially                                    method.                                                                      journals.
                                                  if it is triangulated with other                                               g. Behavior Coding. A quantitative
                                                                                                                                                                                                              Estimate of Burden: NSF estimates
                                                  information) to improve the survey.                                         technique in which a standard set of
                                                                                                                                                                                                           that a total reporting burden of 171,000
                                                  This technique can be used as a                                             codes is systematically applied to
                                                  qualitative or quantitative measurement,                                    respondent/interviewer interactions in                                       hours over the three years of the
                                                  depending on how it is administered.                                        interviewer-administered surveys or                                          requested generic clearance is possible
                                                  This technique has been employed in                                         respondent/questionnaire interactions                                        from working to evaluate/improve
                                                  NSF generic clearance projects (OMB                                         in self-administered surveys. Though                                         existing surveys and to develop new
                                                  Control Number 3145–0174) to identify                                       this technique can quantifiably identify                                     ones. This includes both the burden
                                                  potential problems with existing survey                                     problems with the wording of questions,                                      placed on respondents participating in
                                                  items both quantitatively (response                                         it does not necessarily illuminate the                                       each activity as well as burden imposed
                                                  behavior study, or RBS, using web                                           underlying causes.                                                           on potential respondents during
                                                  survey questions with respondents to                                           Use of the Information: The                                               screening activities. Table 1 provides a
                                                  the Survey of Graduate Students and                                         information obtained from these efforts                                      list of potential improvement projects
                                                  Post-doctorates in Science and                                              will be used to develop new NSF                                              for which generic clearance activities
                                                  Engineering, or GSS) and qualitatively                                      surveys and improve current ones.                                            might be conducted, along with
                                                  (interviews using semi-structured                                           These surveys will generally be used to                                      estimates of the number of respondents
                                                  protocols with Higher Education R&D                                         monitor outputs and outcomes of NSF                                          and burden hours that might be
                                                  Survey respondents).                                                        funding over time (particularly data that                                    involved in each.

                                                                                                                       TABLE 1—POTENTIAL IMPROVEMENT PROJECTS
                                                                                                                                                                                                                                   Number of
                                                                                                                    Improvement project type                                                                                                     Hours
                                                                                                                                                                                                                                 respondents 2

                                                  Cognitive Testing .....................................................................................................................................................                5,000      15,000
                                                  Focus Groups ..........................................................................................................................................................                5,000      10,000
mstockstill on DSK4VPTVN1PROD with NOTICES




                                                  Card Sorting .............................................................................................................................................................             5,000       5,000
                                                  Interviews .................................................................................................................................................................           5,000       5,000
                                                  Panelist Survey ........................................................................................................................................................               7,000      12,000
                                                  Past Awardee Survey ..............................................................................................................................................                     9,000      14,000
                                                  Usability Testing ......................................................................................................................................................               5,000      10,000



                                                    2 Number of respondents listed for any individual

                                                  survey may represent several methodological
                                                  improvement projects.

                                             VerDate Sep<11>2014         18:05 Feb 26, 2015          Jkt 235001       PO 00000       Frm 00066        Fmt 4703       Sfmt 4703       E:\FR\FM\27FEN1.SGM              27FEN1


                                                  10726                                    Federal Register / Vol. 80, No. 39 / Friday, February 27, 2015 / Notices

                                                                                                           TABLE 1—POTENTIAL IMPROVEMENT PROJECTS—Continued
                                                                                                                                                                                                                                     Number of
                                                                                                                    Improvement project type                                                                                                       Hours
                                                                                                                                                                                                                                   respondents 2

                                                  Additional surveys not specified ..............................................................................................................................                         35,000     100,000
                                                        Total ..................................................................................................................................................................          76,000     171,000



                                                    Respondents: The respondents are                                          ACTION: Environmental assessment and                                          Safety and Safeguards, U.S. Nuclear
                                                  PIs, program coordinators, or                                               finding of no significant impact;                                             Regulatory Commission, Washington,
                                                  participants in NSF activities.                                             issuance.                                                                     DC 20555–0001; telephone: 301–415–
                                                                                                                                                                                                            5137, email: Jean.Trefethen@nrc.gov.
                                                  Estimates of Annualized Cost to                                             SUMMARY:   The U.S. Nuclear Regulatory
                                                  Respondents for the Hour Burdens                                                                                                                          SUPPLEMENTARY INFORMATION:
                                                                                                                              Commission (NRC) is considering a
                                                                                                                              license amendment request for the                                             I. Introduction
                                                     The cost to respondents generated by
                                                                                                                              Special Nuclear Materials (SNM)                                                  The NRC is considering a license
                                                  the list of potential projects is estimated
                                                                                                                              License SNM–2507 for the North Anna                                           amendment request for Special Nuclear
                                                  to be $3,205,680 over the three years of
                                                                                                                              Power Station (NA) independent spent                                          Materials License Number SNM–2507
                                                  the clearance. No one year’s cost would
                                                                                                                              fuel storage installation (ISFSI) located                                     for the NA ISFSI located in Louisa
                                                  exceed $3,205,680. In other words, if all
                                                                                                                              in Louisa County, Virginia.                                                   County, Virginia (ADAMS Accession
                                                  work were done in one year, costs in
                                                                                                                              DATES: The environmental assessment                                           No. ML14160A707). The applicant,
                                                  that one year would be $3,205,680 and
                                                  the costs in each of the other 2 years                                      and finding of no significant impact                                          Virginia Electric and Power Company
                                                  would be zero. As in previous requests                                      referenced in this document are                                               (Dominion), is proposing to amend
                                                  for generic clearance authority, the total                                  available on February 27, 2015.                                               Technical Specifications (TS) 4.2.3,
                                                  cost was estimated by summing all the                                       ADDRESSES: Please refer to Docket ID                                          ‘‘Storage Pad,’’ to define the minimum
                                                  hours that might be used on all projects                                    NRC–2014–0154 when contacting the                                             center-to-center spacing for
                                                  over the three years (76,000) and                                           NRC about the availability of                                                 Transnuclear-32 spent nuclear fuel
                                                  multiplying that figure by the hourly                                       information regarding this document.                                          storage casks, with heat loads no greater
                                                  wage ($42.18) of the level of employee                                      You may obtain publicly-available                                             than 27.1 kilowatts (kW), from 16 feet
                                                  who typically answers NSF                                                   information related to this document                                          (feet) to 14 feet. The NRC staff has
                                                  questionnaires or attends NSF                                               using any of the following methods:                                           prepared a final environmental
                                                  workshops. This wage amount is the                                             • Federal Rulemaking Web site: Go to                                       assessment (EA) as part of its review of
                                                  May 2011 national cross-industry                                            http://www.regulations.gov and search                                         this proposed license amendment in
                                                  estimate of the mean hourly wage for a                                      for Docket ID NRC–2014–0154. Address                                          accordance with the requirements in
                                                  financial analyst, or Job Category 13–                                      questions about NRC dockets to Carol                                          part 51 of Title 10 of the Code of Federal
                                                  2051, by the Bureau of Statistics.                                          Gallagher; telephone: 301–415–3463;                                           Regulations (10 CFR). Based on the final
                                                  http://www.bls.gov/oes/#data. The total                                     email: Carol.Gallagher@nrc.gov. For                                           EA, the NRC has determined that a
                                                  hours are based on similar NSF projects                                     technical questions, contact the                                              Finding of No Significant Impact
                                                  over the past few years.                                                    individual listed in the FOR FURTHER                                          (FONSI) is appropriate. The NRC is also
                                                                                                                              INFORMATION CONTACT section of this                                           conducting a safety evaluation of the
                                                     There are no capital, startup,                                           document.
                                                  operation or maintenance costs to the                                                                                                                     proposed license amendment pursuant
                                                                                                                                 • NRC’s Agencywide Documents                                               to 10 CFR part 72, and the results will
                                                  respondents. The costs generated by                                         Access and Management System
                                                  future data collections will be described                                                                                                                 be documented in a separate Safety
                                                                                                                              (ADAMS): You may obtain publicly-                                             Evaluation Report (SER). If Dominion’s
                                                  in the clearance request for each specific                                  available documents online in the
                                                  data collection. NSF does not anticipate                                                                                                                  request is approved, the NRC will issue
                                                                                                                              ADAMS Public Documents collection at                                          the license amendment following
                                                  any capital, startup, operation, or                                         http://www.nrc.gov/reading-rm/
                                                  maintenance costs for future surveys.                                                                                                                     publication of this final EA and FONSI
                                                                                                                              adams.html. To begin the search, select                                       and the SER.
                                                    Dated: February 23, 2015.                                                 ‘‘ADAMS Public Documents’’ and then
                                                  Suzanne H. Plimpton,                                                        select ‘‘Begin Web-based ADAMS                                                II. Final Environmental Assessment
                                                                                                                              Search.’’ For problems with ADAMS,                                            Summary
                                                  Reports Clearance Officer, National Science
                                                  Foundation.                                                                 please contact the NRC’s Public                                                  On August 23, 2011, during an
                                                  [FR Doc. 2015–04097 Filed 2–26–15; 8:45 am]                                 Document Room (PDR) reference staff at                                        earthquake centered in Mineral,
                                                  BILLING CODE 7555–01–P                                                      1–800–397–4209, 301–415–4737, or by                                           Virginia, 25 of 27 of the Transnuclear-
                                                                                                                              email to pdr.resource@nrc.gov. The                                            32 casks on NA ISFSI Pad I shifted from
                                                                                                                              ADAMS accession number for each                                               their original positions. The shifting
                                                                                                                              document referenced in this document                                          changed the center-to-center spacing of
                                                  NUCLEAR REGULATORY                                                          (if that document is available in                                             the casks from 16 feet to a range of 15
                                                  COMMISSION                                                                  ADAMS) is provided the first time that                                        feet 2.25 inches to 16 feet 11.25 inches.
                                                                                                                              a document is referenced.
mstockstill on DSK4VPTVN1PROD with NOTICES




                                                                                                                                                                                                            Dominion is proposing to amend SNM–
                                                  [Docket No. 72–16; NRC–2014–0154]
                                                                                                                                 • NRC’s PDR: You may examine and                                           2507 TS 4.2.3, which would change the
                                                                                                                              purchase copies of public documents at                                        allowable distance between individual
                                                  North Anna Power Station Independent                                        the NRC’s PDR, Room O1–F21, One                                               casks (center-to-center) from a nominal
                                                  Spent Fuel Storage Installation                                             White Flint North, 11555 Rockville                                            16 feet to a minimum of 14 feet for those
                                                                                                                              Pike, Rockville, Maryland 20852.                                              casks with heat loads no greater than
                                                  AGENCY:Nuclear Regulatory                                                   FOR FURTHER INFORMATION CONTACT: Jean                                         27.1 kW. Dominion is requesting this
                                                  Commission.                                                                 Trefethen, Office of Nuclear Material                                         license amendment in lieu of moving


                                             VerDate Sep<11>2014         18:05 Feb 26, 2015          Jkt 235001       PO 00000        Frm 00067        Fmt 4703       Sfmt 4703       E:\FR\FM\27FEN1.SGM               27FEN1



Document Created: 2015-12-18 13:14:39
Document Modified: 2015-12-18 13:14:39
CategoryRegulatory Information
CollectionFederal Register
sudoc ClassAE 2.7:
GS 4.107:
AE 2.106:
PublisherOffice of the Federal Register, National Archives and Records Administration
SectionNotices
ActionNotice and request for comments.
DatesWritten comments on this notice must be received by April 28, 2015, to be assured consideration. Comments received after that date
ContactMs. Suzanne H. Plimpton, Reports Clearance Officer, National Science Foundation, 4201 Wilson Boulevard, Suite 1265, Arlington, Virginia 22230; telephone (703) 292-7556; or send email to [email protected] Individuals who use a telecommunications device for the deaf (TDD) may call the Federal Information Relay Service (FIRS) at 1-800-877-8339, which is accessible 24 hours a day, 7 days a week, 365 days a year (including federal holidays).
FR Citation80 FR 10724 

2025 Federal Register | Disclaimer | Privacy Policy
USC | CFR | eCFR