83_FR_57714 83 FR 57493 - Family Self-Sufficiency Performance Measurement System (“Composite Score”)

83 FR 57493 - Family Self-Sufficiency Performance Measurement System (“Composite Score”)

DEPARTMENT OF HOUSING AND URBAN DEVELOPMENT

Federal Register Volume 83, Issue 221 (November 15, 2018)

Page Range57493-57500
FR Document2018-24949

This notice describes and responds to comments on a performance measurement system that HUD plans to implement for Public Housing Agencies (PHAs) that receive HUD Family Self-Sufficiency (FSS) program coordinator grants. The desired effect of this notice is to notify the public regarding the criteria for evaluating FSS programs.

Federal Register, Volume 83 Issue 221 (Thursday, November 15, 2018)
[Federal Register Volume 83, Number 221 (Thursday, November 15, 2018)]
[Notices]
[Pages 57493-57500]
From the Federal Register Online  [www.thefederalregister.org]
[FR Doc No: 2018-24949]


=======================================================================
-----------------------------------------------------------------------

DEPARTMENT OF HOUSING AND URBAN DEVELOPMENT

[Docket No. FR-6046-N-02]


Family Self-Sufficiency Performance Measurement System 
(``Composite Score'')

AGENCY: Office of Public and Indian Housing, HUD.

ACTION: Notice of new performance measurement system (``Composite 
Score'') for the Family Self-Sufficiency Program.

-----------------------------------------------------------------------

SUMMARY: This notice describes and responds to comments on a 
performance measurement system that HUD plans to implement for Public 
Housing Agencies (PHAs) that receive HUD Family Self-Sufficiency (FSS) 
program coordinator grants. The desired effect of this notice is to 
notify the public regarding the criteria for evaluating FSS programs.

DATES: Applicability Date: December 17, 2018.

FOR FURTHER INFORMATION CONTACT: Questions on this notice may be 
addressed to [email protected] or by contacting Anice Chenault at 502-618-
8163 (email strongly preferred).
    Electronic Data Availability. This Federal Register notice and a 
spreadsheet containing scores using the methodology for FSS programs 
funded in any of the last three years will be available electronically 
from the HUD FSS web page: https://www.hud.gov/program_offices/public_indian_housing/programs/hcv/fss. Federal Register notices also 
are available electronically at https://www.federalregister.gov/, the 
U.S. Government Printing Office website.

SUPPLEMENTARY INFORMATION: 

I. Background

    On December 12, 2017, HUD published a notice in the Federal 
Register (FR-6046-N-01, 82 FR 58434) (2017 Notice) describing and 
requesting comment on a performance measurement system that HUD plans 
to implement for public housing agencies (PHAs) that receive HUD Family 
Self Sufficiency (FSS) program coordinator grants. Through this notice, 
HUD is implementing the FSS performance measurement system, as proposed 
in the 2017 Notice. Additionally, in response to public comments, HUD 
is revising the methodology it uses to compute FSS Performance Scores 
under the new system; these revisions are described below, in section 
III of this notice. Henceforth, HUD will use the new system to evaluate 
the performance of PHAs receiving HUD program coordinator funding in a 
strictly advisory manner. Beginning with Fiscal Year (FY) 2019 
appropriations, HUD intends to use the performance measurement system 
in the determination of FSS funding awards. The complete, updated 
methodology can be found on HUD's website at: https://www.hud.gov/program_offices/public_indian_housing/programs/hcv/fss.
    Under section 23(i) of the Housing Act of 1937 (42 U.S.C. 
1437u(i)), HUD is required to establish criteria to evaluate eligible 
entities' implementation of local FSS programs. HUD has developed this 
new FSS performance measurement system to provide HUD, Congress, public 
housing agencies (PHAs), and other eligible entities with information 
on the performance of individual FSS programs. The information will 
help grantees determine how their programs compare to others across the 
country in efforts to help participants to successfully graduate from 
the program and make progress toward economic security. The information 
will also help HUD understand the extent to which FSS program 
performance--individually and collectively--improves or declines over 
time.
    Initially, HUD plans to use the performance measures to identify 
high performing and low performing FSS programs, which could inform its 
understanding of best practices and its delivery of technical 
assistance. Toward these goals, at least once per year, HUD will 
analyze data collected through the Public Housing Information Center 
(PIC) to calculate FSS performance scores for each FSS program that 
received an FSS coordinator grant in one or more of the past three 
fiscal year NOFA competitions. Beginning in Fiscal Year 2019, HUD plans 
to consider the FSS performance score of an FSS program in determining 
FSS funding awards.
    HUD developed the approach described in this Notice based in part 
on feedback received on an earlier performance measurement approach 
proposed in the FY 2014 FSS Notice of Funding Availability (NOFA). In 
the FY 2014 NOFA, HUD proposed, and asked for feedback on, evaluating 
FSS programs based on the share of FSS participants that experience an 
increase in earned income (also known as ``earnings growth'') over a 
specified time period. Some commenters raised concerns that this 
approach did not adequately account for differences in local economic 
conditions and differences in the approaches of local FSS programs. 
While some FSS programs encourage participants to increase their 
earnings immediately, others encourage FSS participants to build skills 
and credentials first and then seek higher paying jobs. The FSS 
performance measurement system proposed in the December 2017 Notice was 
developed to address these issues, as well as many others, and to allow 
for a more nuanced evaluation of the performance of local FSS programs.
    A PHA's FSS performance score will be calculated based on three 
measures, weighted as follows:
    A. Earnings Performance Measure (50 percent);
    B. FSS Graduation Rate (30 percent);
    C. Participation Rate (20 percent).
    HUD has selected these measures because they are important 
indicators of program performance and are verifiable using the data HUD 
collects through the PIC data system. No outside or additional 
reporting will be required, which ensures that the system will not 
increase the reporting burden of PHAs. No new Paperwork Reduction Act 
(PRA) Information Collection will be required for the scoring, as 
proposed.
    The Earnings Performance Measure represents the difference between 
the

[[Page 57494]]

earnings growth of FSS participants and the earnings growth of similar 
non-FSS households assisted by the PHA within a specified time frame. 
This approach, along with a statistical adjustment described below, 
helps to control for variations in local economic conditions. The 
program was envisioned and designed for the purpose of increasing 
employment and earnings for its participants. Therefore, the 
performance score assigns the Earnings Performance Measure a high 
weight.
    HUD has assigned the next highest weight to the Graduation Rate 
indicator--which represents the rate of FSS participants who 
successfully ``graduate'' from the program--to encourage PHAs to work 
closely with individual FSS participants to increase graduation rates. 
To graduate from FSS, a participant must be employed, be independent of 
cash welfare assistance for at least one year, and achieve the other 
goals set forth in the participant's contract of participation.
    Finally, the FSS performance score looks at the local program's 
Participation Rate, which reflects the extent to which a PHA exceeds 
the minimum number of households that HUD requires the PHA to serve as 
a condition of receiving an FSS grant. PHAs with higher Participation 
Rates are serving more households than required, which is a desired 
output, provided the PHAs are serving those households effectively. 
Because the Earnings Performance Measure is weighted more heavily than 
the Participation Rate, however, PHAs should be careful not to execute 
more Contracts of Participation than they can serve effectively, 
because doing so would likely reduce their scores on the Earnings 
Performance Measure. Together, the Earnings Performance Measure, 
Graduation Rate, and Participation Rate are expected to provide a 
balanced measurement of the performance of an individual FSS program.
    As indicated in the 2017 Notice soliciting public comment, HUD does 
not intend to use this performance measurement system for Tribes/
Tribally Designated Housing Entities (TDHEs), who do not report into 
Public and Indian Housing Information Center (PIC), or for PHAs with a 
Moving to Work (MTW) designation, as they report differently into PIC, 
using Form HUD-50058-MTW. However, HUD is presently exploring a change 
to the reporting processes for MTW agencies, in order to include them 
in the FSS performance scoring process. Nor does HUD intend, after 
considering public comment, to use this performance measurement system 
for unfunded PHAs, and PHAs and private owners that serve Project-based 
Rental Assistance (PBRA) residents at this time.\1\ The Agency will 
continue to explore options for modifying the scoring system for those 
sub-groups.
---------------------------------------------------------------------------

    \1\ Section 306 of the Economic Growth, Regulatory Relief, and 
Consumer Protection Act (Pub. L. 115-174, Approved May 24, 2018) 
amended the United States Housing Act of 1937. Among various 
provisions, this law extended FSS program eligibility to tenants of 
certain privately-owned properties subsidized with project-based 
rental assistance (PBRA).
---------------------------------------------------------------------------

II. HUD's Responses to Public Comments

    HUD received 68 unique public comments on the planned measures, 
which are summarized below along with HUD's responses. HUD's responses 
to comments are organized into five categories: (A) Overall Comments; 
(B) Comments on Earnings Performance Measure; (C) Comments on FSS 
Graduation Rate Measure; (D) Comments on Participation Rate Measure; 
and (E) Comments on Weighting of the Measures. At the conclusion of 
this Notice, in Section III., Final Thresholds, HUD provides the final 
FSS performance measurement system thresholds that it intends to adopt 
to calculate FSS performance scores.

A. Overall Comments

    1. Comment: Data Quality. Many commenters raised concerns about the 
quality of data from the PIC system used to calculate the FSS 
performance scores, particularly with regard to data entered prior to 
HUD's 2016 guidance. Some requested that PHAs be allowed to examine and 
correct all data used for calculating their measures prior to HUD 
calculating the FSS performance measures. Others suggested that this 
might not be possible or that there would not be resources to correct 
the data.
    HUD Response: Data Quality. On May 6, 2016, HUD issued PIH Notice 
2016-08 to help PHAs understand how to submit timely and accurate PIC 
data regarding FSS, along with a series of webinars to help PHAs apply 
the guidance to improve their PIC data quality for both current and 
past participants. Further, HUD has emphasized the importance of PHAs 
submitting accurate PIC data for many years. HUD believes it is 
reasonable to rely on existing PIC data in calculating FSS performance 
scores.
    It is important to note that each time the FSS performance scores 
are calculated, HUD will retrieve a new data report from the PIC 
system. This ensures that if a PHA has made changes to improve the 
accuracy of its reporting on any metric, for current or past 
participants, all of these changes will be reflected in its performance 
score.
    2. Comment: Limitations on Included Measures. Many commenters 
expressed the view that the measures in the planned performance 
measurement system do not address the variations in participants' 
goals. Some participants or programs may have interim goals related to 
addressing barriers to work (e.g., treating psychiatric illness or 
barriers, accessing medical care, securing childcare, or completing 
training, or education), which would not immediately result in higher 
earnings, even if participants make important progress. Several 
commenters suggested that participation in/provision of services or 
progress toward Individual Training and Services Plan (ITSP) goals 
should be included as a measure. Some suggested that changes in 
educational attainment also be included as a measure.
    Several commenters also stated that inputs and outputs should be 
included in the measures, such as the work associated with serving 
participants, meeting with participants, connecting participants to 
services, making referrals, etc. Some indicated that, without these 
measures, they are not given adequate ``credit'' for serving high-needs 
participants or that they may be penalized for participant performance 
issues that are beyond their control (through the earnings and FSS 
graduation measures).
    HUD Response: Limitations on Included Measures. HUD agrees that 
there is tremendous variety in the ITSP goals of individual FSS 
participants, which go beyond the statutorily mandated goals of 
employment and being welfare-free. It is precisely this variety, 
however, that makes these goals extremely difficult to factor into a 
performance measurement system. Since each ITSP is set up individually, 
it would be both impracticable and unwise to standardize ITSP goals 
across all programs. While HUD could potentially measure the share of 
ITSP goals achieved for each participant, this would not represent a 
direct comparison across local FSS programs if some programs set goals 
that were easy to attain while others set more difficult targets. This 
approach could also create an incentive for PHAs to change how they are 
defining individuals' goals to increase their FSS performance scores, 
without necessarily improving outcomes for participants. Finally, HUD 
does not currently collect data on the

[[Page 57495]]

goals set nor the share of ITSP goals that participants attain, so the 
inclusion of ITSP goal data in a performance measurement system for FSS 
would require additional reporting by PHAs, which would add to their 
administrative burden.
    HUD recognizes the importance and value of setting a range of goals 
for participants, including goals other than employment. Over time, 
however, HUD believes the achievement of these goals will support the 
ultimate goal of the program, which is increased earnings, which will 
then be captured in the performance measurement system. This is one of 
the benefits of having five (or more) years to work with participants. 
The long duration of the FSS program provides PHAs an opportunity to 
work with participants on a range of issues--including education, 
training, work readiness, etc.--that will, over time, contribute to 
earnings gains that can be measured and reflected in the FSS 
performance measurement system. The earnings and FSS graduation rate 
measures accommodate this long time-frame, examining data for FSS 
participants that entered the program as far back as 7.5 to 8 years 
ago, respectively.
    3. Comment: Homeownership. A few commenters expressed concern that 
the measures do not support homeownership goals for FSS participants 
and stated that progress toward homeownership should be included as a 
measure in the performance measurement system.
    HUD Response: Homeownership. HUD commends PHAs that work with 
participants on homeownership and recognizes that the achievement of 
homeownership is an important outcome for many FSS participants. At the 
same time, it is clear that homeownership is a more realistic goal in 
some parts of the U.S. than others, due to variations in the local 
economy. This makes it difficult and inequitable to use homeownership 
as a performance measure in comparing FSS programs on a national basis.
    4. Comment: Reliance on Past Performance Data. Some commenters 
opined that it is unfair to base an assessment of FSS performance on 
data from prior periods during which FSS coordinators were unaware of 
the performance measures and could not change their programs 
accordingly.
    HUD Response: Reliance on Past Performance Data. The performance 
measurement system recognizes that it takes considerable time for an 
individual FSS participant to make material progress in increasing his 
or her earnings and to graduate from the program. This requires 
measurements that span years, rather than months. To implement such a 
system prospectively, without relying on data from prior periods, would 
require HUD to wait many years before having valid measures of FSS 
program performance. Such a delay would undermine HUD's ability to 
achieve the key purposes of the FSS performance measurement system. In 
order to ensure that FSS funds are spent responsibly and that FSS 
participants have access to high-quality programs, HUD needs the 
ability to recognize the achievements of high-performing FSS programs 
and identify struggling FSS programs in need of improvement.
    The goals of improving earnings and helping FSS participants 
graduate successfully from the program should not come as a surprise to 
PHAs administering FSS programs. These goals have been clear since the 
program's inception and NOFAs have been announcing HUD's intent to use 
increased earnings as an evaluation metric since FY 2014. The 
participation rate also should not come as a surprise to PHAs, as HUD 
has historically based funding decisions on the number of FSS families 
served by PHAs. HUD's interest in PHAs serving more families (so long 
as they can do so without undermining earnings growth and FSS 
graduation rates), as reflected in the participation rate, is a factor 
that PHAs can influence going forward by adjusting their caseloads.
    5. Comment: Real-Time Data. Some commenters requested a way to 
monitor their programs' progress with respect to the measures 
periodically or in real time.
    HUD Response: Real-Time Data. HUD plans to provide updated scores 
at least once each year so PHAs can track their progress. In addition, 
PHAs can calculate their own participation rates and FSS graduation 
rates at any time.
    6. Comment: Small PHAs/Small FSS Programs. Several commenters 
raised the concern that the measures could disadvantage small PHAs or 
small FSS programs because volatility in the data would be more likely 
and factors beyond the FSS program's control could drive results.
    HUD Response: Small PHAs/Small FSS Programs. HUD recognizes that 
there may be greater volatility in the data for small FSS programs, 
which could be affected by the outcomes for one or more participants 
with unusual characteristics or experiences. Accordingly, in assigning 
earnings scores, HUD has built in protection for small FSS programs by 
using a test of statistical significance that makes it more difficult 
for smaller FSS programs than larger programs to receive a zero (0) 
score on the earnings measure. See the Dec. 12, 2017 Federal Register 
Notice (at page 82 FR 58437) for more details on the statistical test.
    HUD has also examined the FSS performance composite scores of PHAs 
to determine if small programs systematically receive lower composite 
scores and determined that, there is not a strong relationship between 
program size and composite FSS performance score. In fact, the decile 
of PHAs with the second smallest FSS programs (10th through 19th 
percentile) had the second highest median composite scores of any 
decile (the highest was the group of PHAs in the 70th through the 79th 
percentile in size). PHAs with the very smallest FSS programs (0 to 9th 
percentile) did have the lowest median composite score, but the next 
lowest score was recorded by PHAs in the 80th to 89th percentile in 
size. This is an indication that there is not a strong relationship 
between program size and composite FSS performance score. However, HUD 
may continue to monitor scores to determine if there are any patterns 
that might help with the targeting of technical assistance efforts or 
the interpretation of performance data.
    7. Comment: Joint Applicants. One commenter suggested that it would 
be more appropriate to pool joint applicant data for all measures, not 
just for participation.
    HUD Response: Joint Applicants. HUD agrees, and is changing the 
methodology accordingly.
    8. Comment: Initial Funding Period. Some commenters thought that 
FSS programs should not be assessed during their initial 12-month 
funding period or directly after receiving additional funding for the 
first time.
    HUD Response: Initial Funding Period. HUD agrees with the need to 
be careful in interpreting the FSS performance scores of newly funded 
FSS programs and will take this into account in determining how to use 
the scores. However, HUD believes it is important to measure the 
performance of all FSS programs that receive HUD coordinator funding so 
that programs have a way of tracking their performance over time. Also, 
since HUD has not funded new applicants in several years, all PHAs 
currently being scored have had programs funded since at least FY2012.
    9. Comment: Minimum Standards. A few commenters said that HUD 
should consider setting minimum standards for performance rather than 
rating FSS programs on a curve.

[[Page 57496]]

    HUD Response: Minimum Standards. FSS programs will not be graded on 
a curve, but rather based on whether or not they exceed the specific 
fixed standards (or thresholds) adopted in the final FSS performance 
measures. While HUD used percentiles of the distribution to determine 
the initial thresholds for each score, those thresholds have now been 
fixed. This means that over time, a PHA's scores may move up or down, 
based on where the PHA's earnings, FSS graduation, and participation 
measures fall relative to the thresholds. In other words, a PHA's 
performance will determine in which performance category the PHA falls, 
since there is not a set number of ``high'' or ``low'' performers.
    10. Comment: Zero Housing Assistance Payments (HAP). Some 
commenters suggested that attainment of a zero HAP amount (either at 
FSS graduation or in general) should be added as a performance measure.
    HUD Response: Zero Housing Assistance Payments (HAP). The ability 
of an FSS participant to reach a level of earnings at which his or her 
HAP amount drops to zero will depend to a significant degree on the 
local labor market and the level of the voucher payment standard, which 
is a function of the rental housing market as well as a PHA's policies. 
Since FSS participants in some markets have a much greater likelihood 
of achieving zero HAP than others, this measure does not provide a 
useful basis for comparing the performance of PHAs in different labor 
and housing markets.
    11. Comment: Unfunded PHAs, MTW PHAs, and PHAs that serve PBRA 
residents. HUD requested comments on the treatment of these types of 
PHAs and received many thoughtful comments on the development of 
performance measures for such PHAs.
    HUD Response: Unfunded PHAs, MTW PHAs, and PHAs that serve PBRA 
residents. HUD appreciates all the thoughtful comments received on 
these subjects and will be considering these comments as HUD works to 
determine how best to evaluate the performance of these programs.
    12. Comment: Portability. Some commenters were concerned about 
which PHA gets ``credit'' for FSS participants who port out of their 
PHA or into their PHA, although there was no consensus on how this 
should be addressed.
    HUD Response: Portability. If a family ports, for the Participation 
Measure, each PHA (the receiving and the initial PHA) will benefit from 
the family's FSS enrollment. For the earnings and FSS graduation 
measures, the composite score will count the family as a participant in 
the FSS program at the PHA who currently administers the FSS contract 
and thus has final influence on the family's outcomes.

B. Comments on Earnings Performance Measure

    1. Comment: Complexity of Earnings Performance Measure. Several 
commenters expressed a concern that the measures (especially the 
earnings measure) are too complicated or confusing. They indicated that 
PHAs will not understand them and will not be able to track their own 
progress. A few asked for information on which comparison households 
are included for their PHA so that they can track progress and correct 
data for those comparison households if needed. A few commenters 
expressed confusion about how comparison households are chosen and who 
chooses them.
    HUD Response: Complexity of Earnings Performance Measure. HUD 
acknowledges that the methodology for computing the earnings 
performance score is somewhat complex, but believes the complexity is 
justified as a means of adjusting for variations in local economic 
conditions and approaches (e.g., human capital development or ``work 
first'' or some combination) at different PHAs. Fortunately, however, 
the measure produces a single clear data point--the earnings 
performance measure--that PHAs can use to track their progress over 
time. To the extent that FSS programs are successful in helping 
participants to increase their earnings--whether in the short-term or 
in the long-term--they should be able to achieve a strong earnings 
performance score. For information on how the measure works and how 
comparison households are selected, see the December 12, 2017 Federal 
Register Notice (at pages 82 FR 58435-37) and comments below.
    2. Comment: Elderly Individuals and Persons with Disabilities. A 
few commenters suggested that excluding households headed by elderly 
persons or persons with disabilities from the earnings performance 
measure would discourage FSS programs from serving these households.
    HUD Response: Elderly Individuals and Persons with Disabilities. 
This comment provides a good opportunity to clarify that the 
methodology is designed to achieve the opposite effect. Although 
program regulations require FSS programs to serve any resident who 
desires to participate and is able to ``seek and maintain employment,'' 
see 24 CFR 984.303(b)(4), some FSS programs may be concerned that 
serving elderly persons and persons with disabilities would lower their 
earnings performance score because this population may be less likely 
to experience large earnings gains than other individuals. The 
methodology excludes households headed by elderly persons or persons 
with disabilities from the earnings performance measure, which ensures 
that PHAs can serve these households without worrying about the 
possibility that this might reduce their earnings performance score. 
All households served through FSS (regardless of age category or 
disability status) will be counted in the participation and FSS 
graduation measures.
    3. Comment: Changes in Elderly or Disability Status. One commenter 
asked how HUD will account for FSS participants who age out of the non-
elderly category while enrolled in FSS and those that acquire a 
disability while participating in the program. Will they be included or 
excluded from the analysis used to calculate the earnings performance 
measure?
    HUD Response: Changes in Elderly or Disability Status. Given the 
strong interest in and capacity for work of many adults in the 60 to 65 
age range, HUD believes it is appropriate to retain in the earnings 
analysis FSS participants who begin their FSS tenure below the age of 
62 but achieve that age during their participation. On the other hand, 
HUD agrees that a person whose status changes to ``disabled'' during 
the course of participation in FSS should be excluded from the earnings 
analysis in order to be consistent with the inclusion of data for other 
persons with disabilities in the earnings analysis. The methodology for 
calculating the earnings performance measure has thus been changed to 
exclude people who are or become disabled while participating in FSS 
from the analysis.
    4. Comment: Selecting Comparison Households. Many commenters 
expressed concern that the variables used to select comparison 
households were not sufficient to account for important life 
circumstances that may affect the potential for employment and 
increased earnings. The most common variables they recommended be 
included were: Language, education level, childcare availability, 
family composition (including children of all ages and workable adults 
or presence of a household member with a disability), mental health, 
and additional information about household composition. Some commenters 
also noted that FSS participants are different than non-FSS 
participants in terms of motivation, resources, or barriers to

[[Page 57497]]

employment, though there was disagreement among commenters on whether 
FSS participants are more likely to have high barriers or low barriers.
    HUD Response: Selecting Comparison Households. As described in the 
December 12, 2017 Federal Register Notice, in selecting comparison 
households for purposes of calculating the earnings performance 
measure, HUD considered the following household characteristics: 
Earnings as of the time of the FSS household's entry into FSS, age of 
head of household, length of time in the voucher or public housing 
program, number of adults in the household and number of children under 
age 5. While some of the additional factors recommended by commenters 
are not available in the PIC dataset used to compute the FSS 
performance measures, several are, including: presence of children of 
any age and presence of a household member with a disability.
    In response to this comment, HUD has considered whether the 
increased precision of adding additional comparison factors would 
outweigh the dilution of the weight of the existing factors and lead to 
an insufficient number of comparison households. Further analysis has 
determined that number of children under 18 is better than presence of 
children under age 5 in predicting whether a household would join FSS 
and therefore is a better factor in choosing comparison households. HUD 
will therefore remove presence of children under age 5 from the factors 
used to match comparison households and instead include number of 
children under 18.
    After further analysis, it has been determined that the presence of 
a child with a disability and presence of a non-head of household adult 
with a disability are not substantial factors predicting a household's 
choice to participate in FSS, but each of these factors is associated 
with a large and significant difference in a household's future 
earnings change. As a result, HUD will include both factors in 
selecting comparison households.
    5. Comment: Location of Comparison Households. A few commenters 
stated that households selected as comparisons for purposes of the 
earnings performance measure should be matched by similar census tract, 
neighborhood, or other measure of geography, to account for local 
variations in opportunity.
    HUD Response: Location of Comparison Households. HUD agrees that it 
would be preferable to select comparison households from the same 
geography as the FSS participants to which they are being compared but 
notes that this may be impossible to achieve at a very small level of 
geography, such as census tract or ZIP code, due to an insufficient 
number of comparison households, especially at small PHAs. Moreover, 
households in neighboring census tracts or ZIP codes are likely to 
still be in the same labor market, and thus can still be effective 
comparators.
    In PHAs that serve a very large geographical area, such as 
statewide PHAs, however, this point may not hold true since the 
economic conditions may be very different in different parts of the 
state. Accordingly, HUD plans to modify the protocol to require, under 
certain circumstances, that comparison households be in the same county 
and PHA as the FSS participants to which they are being compared. HUD 
will apply this protocol to all state PHAs and to non-State PHAs 
serving three or more counties where at least 10 percent of the PHA's 
housing choice voucher (HCV) or public housing households are leased in 
each of those counties. To ensure this approach does not unduly dilute 
the ability to find comparable households, HUD will require that FSS 
participants be matched to comparison households in the same county 
only in counties where there are at least four times as many non-FSS 
households as FSS households being served by the PHA.
    6. Comment: Shifts in Enrollment. Many commenters were concerned 
that the performance measures would encourage PHAs to recruit or enroll 
participants with a high probability of increases in earnings or 
chances of FSS graduation. This comment arose most often for the 
earnings measure, though commenters differed on whether this would lead 
to recruiting minimally employed participants so that they had room to 
grow or participants who are already somewhat financially successful 
and have high potential to increase salaries without much intervention. 
A few commenters raised the concern that FSS programs will stop serving 
participants with substantial barriers who are riskier for the earnings 
and FSS graduation measures and require more intensive intervention.
    HUD Response: Shifts in Enrollment. HUD appreciates these concerns 
and would remind PHAs of the requirement to open the program equally to 
all residents and administer the program for the residents who sign up 
for it, without trying to adjust enrollment to gain a higher score. As 
the commenters note, earnings gains among both unemployed participants 
and already employed participants can help boost a program's earnings 
performance score. It is also important to note that by regulation, FSS 
programs may screen families for interest and motivation to participate 
in the FSS program, but such programs are only permitted to screen for 
permissible motivational screening factors, i.e., those which solely 
measure the family's interest and motivation to participate in the FSS 
program. They may not exclude interested households based on other, 
prohibited characteristics.\2\
---------------------------------------------------------------------------

    \2\ 24 CFR 984.203(c).
---------------------------------------------------------------------------

    7. Comment: Variations in Economic Conditions. Some commenters 
raised the concern that the earnings measure advantages communities 
with higher wages and stronger employment opportunities (primarily 
urban areas) and disadvantages communities with lower wages and weaker 
employment opportunities (primarily rural and suburban areas).
    HUD Response: Variations in Economic Conditions. Because the 
earnings performance score is calculated based on the difference 
between the earnings growth of FSS participants and comparison 
households at the same PHA, it already controls to some extent for 
difference in economic conditions. Presumably, the comparison 
households at a PHA in a stronger economic market will experience 
greater earnings growth than the comparison households at a PHA in a 
weaker economic market, setting up a higher bar for FSS programs to 
exceed in the stronger market.
    Based on these comments, however, HUD has conducted additional 
analysis to determine if there are some residual effects of strong 
economic conditions that are not accounted for in this methodology and 
therefore a need to account for it in assigning earnings performance 
scores. This analysis found that there is in fact still a relationship 
between the earnings performance measures and county median income. 
Accordingly, HUD has decided to apply an adjustment factor to the 
earnings performance measure to account for the residual effect of 
local economic conditions.
    To compute this adjustment factor, HUD first used a linear 
regression model to examine the relationship between the earnings 
growth of comparison households within a PHA and the average county 
median income of those households. On average, earnings growth of 
comparison households was higher in counties with high median incomes, 
and lower in counties with low median incomes. HUD developed an 
adjustment factor that eliminated this relationship and then applied 
this

[[Page 57498]]

adjustment factor to the earnings performance measure for each PHA, 
resulting in an adjusted earnings performance measure.
    Using these adjusted earnings performance measures, HUD has 
recalculated the thresholds for awarding a 10, 7.5, or 0 earnings 
performance score by focusing on the 80th, 60th, and 20th percentile, 
respectively, of the distribution of adjusted measures. In selecting 
the revised thresholds, HUD has analyzed the distribution of scores 
across all funded PHAs, rather than the narrower universe described in 
the December 12, 2017 Federal Register Notice at 82 FR 58437 (the 
earlier notice included only PHAs whose earnings performance measures 
have a significant likelihood of being different from $0, per a 
statistical test). This makes the methodology more consistent with how 
HUD is calculating thresholds for the FSS graduation rate.
    8. Comment: Interim Earnings. Many commenters expressed the view 
that the results of interim reexaminations of income should be included 
in analyzing earnings growth because they capture seasonal income, and 
the most recent progress toward higher earnings. Several were also 
concerned that if participants reach a level of earnings where they no 
longer receive any HAP, this increase in earnings may only be captured 
by interim reexaminations and FSS exit reports.
    HUD Response: Interim Earnings. As noted in the December 12, 2017 
Federal Register Notice, HUD did not consider the earnings reported 
through interim reexaminations of income in the analysis of earnings 
gains because some PHAs conduct such reexaminations when income 
increases between annual reexaminations and others do not. Excluding 
these interim results thus facilitates a direct comparison of local FSS 
programs. Further, participants' incomes are not reexamined at the time 
of exit from FSS. While excluding interim reexaminations will mean 
missing certain earnings changes, such as when a family's earnings 
increase to the point where they are paying zero HAP, HUD has 
determined that their inclusion would make it difficult to compare 
results across PHAs, an essential element of the performance 
measurement system.
    9. Comment: Other Comments on the Earnings Measure. Most commenters 
agreed that averages were more appropriate than medians for the 
earnings measure. A few commenters stated that new employment and/or 
employment retention should be included as part of the earnings measure 
or in addition to the earnings measure. A few commenters suggested that 
escrow accumulation be included as part of or in addition to the 
earnings measure.
    HUD Response: Other Comments on the Earnings Measure. As noted in 
the December 12, 2017 Federal Register Notice (at page 82 FR 58438-39), 
HUD chose to focus on average earnings growth rather than median 
earnings growth to ensure that PHAs received credit for the major, 
transformative earnings gains experienced by some FSS participants, 
even if this experience was not typical of the whole population of FSS 
participants. HUD appreciates that most commenters agreed with this 
approach. However, HUD disagrees with adding new employment, employment 
retention, and escrow accumulation as additional measures or as part of 
the earnings measure. Households that experience new employment and 
escrow accumulation are likely to also experience increased earnings, 
since these measures are strongly related. Accordingly, the inclusion 
of these measures as additional measures would provide even heavier 
weight to earnings than is already the case, which HUD does not believe 
to be appropriate. HUD also notes that data on ``new employment'' is 
not currently collected (though HUD could make inferences about this 
from the PIC data) and that this measure could disadvantage PHAs that 
serve a population that generally enters FSS employed. Escrow is driven 
largely by earnings gains, though it is also affected by the loss of 
welfare assistance or other non-earnings income and thus is less 
precise than earnings in measuring earnings growth. Escrow accumulation 
also does not take into account earnings gains for households above 50 
percent of Area Medium Income (AMI), which is taken into consideration 
by the earnings measure currently in place. Additionally, until HUD has 
published a regulation or notice that implements Section 102 of Housing 
Opportunity Through Modernization Act of 2016 (HOTMA), residents who 
are subject to the Earned Income Disregard will have their escrow 
affected by that policy (in that escrow will not grow while income is 
disregarded for rent calculation purposes). While the current measure 
does not directly measure employment retention, it does factor it in 
since an FSS participant who retains his or her job while a comparison 
household does not will experience greater gains in earnings (zero) 
than the comparison household (a negative number), boosting the PHAs' 
average earnings performance score.

C. Comments on FSS Graduation Rate Measure

    1. Comment: FSS Graduation Rate. Many commenters were concerned 
that the inclusion of an FSS graduation rate measure would encourage 
PHAs to graduate families quickly instead of encouraging families to 
set ambitious employment goals in addition to the necessary 
requirements of maintaining entry level employment and being free of 
welfare cash assistance for twelve (12) months. Others noted that PHAs 
define/operationalize some of the FSS graduation standards differently 
from one another, so this measure would not be consistent across PHAs. 
A few commenters said that the FSS graduation measure penalizes 
programs for terminating non-compliant participants.
    HUD Response: FSS Graduation Rate. FSS graduation is an important 
milestone in the FSS program. FSS graduation marks the point at which 
FSS participants attain both their individual goals and the required 
program goals of employment and independence from welfare cash 
assistance. It also is the prerequisite for participants to receive the 
final disbursement from their escrow accounts.
    Together, the Earnings Performance Measure, Graduation Rate, and 
Participation Rate provide a balanced measurement of the performance of 
an individual FSS program. Because the Earnings Performance Measure is 
weighted more heavily than the Graduation Rate, PHAs should balance the 
need to graduate participants with setting ambitious employment goals 
so participants can maximize their earnings growth while in the 
program. In addition, while PHAs have the discretion to terminate the 
FSS participation of non-compliant participants, HUD would encourage 
PHAs to first work with participants to determine if their challenges 
can be addressed so participants can successfully complete the FSS 
program. Additional guidance can be found in the FSS Promising 
Practices Guidebook.

D. Comments on Participation Rate Measure

    1. Comment: Top Participation Scores. Many commenters expressed the 
view that having the top scores for participation substantially higher 
than the minimum a PHA is expected to serve with HUD funding is unfair 
and encourages PHAs to enroll more people than they can effectively 
serve. A few saw it as an unfunded mandate.

[[Page 57499]]

    HUD Response: Top Participation Scores. All PHAs that serve the 
minimum number of participants expected based on the level of HUD 
coordinator funding will receive at least a 5 as a participation score. 
If a PHA can attain strong earnings and FSS graduation results while 
exceeding this minimum, however, HUD wishes to encourage them to do so 
as this helps to maximize the number of families benefitting from the 
FSS program. This is the reason for assigning higher participation 
scores to PHAs that achieve higher participation levels. Since earnings 
is weighted much more heavily than participation, however, HUD 
emphasizes that PHAs should only increase their caseloads if and to the 
extent they can do so without undermining their earnings and FSS 
graduation results.
    HUD examined FSS performance data to determine if there is a 
correlation between a PHA's participation rate and its earnings and FSS 
graduation rate, paying particular attention to the participation rate 
threshold for obtaining a score of 10 points (80th percentile). This 
analysis did not find a strong relationship between participation rate 
and earnings performance measure. In fact, PHAs with participation 
rates between the 80th and 90th percentile had the highest average 
earnings performance measure of any decile and a median earnings 
performance measure that was typical for the sample as a whole, 
confirming that the threshold for obtaining a score of 10 points is not 
one that leads to lower earnings performance scores.
    In terms of FSS graduation rates, the median FSS graduation rate 
was fairly similar for most deciles of participation rate, except for 
the very highest and lowest deciles, which both had lower FSS 
graduation rates than the other deciles. However, the threshold for 
qualifying for 10 points on the participation rate is set at the 80th 
percentile and not the 90th percentile (the starting point for the 
highest decile) and PHAs with participation rates between the 80th and 
90th percentile had median and average FSS graduation rates that were 
typical for the sample as a whole, confirming that this threshold does 
not inherently lead to sub-par performance.
    Based on this analysis, HUD has determined that it is appropriate 
to encourage PHAs to adopt higher participation rates, so long as they 
can do so without compromising their earnings performance and FSS 
graduation rates. However, HUD has decided to change the final scoring 
so as to reward incremental improvements in participation rates, rather 
than only participation rates that exceed one of two specific 
thresholds. Accordingly, HUD will assign PHAs with participation rates 
above .95 a score of 5, 6, 7, 8, 9 or 10, depending on their 
participation rate, as specified in Section III of this notice. A score 
of 10 will be awarded for a participation rate at or above 2.0, which 
is close to the 80th percentile level HUD previously identified.
    2. Comment: Participation Rate and PHA Size. A few commenters said 
that the participation rate measure disadvantages either large PHAs/
programs or small ones. For small programs in small PHAs, there may be 
less opportunity to recruit participants and smaller economies of scale 
for the coordinator. For large programs, increases in the number of 
participants enrolled would have to be very large in order to increase 
the participation score.
    HUD Response: Participation Rate and PHA Size. The commenters are 
split about whether the participation rate calculation benefits smaller 
or larger PHAs. HUD believes this reflects the reality that all PHAs 
(regardless of size) have the potential to obtain either a high or a 
low participation rate, depending on how they manage their FSS program. 
This is confirmed by the fact that, in the initial spreadsheet of PHA 
scores, PHAs of all sizes are well represented at each of the 
participation score levels. While all PHAs must comply with the minimum 
enrollment requirements associated with the receipt of HUD coordinator 
funding, each PHA should make a determination of how many families they 
can serve effectively above this minimum based on their staff capacity, 
the intensity of participants' needs, and other resources available at 
the PHA and from partner organizations. HUD encourages PHAs to serve as 
many households as they can, so long as they do not exceed the level 
they can effectively support. Additionally, as explained above, there 
is no clear correlation between a PHA's size and the overall composite 
score.

E. Comments on Weighting of the Measures

    1. Comment: Weighting. Several commenters felt that the weights are 
appropriate and did not comment further. Many commenters expressed the 
view that the earnings measure is weighted too highly. Commenters who 
suggested this were often concerned that the earnings measure would not 
show progress for FSS participants in longer-running education or 
training programs and so, did not account for variations in participant 
goals. Some commenters felt that FSS graduation and participation 
should have the same weight, regardless of the weight of the earnings 
measure. One reason given for this is that participation is essential 
for FSS graduation. Another was that weighting FSS graduation rate too 
highly compared to participation would encourage PHAs to graduate 
families before they had met ambitious goals.
    HUD Response: Weighting. HUD appreciates the range of views 
expressed on this matter. After considering the comments, HUD plans to 
retain the weighting specified in the December 12, 2017 Federal 
Register Notice. Earnings represent by far the most powerful and 
objective measure available to HUD. While there are many goals to which 
FSS participants aspire, the achievement of most of these should lead 
to higher earnings which can then be measured through the earnings 
performance measure. Accordingly, HUD believes that a weight of 50 
percent is appropriate.
    While there is a case for weighting FSS graduation rate and 
participation rate equally, HUD believes weights of 30 percent for the 
FSS graduation rate and 20 percent of the participation rate are 
appropriate. As noted above, FSS graduation is an important milestone 
for the FSS program and HUD would like to see PHAs raise FSS graduation 
rates. HUD would also like to see PHAs serve more families if and to 
the extent they can do so without jeopardizing their achievement of 
strong earnings and FSS graduation rates. Weighting FSS graduation rate 
more heavily than participation rate is consistent with HUD's goal of 
not creating incentives for PHAs to raise caseloads beyond the point 
where families can be served effectively.

III. Final Thresholds

A. Summary of Adjustments to FSS Performance Score Methodology

    After considering all of the public comments, HUD is adopting the 
proposed FSS performance measurement system, with the adjustments noted 
above, which will henceforth be used by HUD to evaluate the performance 
of PHAs receiving HUD program coordinator funding. These adjustments 
are summarized in the table below:

[[Page 57500]]



                           Changes to Methodology for Computing FSS Performance Scores
----------------------------------------------------------------------------------------------------------------
 
----------------------------------------------------------------------------------------------------------------
Overall.............................................   Where a family ports, each PHA (the receiving and
                                                       the initial PHA) will benefit from the family's FSS
                                                       enrollment as it relates to the PHA's participation
                                                       measure. For the earnings and FSS graduation measures,
                                                       HUD will include the family for the PHA who currently
                                                       administers the FSS contract.
                                                       HUD will treat joint applicants as a single PHA
                                                       for purposes of computing all three components of the FSS
                                                       performance score.
Earnings Performance Score..........................   In calculating the earnings performance score,
                                                       HUD will exclude FSS participants who become classified
                                                       as disabled at any point during their participation.
                                                       HUD will include within the earnings measure FSS
                                                       participants that begin the FSS contract below age 62,
                                                       even if they reach or exceed the age of 62 during their
                                                       Contract of Participation.
                                                       In selecting comparison households, HUD will
                                                       match FSS families with comparison families based on the
                                                       number of children under the age of 18, rather than the
                                                       presence of child under age 5. HUD will also match FSS
                                                       families with comparison families based on presence of a
                                                       child with a disability and presence of a non-head of
                                                       household adult with a disability.
                                                       Under certain circumstances, HUD will require
                                                       that comparison households be in the same county and PHA
                                                       as the FSS participants to which they are being compared.
                                                       HUD will apply this protocol to all state PHAs and to any
                                                       additional PHAs where three or more counties are each
                                                       home to at least 10 percent of households receiving
                                                       housing assistance from the PHA (through HCV or public
                                                       housing). To ensure this approach does not unduly dilute
                                                       the ability to find comparable households, HUD will
                                                       require that FSS participants be matched to comparison
                                                       households in the same county only in counties where
                                                       there are at least four times as many non-FSS households
                                                       as FSS households being served by the PHA.
                                                       HUD will apply an adjustment factor to the
                                                       earnings performance measure to account for variations in
                                                       local economic conditions.
----------------------------------------------------------------------------------------------------------------

    After making these adjustments to the methodology, HUD has 
recalculated the thresholds for translating the FSS performance 
measures into individual component scores and the final composite score 
and notes the final thresholds below.

B. Updated Thresholds for FSS Performance Scores

    The following are the updated thresholds HUD will use to compute an 
FSS Performance Score for each PHA. See the December 12, 2017 Federal 
Register Notice and the updated complete methodology, which can be 
found on HUD's website at https://www.hud.gov/program_offices/public_indian_housing/programs/hcv/fss, for more information on each of 
the two steps in this process.
1. Step One: Assigning Scores to Each of the Three Measures
    In Step One, HUD will assign a score of 0 to 10 to each PHA's FSS 
program for each of the three measures. Scores will be assigned using 
the thresholds and procedures described below. The ranges for awarding 
points between two values include those values as well as all 
intermediary values.
    a. Earnings Performance Measure (50 percent of final score):
     10 points: Earnings performance measure of $8,700 or 
higher.
     7.5 points: Earnings performance measure between $6,950 
and $8,699.99.
     0 points: Earnings performance measure below $4,050 and a 
p-value of <.10 on a statistical test measuring the likelihood that a 
PHA's earnings performance measure is significantly lower than the 
median measure of $6,302 (see December 12, 2017 Federal Register Notice 
at page 82 FR 58437 for an explanation of this statistical test).
     5 points: All PHAs that do not qualify for a 10, 7.5, or a 
0.
    b. FSS Graduation Rate (30 percent of final score):
     10 points: FSS graduation rate of 38 percent or higher.
     7.5 points: FSS graduation rate between 28 percent and 
37.9 percent.
     0 points: FSS graduation rate below 10 percent.
     5 points: All PHAs that do not qualify for a 10, 7.5, or a 
0
    c. Participation Rate (20 percent of final score):
     10 points: Participation rate of 2.0 or higher.
     9 points: Participation rate between 1.8 and 1.99.
     8 points: Participation rate between 1.6 and 1.79.
     7 points: Participation rate between 1.4 and 1.59.
     6 points: Participation rate between 1.2 and 1.39.
     5 points: Participation rate between .96 and 1.19.
     0 points: Participation rate of .95 or lower.
2. Step Two: Developing the Final FSS Performance Score and Grade
    In Step Two, after computing individual scores for each of the 
three measures, HUD will aggregate each PHA's scores using the weights 
noted above to develop a final FSS Performance Score from 0 to 10. 
Based on this score, HUD will assign the following ranking to the PHA's 
performance:
     Category 1: FSS Performance score of 8.0 or higher.
     Category 2: FSS Performance score between 4.26 and 7.99.
     Category 3: FSS Performance score between 3.26 and 4.25.
     Category 4: FSS Performance score of 3.25 or lower.

IV. Environmental Impact

    This notice does not direct, provide for assistance or loan and 
mortgage insurance for, or otherwise govern or regulate, real property 
acquisition, disposition, leasing, rehabilitation, alteration, 
demolition, or new construction, or establish, revise or provide for 
standards for construction or construction materials, manufactured 
housing, or occupancy. Accordingly, under 24 CFR 50.19(c)(1), this 
notice is categorically excluded from environmental review under the 
National Environmental Policy Act of 1969 (42 U.S.C. 4321).

    Dated: November 7, 2018.
Dominique Blom,
General Deputy Assistant Secretary, Public and Indian Housing.
[FR Doc. 2018-24949 Filed 11-14-18; 8:45 am]
 BILLING CODE 4210-67-P



                                                                         Federal Register / Vol. 83, No. 221 / Thursday, November 15, 2018 / Notices                                           57493

                                               especially interested in public comment                 contacting Anice Chenault at 502–618–                 FSS program performance—
                                               addressing the following issues: (1) Is                 8163 (email strongly preferred).                      individually and collectively—improves
                                               this collection necessary to the proper                   Electronic Data Availability. This                  or declines over time.
                                               functions of the Department; (2) will                   Federal Register notice and a                            Initially, HUD plans to use the
                                               this information be processed and used                  spreadsheet containing scores using the               performance measures to identify high
                                               in a timely manner; (3) is the estimate                 methodology for FSS programs funded                   performing and low performing FSS
                                               of burden accurate; (4) how might the                   in any of the last three years will be                programs, which could inform its
                                               Department enhance the quality, utility,                available electronically from the HUD                 understanding of best practices and its
                                               and clarity of the information to be                    FSS web page: https://www.hud.gov/                    delivery of technical assistance. Toward
                                               collected; and (5) how might the                        program_offices/public_indian_                        these goals, at least once per year, HUD
                                               Department minimize the burden of this                  housing/programs/hcv/fss. Federal                     will analyze data collected through the
                                               collection on the respondents, including                Register notices also are available                   Public Housing Information Center (PIC)
                                               through the use of information                          electronically at https://                            to calculate FSS performance scores for
                                               technology? Please note that written                    www.federalregister.gov/, the U.S.                    each FSS program that received an FSS
                                               comments received in response to this                   Government Printing Office website.                   coordinator grant in one or more of the
                                               notice will be considered public                        SUPPLEMENTARY INFORMATION:                            past three fiscal year NOFA
                                               records.                                                                                                      competitions. Beginning in Fiscal Year
                                                                                                       I. Background                                         2019, HUD plans to consider the FSS
                                                 Title of Collection: Science and
                                               Technology Collection of Qualitative                       On December 12, 2017, HUD                          performance score of an FSS program in
                                               Feedback.                                               published a notice in the Federal                     determining FSS funding awards.
                                                 Type of Review: New.                                  Register (FR–6046–N–01, 82 FR 58434)                     HUD developed the approach
                                                 Affected Public: Individuals and                      (2017 Notice) describing and requesting               described in this Notice based in part on
                                               Households, Businesses and                              comment on a performance                              feedback received on an earlier
                                               Organizations, State, Local or Tribal                   measurement system that HUD plans to                  performance measurement approach
                                               Government.                                             implement for public housing agencies                 proposed in the FY 2014 FSS Notice of
                                                 Frequency of Collection: One per                      (PHAs) that receive HUD Family Self                   Funding Availability (NOFA). In the FY
                                               Request.                                                Sufficiency (FSS) program coordinator                 2014 NOFA, HUD proposed, and asked
                                                 Estimated Time per Respondent: 30                     grants. Through this notice, HUD is                   for feedback on, evaluating FSS
                                               minutes or under.                                       implementing the FSS performance                      programs based on the share of FSS
                                                 Number of Respondents: 215,100.                       measurement system, as proposed in the                participants that experience an increase
                                                 Total Burden Hours: 34,732.                           2017 Notice. Additionally, in response                in earned income (also known as
                                                 Dated: October 16, 2018.                              to public comments, HUD is revising the               ‘‘earnings growth’’) over a specified time
                                               Rick Stevens,
                                                                                                       methodology it uses to compute FSS                    period. Some commenters raised
                                                                                                       Performance Scores under the new                      concerns that this approach did not
                                               Chief Technology Officer, Science and
                                               Technology Directorate.
                                                                                                       system; these revisions are described                 adequately account for differences in
                                                                                                       below, in section III of this notice.                 local economic conditions and
                                               [FR Doc. 2018–24906 Filed 11–14–18; 8:45 am]
                                                                                                       Henceforth, HUD will use the new                      differences in the approaches of local
                                               BILLING CODE 9110–9F–P
                                                                                                       system to evaluate the performance of                 FSS programs. While some FSS
                                                                                                       PHAs receiving HUD program                            programs encourage participants to
                                                                                                       coordinator funding in a strictly                     increase their earnings immediately,
                                               DEPARTMENT OF HOUSING AND                               advisory manner. Beginning with Fiscal                others encourage FSS participants to
                                               URBAN DEVELOPMENT                                       Year (FY) 2019 appropriations, HUD                    build skills and credentials first and
                                               [Docket No. FR–6046–N–02]                               intends to use the performance                        then seek higher paying jobs. The FSS
                                                                                                       measurement system in the                             performance measurement system
                                               Family Self-Sufficiency Performance                     determination of FSS funding awards.                  proposed in the December 2017 Notice
                                               Measurement System (‘‘Composite                         The complete, updated methodology                     was developed to address these issues,
                                               Score’’)                                                can be found on HUD’s website at:                     as well as many others, and to allow for
                                                                                                       https://www.hud.gov/program_offices/                  a more nuanced evaluation of the
                                               AGENCY:   Office of Public and Indian                   public_indian_housing/programs/hcv/
                                               Housing, HUD.                                                                                                 performance of local FSS programs.
                                                                                                       fss.                                                     A PHA’s FSS performance score will
                                               ACTION: Notice of new performance                          Under section 23(i) of the Housing                 be calculated based on three measures,
                                               measurement system (‘‘Composite                         Act of 1937 (42 U.S.C. 1437u(i)), HUD                 weighted as follows:
                                               Score’’) for the Family Self-Sufficiency                is required to establish criteria to                     A. Earnings Performance Measure (50
                                               Program.                                                evaluate eligible entities’                           percent);
                                                                                                       implementation of local FSS programs.                    B. FSS Graduation Rate (30 percent);
                                               SUMMARY:    This notice describes and                   HUD has developed this new FSS                           C. Participation Rate (20 percent).
                                               responds to comments on a performance                   performance measurement system to                        HUD has selected these measures
                                               measurement system that HUD plans to                    provide HUD, Congress, public housing                 because they are important indicators of
                                               implement for Public Housing Agencies                   agencies (PHAs), and other eligible                   program performance and are verifiable
                                               (PHAs) that receive HUD Family Self-                    entities with information on the                      using the data HUD collects through the
                                               Sufficiency (FSS) program coordinator                   performance of individual FSS                         PIC data system. No outside or
                                               grants. The desired effect of this notice               programs. The information will help
khammond on DSK30JT082PROD with NOTICES




                                                                                                                                                             additional reporting will be required,
                                               is to notify the public regarding the                   grantees determine how their programs                 which ensures that the system will not
                                               criteria for evaluating FSS programs.                   compare to others across the country in               increase the reporting burden of PHAs.
                                               DATES: Applicability Date: December 17,                 efforts to help participants to                       No new Paperwork Reduction Act (PRA)
                                               2018.                                                   successfully graduate from the program                Information Collection will be required
                                               FOR FURTHER INFORMATION CONTACT:                        and make progress toward economic                     for the scoring, as proposed.
                                               Questions on this notice may be                         security. The information will also help                 The Earnings Performance Measure
                                               addressed to FSS@hud.gov or by                          HUD understand the extent to which                    represents the difference between the


                                          VerDate Sep<11>2014   16:53 Nov 14, 2018   Jkt 247001   PO 00000   Frm 00095   Fmt 4703   Sfmt 4703   E:\FR\FM\15NON1.SGM   15NON1


                                               57494                     Federal Register / Vol. 83, No. 221 / Thursday, November 15, 2018 / Notices

                                               earnings growth of FSS participants and                 measurement system for unfunded                       report from the PIC system. This ensures
                                               the earnings growth of similar non-FSS                  PHAs, and PHAs and private owners                     that if a PHA has made changes to
                                               households assisted by the PHA within                   that serve Project-based Rental                       improve the accuracy of its reporting on
                                               a specified time frame. This approach,                  Assistance (PBRA) residents at this                   any metric, for current or past
                                               along with a statistical adjustment                     time.1 The Agency will continue to                    participants, all of these changes will be
                                               described below, helps to control for                   explore options for modifying the                     reflected in its performance score.
                                               variations in local economic conditions.                scoring system for those sub-groups.                     2. Comment: Limitations on Included
                                               The program was envisioned and                                                                                Measures. Many commenters expressed
                                               designed for the purpose of increasing                  II. HUD’s Responses to Public                         the view that the measures in the
                                               employment and earnings for its                         Comments                                              planned performance measurement
                                               participants. Therefore, the performance                   HUD received 68 unique public                      system do not address the variations in
                                               score assigns the Earnings Performance                  comments on the planned measures,                     participants’ goals. Some participants or
                                               Measure a high weight.                                  which are summarized below along                      programs may have interim goals related
                                                  HUD has assigned the next highest                    with HUD’s responses. HUD’s responses                 to addressing barriers to work (e.g.,
                                               weight to the Graduation Rate                           to comments are organized into five                   treating psychiatric illness or barriers,
                                               indicator—which represents the rate of                  categories: (A) Overall Comments; (B)                 accessing medical care, securing
                                               FSS participants who successfully                       Comments on Earnings Performance                      childcare, or completing training, or
                                               ‘‘graduate’’ from the program—to                        Measure; (C) Comments on FSS                          education), which would not
                                               encourage PHAs to work closely with                     Graduation Rate Measure; (D)                          immediately result in higher earnings,
                                               individual FSS participants to increase                 Comments on Participation Rate                        even if participants make important
                                               graduation rates. To graduate from FSS,                 Measure; and (E) Comments on                          progress. Several commenters suggested
                                               a participant must be employed, be                      Weighting of the Measures. At the                     that participation in/provision of
                                               independent of cash welfare assistance                  conclusion of this Notice, in Section III.,           services or progress toward Individual
                                               for at least one year, and achieve the                  Final Thresholds, HUD provides the                    Training and Services Plan (ITSP) goals
                                               other goals set forth in the participant’s              final FSS performance measurement                     should be included as a measure. Some
                                               contract of participation.                              system thresholds that it intends to                  suggested that changes in educational
                                                  Finally, the FSS performance score                   adopt to calculate FSS performance                    attainment also be included as a
                                               looks at the local program’s                            scores.                                               measure.
                                               Participation Rate, which reflects the                                                                           Several commenters also stated that
                                               extent to which a PHA exceeds the                       A. Overall Comments                                   inputs and outputs should be included
                                               minimum number of households that                          1. Comment: Data Quality. Many                     in the measures, such as the work
                                               HUD requires the PHA to serve as a                      commenters raised concerns about the                  associated with serving participants,
                                               condition of receiving an FSS grant.                    quality of data from the PIC system used              meeting with participants, connecting
                                               PHAs with higher Participation Rates                    to calculate the FSS performance scores,              participants to services, making
                                               are serving more households than                        particularly with regard to data entered              referrals, etc. Some indicated that,
                                               required, which is a desired output,                    prior to HUD’s 2016 guidance. Some                    without these measures, they are not
                                               provided the PHAs are serving those                     requested that PHAs be allowed to                     given adequate ‘‘credit’’ for serving
                                               households effectively. Because the                     examine and correct all data used for                 high-needs participants or that they may
                                               Earnings Performance Measure is                         calculating their measures prior to HUD               be penalized for participant
                                               weighted more heavily than the                          calculating the FSS performance                       performance issues that are beyond their
                                               Participation Rate, however, PHAs                       measures. Others suggested that this                  control (through the earnings and FSS
                                               should be careful not to execute more                   might not be possible or that there                   graduation measures).
                                               Contracts of Participation than they can                would not be resources to correct the                    HUD Response: Limitations on
                                               serve effectively, because doing so                     data.                                                 Included Measures. HUD agrees that
                                               would likely reduce their scores on the                    HUD Response: Data Quality. On May                 there is tremendous variety in the ITSP
                                               Earnings Performance Measure.                           6, 2016, HUD issued PIH Notice 2016–                  goals of individual FSS participants,
                                               Together, the Earnings Performance                      08 to help PHAs understand how to                     which go beyond the statutorily
                                               Measure, Graduation Rate, and                           submit timely and accurate PIC data                   mandated goals of employment and
                                               Participation Rate are expected to                      regarding FSS, along with a series of                 being welfare-free. It is precisely this
                                               provide a balanced measurement of the                   webinars to help PHAs apply the                       variety, however, that makes these goals
                                               performance of an individual FSS                        guidance to improve their PIC data                    extremely difficult to factor into a
                                               program.                                                quality for both current and past                     performance measurement system.
                                                  As indicated in the 2017 Notice                      participants. Further, HUD has                        Since each ITSP is set up individually,
                                               soliciting public comment, HUD does                     emphasized the importance of PHAs                     it would be both impracticable and
                                               not intend to use this performance                      submitting accurate PIC data for many                 unwise to standardize ITSP goals across
                                               measurement system for Tribes/Tribally                  years. HUD believes it is reasonable to               all programs. While HUD could
                                               Designated Housing Entities (TDHEs),                                                                          potentially measure the share of ITSP
                                                                                                       rely on existing PIC data in calculating
                                               who do not report into Public and                                                                             goals achieved for each participant, this
                                                                                                       FSS performance scores.
                                               Indian Housing Information Center                          It is important to note that each time             would not represent a direct comparison
                                               (PIC), or for PHAs with a Moving to                                                                           across local FSS programs if some
                                                                                                       the FSS performance scores are
                                               Work (MTW) designation, as they report                                                                        programs set goals that were easy to
                                                                                                       calculated, HUD will retrieve a new data
                                               differently into PIC, using Form HUD–                                                                         attain while others set more difficult
khammond on DSK30JT082PROD with NOTICES




                                               50058–MTW. However, HUD is                                 1 Section 306 of the Economic Growth, Regulatory   targets. This approach could also create
                                               presently exploring a change to the                     Relief, and Consumer Protection Act (Pub. L. 115–     an incentive for PHAs to change how
                                               reporting processes for MTW agencies,                   174, Approved May 24, 2018) amended the United        they are defining individuals’ goals to
                                               in order to include them in the FSS                     States Housing Act of 1937. Among various             increase their FSS performance scores,
                                                                                                       provisions, this law extended FSS program
                                               performance scoring process. Nor does                   eligibility to tenants of certain privately-owned
                                                                                                                                                             without necessarily improving
                                               HUD intend, after considering public                    properties subsidized with project-based rental       outcomes for participants. Finally, HUD
                                               comment, to use this performance                        assistance (PBRA).                                    does not currently collect data on the


                                          VerDate Sep<11>2014   16:53 Nov 14, 2018   Jkt 247001   PO 00000   Frm 00096   Fmt 4703   Sfmt 4703   E:\FR\FM\15NON1.SGM   15NON1


                                                                         Federal Register / Vol. 83, No. 221 / Thursday, November 15, 2018 / Notices                                          57495

                                               goals set nor the share of ITSP goals that              program. This requires measurements                   more difficult for smaller FSS programs
                                               participants attain, so the inclusion of                that span years, rather than months. To               than larger programs to receive a zero
                                               ITSP goal data in a performance                         implement such a system prospectively,                (0) score on the earnings measure. See
                                               measurement system for FSS would                        without relying on data from prior                    the Dec. 12, 2017 Federal Register
                                               require additional reporting by PHAs,                   periods, would require HUD to wait                    Notice (at page 82 FR 58437) for more
                                               which would add to their administrative                 many years before having valid                        details on the statistical test.
                                               burden.                                                 measures of FSS program performance.                     HUD has also examined the FSS
                                                  HUD recognizes the importance and                    Such a delay would undermine HUD’s                    performance composite scores of PHAs
                                               value of setting a range of goals for                   ability to achieve the key purposes of                to determine if small programs
                                               participants, including goals other than                the FSS performance measurement                       systematically receive lower composite
                                               employment. Over time, however, HUD                     system. In order to ensure that FSS                   scores and determined that, there is not
                                               believes the achievement of these goals                 funds are spent responsibly and that                  a strong relationship between program
                                               will support the ultimate goal of the                   FSS participants have access to high-                 size and composite FSS performance
                                               program, which is increased earnings,                   quality programs, HUD needs the ability               score. In fact, the decile of PHAs with
                                               which will then be captured in the                      to recognize the achievements of high-                the second smallest FSS programs (10th
                                               performance measurement system. This                    performing FSS programs and identify                  through 19th percentile) had the second
                                               is one of the benefits of having five (or               struggling FSS programs in need of                    highest median composite scores of any
                                               more) years to work with participants.                  improvement.                                          decile (the highest was the group of
                                               The long duration of the FSS program                       The goals of improving earnings and                PHAs in the 70th through the 79th
                                               provides PHAs an opportunity to work                    helping FSS participants graduate                     percentile in size). PHAs with the very
                                               with participants on a range of issues—                 successfully from the program should                  smallest FSS programs (0 to 9th
                                               including education, training, work                     not come as a surprise to PHAs                        percentile) did have the lowest median
                                               readiness, etc.—that will, over time,                   administering FSS programs. These                     composite score, but the next lowest
                                               contribute to earnings gains that can be                goals have been clear since the                       score was recorded by PHAs in the 80th
                                               measured and reflected in the FSS                       program’s inception and NOFAs have                    to 89th percentile in size. This is an
                                               performance measurement system. The                     been announcing HUD’s intent to use                   indication that there is not a strong
                                               earnings and FSS graduation rate                        increased earnings as an evaluation                   relationship between program size and
                                               measures accommodate this long time-                    metric since FY 2014. The participation               composite FSS performance score.
                                               frame, examining data for FSS                           rate also should not come as a surprise               However, HUD may continue to monitor
                                               participants that entered the program as                to PHAs, as HUD has historically based                scores to determine if there are any
                                               far back as 7.5 to 8 years ago,                         funding decisions on the number of FSS                patterns that might help with the
                                               respectively.                                           families served by PHAs. HUD’s interest               targeting of technical assistance efforts
                                                  3. Comment: Homeownership. A few                     in PHAs serving more families (so long                or the interpretation of performance
                                               commenters expressed concern that the                   as they can do so without undermining                 data.
                                               measures do not support                                 earnings growth and FSS graduation                       7. Comment: Joint Applicants. One
                                               homeownership goals for FSS                             rates), as reflected in the participation             commenter suggested that it would be
                                               participants and stated that progress                   rate, is a factor that PHAs can influence             more appropriate to pool joint applicant
                                               toward homeownership should be                          going forward by adjusting their                      data for all measures, not just for
                                               included as a measure in the                            caseloads.                                            participation.
                                               performance measurement system.                            5. Comment: Real-Time Data. Some                      HUD Response: Joint Applicants.
                                                  HUD Response: Homeownership.                         commenters requested a way to monitor                 HUD agrees, and is changing the
                                               HUD commends PHAs that work with                        their programs’ progress with respect to              methodology accordingly.
                                               participants on homeownership and                       the measures periodically or in real                     8. Comment: Initial Funding Period.
                                               recognizes that the achievement of                      time.                                                 Some commenters thought that FSS
                                               homeownership is an important                              HUD Response: Real-Time Data. HUD                  programs should not be assessed during
                                               outcome for many FSS participants. At                   plans to provide updated scores at least              their initial 12-month funding period or
                                               the same time, it is clear that                         once each year so PHAs can track their                directly after receiving additional
                                               homeownership is a more realistic goal                  progress. In addition, PHAs can                       funding for the first time.
                                               in some parts of the U.S. than others,                  calculate their own participation rates                  HUD Response: Initial Funding
                                               due to variations in the local economy.                 and FSS graduation rates at any time.                 Period. HUD agrees with the need to be
                                               This makes it difficult and inequitable                    6. Comment: Small PHAs/Small FSS                   careful in interpreting the FSS
                                               to use homeownership as a performance                   Programs. Several commenters raised                   performance scores of newly funded
                                               measure in comparing FSS programs on                    the concern that the measures could                   FSS programs and will take this into
                                               a national basis.                                       disadvantage small PHAs or small FSS                  account in determining how to use the
                                                  4. Comment: Reliance on Past                         programs because volatility in the data               scores. However, HUD believes it is
                                               Performance Data. Some commenters                       would be more likely and factors                      important to measure the performance
                                               opined that it is unfair to base an                     beyond the FSS program’s control could                of all FSS programs that receive HUD
                                               assessment of FSS performance on data                   drive results.                                        coordinator funding so that programs
                                               from prior periods during which FSS                        HUD Response: Small PHAs/Small                     have a way of tracking their
                                               coordinators were unaware of the                        FSS Programs. HUD recognizes that                     performance over time. Also, since HUD
                                               performance measures and could not                      there may be greater volatility in the                has not funded new applicants in
                                                                                                       data for small FSS programs, which
khammond on DSK30JT082PROD with NOTICES




                                               change their programs accordingly.                                                                            several years, all PHAs currently being
                                                  HUD Response: Reliance on Past                       could be affected by the outcomes for                 scored have had programs funded since
                                               Performance Data. The performance                       one or more participants with unusual                 at least FY2012.
                                               measurement system recognizes that it                   characteristics or experiences.                          9. Comment: Minimum Standards. A
                                               takes considerable time for an                          Accordingly, in assigning earnings                    few commenters said that HUD should
                                               individual FSS participant to make                      scores, HUD has built in protection for               consider setting minimum standards for
                                               material progress in increasing his or                  small FSS programs by using a test of                 performance rather than rating FSS
                                               her earnings and to graduate from the                   statistical significance that makes it                programs on a curve.


                                          VerDate Sep<11>2014   16:53 Nov 14, 2018   Jkt 247001   PO 00000   Frm 00097   Fmt 4703   Sfmt 4703   E:\FR\FM\15NON1.SGM   15NON1


                                               57496                     Federal Register / Vol. 83, No. 221 / Thursday, November 15, 2018 / Notices

                                                  HUD Response: Minimum Standards.                     score will count the family as a                      elderly persons and persons with
                                               FSS programs will not be graded on a                    participant in the FSS program at the                 disabilities would lower their earnings
                                               curve, but rather based on whether or                   PHA who currently administers the FSS                 performance score because this
                                               not they exceed the specific fixed                      contract and thus has final influence on              population may be less likely to
                                               standards (or thresholds) adopted in the                the family’s outcomes.                                experience large earnings gains than
                                               final FSS performance measures. While                                                                         other individuals. The methodology
                                                                                                       B. Comments on Earnings Performance
                                               HUD used percentiles of the distribution                                                                      excludes households headed by elderly
                                                                                                       Measure
                                               to determine the initial thresholds for                                                                       persons or persons with disabilities
                                               each score, those thresholds have now                      1. Comment: Complexity of Earnings                 from the earnings performance measure,
                                               been fixed. This means that over time,                  Performance Measure. Several                          which ensures that PHAs can serve
                                               a PHA’s scores may move up or down,                     commenters expressed a concern that                   these households without worrying
                                               based on where the PHA’s earnings, FSS                  the measures (especially the earnings                 about the possibility that this might
                                               graduation, and participation measures                  measure) are too complicated or                       reduce their earnings performance
                                               fall relative to the thresholds. In other               confusing. They indicated that PHAs                   score. All households served through
                                               words, a PHA’s performance will                         will not understand them and will not                 FSS (regardless of age category or
                                               determine in which performance                          be able to track their own progress. A                disability status) will be counted in the
                                               category the PHA falls, since there is not              few asked for information on which                    participation and FSS graduation
                                               a set number of ‘‘high’’ or ‘‘low’’                     comparison households are included for                measures.
                                               performers.                                             their PHA so that they can track                         3. Comment: Changes in Elderly or
                                                  10. Comment: Zero Housing                            progress and correct data for those                   Disability Status. One commenter asked
                                               Assistance Payments (HAP). Some                         comparison households if needed. A                    how HUD will account for FSS
                                               commenters suggested that attainment                    few commenters expressed confusion                    participants who age out of the non-
                                               of a zero HAP amount (either at FSS                     about how comparison households are                   elderly category while enrolled in FSS
                                               graduation or in general) should be                     chosen and who chooses them.                          and those that acquire a disability while
                                               added as a performance measure.                            HUD Response: Complexity of                        participating in the program. Will they
                                                  HUD Response: Zero Housing                           Earnings Performance Measure. HUD                     be included or excluded from the
                                               Assistance Payments (HAP). The ability                  acknowledges that the methodology for                 analysis used to calculate the earnings
                                               of an FSS participant to reach a level of               computing the earnings performance                    performance measure?
                                               earnings at which his or her HAP                        score is somewhat complex, but believes                  HUD Response: Changes in Elderly or
                                               amount drops to zero will depend to a                   the complexity is justified as a means of             Disability Status. Given the strong
                                               significant degree on the local labor                   adjusting for variations in local                     interest in and capacity for work of
                                               market and the level of the voucher                     economic conditions and approaches                    many adults in the 60 to 65 age range,
                                               payment standard, which is a function                   (e.g., human capital development or                   HUD believes it is appropriate to retain
                                               of the rental housing market as well as                 ‘‘work first’’ or some combination) at                in the earnings analysis FSS
                                               a PHA’s policies. Since FSS participants                different PHAs. Fortunately, however,                 participants who begin their FSS tenure
                                               in some markets have a much greater                     the measure produces a single clear data              below the age of 62 but achieve that age
                                               likelihood of achieving zero HAP than                   point—the earnings performance                        during their participation. On the other
                                               others, this measure does not provide a                 measure—that PHAs can use to track                    hand, HUD agrees that a person whose
                                               useful basis for comparing the                          their progress over time. To the extent               status changes to ‘‘disabled’’ during the
                                               performance of PHAs in different labor                  that FSS programs are successful in                   course of participation in FSS should be
                                               and housing markets.                                    helping participants to increase their                excluded from the earnings analysis in
                                                  11. Comment: Unfunded PHAs, MTW                      earnings—whether in the short-term or                 order to be consistent with the inclusion
                                               PHAs, and PHAs that serve PBRA                          in the long-term—they should be able to               of data for other persons with
                                               residents. HUD requested comments on                    achieve a strong earnings performance                 disabilities in the earnings analysis. The
                                               the treatment of these types of PHAs                    score. For information on how the                     methodology for calculating the
                                               and received many thoughtful                            measure works and how comparison                      earnings performance measure has thus
                                               comments on the development of                          households are selected, see the                      been changed to exclude people who are
                                               performance measures for such PHAs.                     December 12, 2017 Federal Register                    or become disabled while participating
                                                  HUD Response: Unfunded PHAs,                         Notice (at pages 82 FR 58435–37) and                  in FSS from the analysis.
                                               MTW PHAs, and PHAs that serve PBRA                      comments below.                                          4. Comment: Selecting Comparison
                                               residents. HUD appreciates all the                         2. Comment: Elderly Individuals and                Households. Many commenters
                                               thoughtful comments received on these                   Persons with Disabilities. A few                      expressed concern that the variables
                                               subjects and will be considering these                  commenters suggested that excluding                   used to select comparison households
                                               comments as HUD works to determine                      households headed by elderly persons                  were not sufficient to account for
                                               how best to evaluate the performance of                 or persons with disabilities from the                 important life circumstances that may
                                               these programs.                                         earnings performance measure would                    affect the potential for employment and
                                                  12. Comment: Portability. Some                       discourage FSS programs from serving                  increased earnings. The most common
                                               commenters were concerned about                         these households.                                     variables they recommended be
                                               which PHA gets ‘‘credit’’ for FSS                          HUD Response: Elderly Individuals                  included were: Language, education
                                               participants who port out of their PHA                  and Persons with Disabilities. This                   level, childcare availability, family
                                               or into their PHA, although there was no                comment provides a good opportunity                   composition (including children of all
                                                                                                       to clarify that the methodology is                    ages and workable adults or presence of
khammond on DSK30JT082PROD with NOTICES




                                               consensus on how this should be
                                               addressed.                                              designed to achieve the opposite effect.              a household member with a disability),
                                                  HUD Response: Portability. If a family               Although program regulations require                  mental health, and additional
                                               ports, for the Participation Measure,                   FSS programs to serve any resident who                information about household
                                               each PHA (the receiving and the initial                 desires to participate and is able to                 composition. Some commenters also
                                               PHA) will benefit from the family’s FSS                 ‘‘seek and maintain employment,’’ see                 noted that FSS participants are different
                                               enrollment. For the earnings and FSS                    24 CFR 984.303(b)(4), some FSS                        than non-FSS participants in terms of
                                               graduation measures, the composite                      programs may be concerned that serving                motivation, resources, or barriers to


                                          VerDate Sep<11>2014   16:53 Nov 14, 2018   Jkt 247001   PO 00000   Frm 00098   Fmt 4703   Sfmt 4703   E:\FR\FM\15NON1.SGM   15NON1


                                                                         Federal Register / Vol. 83, No. 221 / Thursday, November 15, 2018 / Notices                                           57497

                                               employment, though there was                            geography as the FSS participants to                  program’s earnings performance score. It
                                               disagreement among commenters on                        which they are being compared but                     is also important to note that by
                                               whether FSS participants are more                       notes that this may be impossible to                  regulation, FSS programs may screen
                                               likely to have high barriers or low                     achieve at a very small level of                      families for interest and motivation to
                                               barriers.                                               geography, such as census tract or ZIP                participate in the FSS program, but such
                                                  HUD Response: Selecting Comparison                   code, due to an insufficient number of                programs are only permitted to screen
                                               Households. As described in the                         comparison households, especially at                  for permissible motivational screening
                                               December 12, 2017 Federal Register                      small PHAs. Moreover, households in                   factors, i.e., those which solely measure
                                               Notice, in selecting comparison                         neighboring census tracts or ZIP codes                the family’s interest and motivation to
                                               households for purposes of calculating                  are likely to still be in the same labor              participate in the FSS program. They
                                               the earnings performance measure, HUD                   market, and thus can still be effective               may not exclude interested households
                                               considered the following household                      comparators.                                          based on other, prohibited
                                               characteristics: Earnings as of the time                  In PHAs that serve a very large                     characteristics.2
                                               of the FSS household’s entry into FSS,                  geographical area, such as statewide                     7. Comment: Variations in Economic
                                               age of head of household, length of time                PHAs, however, this point may not hold                Conditions. Some commenters raised
                                               in the voucher or public housing                        true since the economic conditions may                the concern that the earnings measure
                                               program, number of adults in the                        be very different in different parts of the           advantages communities with higher
                                               household and number of children                        state. Accordingly, HUD plans to modify               wages and stronger employment
                                               under age 5. While some of the                          the protocol to require, under certain                opportunities (primarily urban areas)
                                               additional factors recommended by                       circumstances, that comparison                        and disadvantages communities with
                                               commenters are not available in the PIC                 households be in the same county and                  lower wages and weaker employment
                                               dataset used to compute the FSS                         PHA as the FSS participants to which                  opportunities (primarily rural and
                                               performance measures, several are,                      they are being compared. HUD will                     suburban areas).
                                               including: presence of children of any                  apply this protocol to all state PHAs and                HUD Response: Variations in
                                               age and presence of a household                         to non-State PHAs serving three or more               Economic Conditions. Because the
                                               member with a disability.                               counties where at least 10 percent of the             earnings performance score is calculated
                                                  In response to this comment, HUD has                 PHA’s housing choice voucher (HCV) or                 based on the difference between the
                                               considered whether the increased                        public housing households are leased in               earnings growth of FSS participants and
                                               precision of adding additional                          each of those counties. To ensure this                comparison households at the same
                                               comparison factors would outweigh the                   approach does not unduly dilute the                   PHA, it already controls to some extent
                                               dilution of the weight of the existing                  ability to find comparable households,                for difference in economic conditions.
                                               factors and lead to an insufficient                     HUD will require that FSS participants                Presumably, the comparison households
                                               number of comparison households.                        be matched to comparison households                   at a PHA in a stronger economic market
                                               Further analysis has determined that                    in the same county only in counties                   will experience greater earnings growth
                                               number of children under 18 is better                   where there are at least four times as                than the comparison households at a
                                               than presence of children under age 5 in                many non-FSS households as FSS                        PHA in a weaker economic market,
                                               predicting whether a household would                    households being served by the PHA.                   setting up a higher bar for FSS programs
                                               join FSS and therefore is a better factor                 6. Comment: Shifts in Enrollment.                   to exceed in the stronger market.
                                               in choosing comparison households.                      Many commenters were concerned that                      Based on these comments, however,
                                               HUD will therefore remove presence of                   the performance measures would                        HUD has conducted additional analysis
                                               children under age 5 from the factors                   encourage PHAs to recruit or enroll                   to determine if there are some residual
                                               used to match comparison households                     participants with a high probability of               effects of strong economic conditions
                                               and instead include number of children                  increases in earnings or chances of FSS               that are not accounted for in this
                                               under 18.                                               graduation. This comment arose most                   methodology and therefore a need to
                                                  After further analysis, it has been                  often for the earnings measure, though                account for it in assigning earnings
                                               determined that the presence of a child                 commenters differed on whether this                   performance scores. This analysis found
                                               with a disability and presence of a non-                would lead to recruiting minimally                    that there is in fact still a relationship
                                               head of household adult with a                          employed participants so that they had                between the earnings performance
                                               disability are not substantial factors                  room to grow or participants who are                  measures and county median income.
                                               predicting a household’s choice to                      already somewhat financially successful               Accordingly, HUD has decided to apply
                                               participate in FSS, but each of these                   and have high potential to increase                   an adjustment factor to the earnings
                                               factors is associated with a large and                  salaries without much intervention. A                 performance measure to account for the
                                               significant difference in a household’s                 few commenters raised the concern that                residual effect of local economic
                                               future earnings change. As a result,                    FSS programs will stop serving                        conditions.
                                               HUD will include both factors in                        participants with substantial barriers                   To compute this adjustment factor,
                                               selecting comparison households.                        who are riskier for the earnings and FSS              HUD first used a linear regression model
                                                  5. Comment: Location of Comparison                   graduation measures and require more                  to examine the relationship between the
                                               Households. A few commenters stated                     intensive intervention.                               earnings growth of comparison
                                               that households selected as comparisons                   HUD Response: Shifts in Enrollment.                 households within a PHA and the
                                               for purposes of the earnings                            HUD appreciates these concerns and                    average county median income of those
                                               performance measure should be                           would remind PHAs of the requirement                  households. On average, earnings
                                                                                                       to open the program equally to all                    growth of comparison households was
khammond on DSK30JT082PROD with NOTICES




                                               matched by similar census tract,
                                               neighborhood, or other measure of                       residents and administer the program                  higher in counties with high median
                                               geography, to account for local                         for the residents who sign up for it,                 incomes, and lower in counties with
                                               variations in opportunity.                              without trying to adjust enrollment to                low median incomes. HUD developed
                                                  HUD Response: Location of                            gain a higher score. As the commenters                an adjustment factor that eliminated this
                                               Comparison Households. HUD agrees                       note, earnings gains among both                       relationship and then applied this
                                               that it would be preferable to select                   unemployed participants and already
                                               comparison households from the same                     employed participants can help boost a                  2 24   CFR 984.203(c).



                                          VerDate Sep<11>2014   16:53 Nov 14, 2018   Jkt 247001   PO 00000   Frm 00099   Fmt 4703   Sfmt 4703   E:\FR\FM\15NON1.SGM     15NON1


                                               57498                     Federal Register / Vol. 83, No. 221 / Thursday, November 15, 2018 / Notices

                                               adjustment factor to the earnings                       A few commenters suggested that                       C. Comments on FSS Graduation Rate
                                               performance measure for each PHA,                       escrow accumulation be included as                    Measure
                                               resulting in an adjusted earnings                       part of or in addition to the earnings
                                               performance measure.                                    measure.                                                1. Comment: FSS Graduation Rate.
                                                  Using these adjusted earnings                                                                              Many commenters were concerned that
                                                                                                          HUD Response: Other Comments on                    the inclusion of an FSS graduation rate
                                               performance measures, HUD has                           the Earnings Measure. As noted in the
                                               recalculated the thresholds for awarding                                                                      measure would encourage PHAs to
                                                                                                       December 12, 2017 Federal Register                    graduate families quickly instead of
                                               a 10, 7.5, or 0 earnings performance                    Notice (at page 82 FR 58438–39), HUD
                                               score by focusing on the 80th, 60th, and                                                                      encouraging families to set ambitious
                                                                                                       chose to focus on average earnings                    employment goals in addition to the
                                               20th percentile, respectively, of the                   growth rather than median earnings
                                               distribution of adjusted measures. In                                                                         necessary requirements of maintaining
                                                                                                       growth to ensure that PHAs received                   entry level employment and being free
                                               selecting the revised thresholds, HUD                   credit for the major, transformative
                                               has analyzed the distribution of scores                                                                       of welfare cash assistance for twelve
                                                                                                       earnings gains experienced by some FSS                (12) months. Others noted that PHAs
                                               across all funded PHAs, rather than the                 participants, even if this experience was
                                               narrower universe described in the                                                                            define/operationalize some of the FSS
                                                                                                       not typical of the whole population of                graduation standards differently from
                                               December 12, 2017 Federal Register                      FSS participants. HUD appreciates that
                                               Notice at 82 FR 58437 (the earlier notice                                                                     one another, so this measure would not
                                                                                                       most commenters agreed with this                      be consistent across PHAs. A few
                                               included only PHAs whose earnings                       approach. However, HUD disagrees with
                                               performance measures have a significant                                                                       commenters said that the FSS
                                                                                                       adding new employment, employment                     graduation measure penalizes programs
                                               likelihood of being different from $0,
                                                                                                       retention, and escrow accumulation as                 for terminating non-compliant
                                               per a statistical test). This makes the
                                                                                                       additional measures or as part of the                 participants.
                                               methodology more consistent with how
                                                                                                       earnings measure. Households that
                                               HUD is calculating thresholds for the                                                                           HUD Response: FSS Graduation Rate.
                                                                                                       experience new employment and
                                               FSS graduation rate.                                                                                          FSS graduation is an important
                                                  8. Comment: Interim Earnings. Many                   escrow accumulation are likely to also
                                                                                                       experience increased earnings, since                  milestone in the FSS program. FSS
                                               commenters expressed the view that the                                                                        graduation marks the point at which
                                               results of interim reexaminations of                    these measures are strongly related.
                                                                                                       Accordingly, the inclusion of these                   FSS participants attain both their
                                               income should be included in analyzing                                                                        individual goals and the required
                                               earnings growth because they capture                    measures as additional measures would
                                                                                                       provide even heavier weight to earnings               program goals of employment and
                                               seasonal income, and the most recent                                                                          independence from welfare cash
                                               progress toward higher earnings. Several                than is already the case, which HUD
                                                                                                       does not believe to be appropriate. HUD               assistance. It also is the prerequisite for
                                               were also concerned that if participants                                                                      participants to receive the final
                                               reach a level of earnings where they no                 also notes that data on ‘‘new
                                                                                                       employment’’ is not currently collected               disbursement from their escrow
                                               longer receive any HAP, this increase in                                                                      accounts.
                                               earnings may only be captured by                        (though HUD could make inferences
                                               interim reexaminations and FSS exit                     about this from the PIC data) and that                  Together, the Earnings Performance
                                               reports.                                                this measure could disadvantage PHAs                  Measure, Graduation Rate, and
                                                  HUD Response: Interim Earnings. As                   that serve a population that generally                Participation Rate provide a balanced
                                               noted in the December 12, 2017 Federal                  enters FSS employed. Escrow is driven                 measurement of the performance of an
                                               Register Notice, HUD did not consider                   largely by earnings gains, though it is               individual FSS program. Because the
                                               the earnings reported through interim                   also affected by the loss of welfare                  Earnings Performance Measure is
                                               reexaminations of income in the                         assistance or other non-earnings income               weighted more heavily than the
                                               analysis of earnings gains because some                 and thus is less precise than earnings in             Graduation Rate, PHAs should balance
                                               PHAs conduct such reexaminations                        measuring earnings growth. Escrow                     the need to graduate participants with
                                               when income increases between annual                    accumulation also does not take into                  setting ambitious employment goals so
                                               reexaminations and others do not.                       account earnings gains for households                 participants can maximize their
                                               Excluding these interim results thus                    above 50 percent of Area Medium                       earnings growth while in the program.
                                               facilitates a direct comparison of local                Income (AMI), which is taken into                     In addition, while PHAs have the
                                               FSS programs. Further, participants’                    consideration by the earnings measure                 discretion to terminate the FSS
                                               incomes are not reexamined at the time                  currently in place. Additionally, until               participation of non-compliant
                                               of exit from FSS. While excluding                       HUD has published a regulation or                     participants, HUD would encourage
                                               interim reexaminations will mean                        notice that implements Section 102 of                 PHAs to first work with participants to
                                               missing certain earnings changes, such                  Housing Opportunity Through                           determine if their challenges can be
                                               as when a family’s earnings increase to                 Modernization Act of 2016 (HOTMA),                    addressed so participants can
                                               the point where they are paying zero                    residents who are subject to the Earned               successfully complete the FSS program.
                                               HAP, HUD has determined that their                      Income Disregard will have their escrow               Additional guidance can be found in the
                                               inclusion would make it difficult to                    affected by that policy (in that escrow               FSS Promising Practices Guidebook.
                                               compare results across PHAs, an                         will not grow while income is                         D. Comments on Participation Rate
                                               essential element of the performance                    disregarded for rent calculation                      Measure
                                               measurement system.                                     purposes). While the current measure
                                                  9. Comment: Other Comments on the                    does not directly measure employment                    1. Comment: Top Participation
                                               Earnings Measure. Most commenters                       retention, it does factor it in since an              Scores. Many commenters expressed the
khammond on DSK30JT082PROD with NOTICES




                                               agreed that averages were more                          FSS participant who retains his or her                view that having the top scores for
                                               appropriate than medians for the                        job while a comparison household does                 participation substantially higher than
                                               earnings measure. A few commenters                      not will experience greater gains in                  the minimum a PHA is expected to
                                               stated that new employment and/or                       earnings (zero) than the comparison                   serve with HUD funding is unfair and
                                               employment retention should be                          household (a negative number), boosting               encourages PHAs to enroll more people
                                               included as part of the earnings measure                the PHAs’ average earnings performance                than they can effectively serve. A few
                                               or in addition to the earnings measure.                 score.                                                saw it as an unfunded mandate.


                                          VerDate Sep<11>2014   16:53 Nov 14, 2018   Jkt 247001   PO 00000   Frm 00100   Fmt 4703   Sfmt 4703   E:\FR\FM\15NON1.SGM   15NON1


                                                                         Federal Register / Vol. 83, No. 221 / Thursday, November 15, 2018 / Notices                                          57499

                                                  HUD Response: Top Participation                      to reward incremental improvements in                 and so, did not account for variations in
                                               Scores. All PHAs that serve the                         participation rates, rather than only                 participant goals. Some commenters felt
                                               minimum number of participants                          participation rates that exceed one of                that FSS graduation and participation
                                               expected based on the level of HUD                      two specific thresholds. Accordingly,                 should have the same weight, regardless
                                               coordinator funding will receive at least               HUD will assign PHAs with                             of the weight of the earnings measure.
                                               a 5 as a participation score. If a PHA can              participation rates above .95 a score of              One reason given for this is that
                                               attain strong earnings and FSS                          5, 6, 7, 8, 9 or 10, depending on their               participation is essential for FSS
                                               graduation results while exceeding this                 participation rate, as specified in                   graduation. Another was that weighting
                                               minimum, however, HUD wishes to                         Section III of this notice. A score of 10             FSS graduation rate too highly
                                               encourage them to do so as this helps                   will be awarded for a participation rate              compared to participation would
                                               to maximize the number of families                      at or above 2.0, which is close to the
                                                                                                                                                             encourage PHAs to graduate families
                                               benefitting from the FSS program. This                  80th percentile level HUD previously
                                                                                                                                                             before they had met ambitious goals.
                                               is the reason for assigning higher                      identified.
                                               participation scores to PHAs that                          2. Comment: Participation Rate and                   HUD Response: Weighting. HUD
                                               achieve higher participation levels.                    PHA Size. A few commenters said that                  appreciates the range of views expressed
                                               Since earnings is weighted much more                    the participation rate measure                        on this matter. After considering the
                                               heavily than participation, however,                    disadvantages either large PHAs/                      comments, HUD plans to retain the
                                               HUD emphasizes that PHAs should only                    programs or small ones. For small                     weighting specified in the December 12,
                                               increase their caseloads if and to the                  programs in small PHAs, there may be                  2017 Federal Register Notice. Earnings
                                               extent they can do so without                           less opportunity to recruit participants              represent by far the most powerful and
                                               undermining their earnings and FSS                      and smaller economies of scale for the                objective measure available to HUD.
                                               graduation results.                                     coordinator. For large programs,                      While there are many goals to which
                                                  HUD examined FSS performance data                    increases in the number of participants               FSS participants aspire, the
                                               to determine if there is a correlation                  enrolled would have to be very large in               achievement of most of these should
                                               between a PHA’s participation rate and                  order to increase the participation score.
                                                                                                                                                             lead to higher earnings which can then
                                               its earnings and FSS graduation rate,                      HUD Response: Participation Rate
                                                                                                       and PHA Size. The commenters are split                be measured through the earnings
                                               paying particular attention to the
                                               participation rate threshold for                        about whether the participation rate                  performance measure. Accordingly,
                                               obtaining a score of 10 points (80th                    calculation benefits smaller or larger                HUD believes that a weight of 50
                                               percentile). This analysis did not find a               PHAs. HUD believes this reflects the                  percent is appropriate.
                                               strong relationship between                             reality that all PHAs (regardless of size)               While there is a case for weighting
                                               participation rate and earnings                         have the potential to obtain either a high            FSS graduation rate and participation
                                               performance measure. In fact, PHAs                      or a low participation rate, depending                rate equally, HUD believes weights of 30
                                               with participation rates between the                    on how they manage their FSS program.                 percent for the FSS graduation rate and
                                               80th and 90th percentile had the highest                This is confirmed by the fact that, in the            20 percent of the participation rate are
                                               average earnings performance measure                    initial spreadsheet of PHA scores, PHAs               appropriate. As noted above, FSS
                                               of any decile and a median earnings                     of all sizes are well represented at each             graduation is an important milestone for
                                               performance measure that was typical                    of the participation score levels. While              the FSS program and HUD would like
                                               for the sample as a whole, confirming                   all PHAs must comply with the
                                                                                                                                                             to see PHAs raise FSS graduation rates.
                                               that the threshold for obtaining a score                minimum enrollment requirements
                                                                                                                                                             HUD would also like to see PHAs serve
                                               of 10 points is not one that leads to                   associated with the receipt of HUD
                                               lower earnings performance scores.                                                                            more families if and to the extent they
                                                                                                       coordinator funding, each PHA should
                                                  In terms of FSS graduation rates, the                make a determination of how many                      can do so without jeopardizing their
                                               median FSS graduation rate was fairly                   families they can serve effectively above             achievement of strong earnings and FSS
                                               similar for most deciles of participation               this minimum based on their staff                     graduation rates. Weighting FSS
                                               rate, except for the very highest and                   capacity, the intensity of participants’              graduation rate more heavily than
                                               lowest deciles, which both had lower                    needs, and other resources available at               participation rate is consistent with
                                               FSS graduation rates than the other                     the PHA and from partner organizations.               HUD’s goal of not creating incentives for
                                               deciles. However, the threshold for                     HUD encourages PHAs to serve as many                  PHAs to raise caseloads beyond the
                                               qualifying for 10 points on the                         households as they can, so long as they               point where families can be served
                                               participation rate is set at the 80th                   do not exceed the level they can                      effectively.
                                               percentile and not the 90th percentile                  effectively support. Additionally, as
                                               (the starting point for the highest decile)                                                                   III. Final Thresholds
                                                                                                       explained above, there is no clear
                                               and PHAs with participation rates                       correlation between a PHA’s size and                  A. Summary of Adjustments to FSS
                                               between the 80th and 90th percentile                    the overall composite score.                          Performance Score Methodology
                                               had median and average FSS graduation
                                               rates that were typical for the sample as               E. Comments on Weighting of the                         After considering all of the public
                                               a whole, confirming that this threshold                 Measures
                                                                                                                                                             comments, HUD is adopting the
                                               does not inherently lead to sub-par                       1. Comment: Weighting. Several                      proposed FSS performance
                                               performance.                                            commenters felt that the weights are                  measurement system, with the
                                                  Based on this analysis, HUD has                      appropriate and did not comment
khammond on DSK30JT082PROD with NOTICES




                                                                                                                                                             adjustments noted above, which will
                                               determined that it is appropriate to                    further. Many commenters expressed                    henceforth be used by HUD to evaluate
                                               encourage PHAs to adopt higher                          the view that the earnings measure is                 the performance of PHAs receiving HUD
                                               participation rates, so long as they can                weighted too highly. Commenters who                   program coordinator funding. These
                                               do so without compromising their                        suggested this were often concerned that              adjustments are summarized in the table
                                               earnings performance and FSS                            the earnings measure would not show                   below:
                                               graduation rates. However, HUD has                      progress for FSS participants in longer-
                                               decided to change the final scoring so as               running education or training programs


                                          VerDate Sep<11>2014   16:53 Nov 14, 2018   Jkt 247001   PO 00000   Frm 00101   Fmt 4703   Sfmt 4703   E:\FR\FM\15NON1.SGM   15NON1


                                               57500                            Federal Register / Vol. 83, No. 221 / Thursday, November 15, 2018 / Notices

                                                                                     CHANGES TO METHODOLOGY FOR COMPUTING FSS PERFORMANCE SCORES
                                               Overall ................................   • Where a family ports, each PHA (the receiving and the initial PHA) will benefit from the family’s FSS enrollment
                                                                                            as it relates to the PHA’s participation measure. For the earnings and FSS graduation measures, HUD will in-
                                                                                            clude the family for the PHA who currently administers the FSS contract.
                                                                                          • HUD will treat joint applicants as a single PHA for purposes of computing all three components of the FSS per-
                                                                                            formance score.
                                               Earnings Performance                       • In calculating the earnings performance score, HUD will exclude FSS participants who become classified as dis-
                                                 Score.                                     abled at any point during their participation.
                                                                                          • HUD will include within the earnings measure FSS participants that begin the FSS contract below age 62, even
                                                                                            if they reach or exceed the age of 62 during their Contract of Participation.
                                                                                          • In selecting comparison households, HUD will match FSS families with comparison families based on the num-
                                                                                            ber of children under the age of 18, rather than the presence of child under age 5. HUD will also match FSS
                                                                                            families with comparison families based on presence of a child with a disability and presence of a non-head of
                                                                                            household adult with a disability.
                                                                                          • Under certain circumstances, HUD will require that comparison households be in the same county and PHA as
                                                                                            the FSS participants to which they are being compared. HUD will apply this protocol to all state PHAs and to
                                                                                            any additional PHAs where three or more counties are each home to at least 10 percent of households receiv-
                                                                                            ing housing assistance from the PHA (through HCV or public housing). To ensure this approach does not unduly
                                                                                            dilute the ability to find comparable households, HUD will require that FSS participants be matched to compari-
                                                                                            son households in the same county only in counties where there are at least four times as many non-FSS
                                                                                            households as FSS households being served by the PHA.
                                                                                          • HUD will apply an adjustment factor to the earnings performance measure to account for variations in local eco-
                                                                                            nomic conditions.



                                                 After making these adjustments to the                        $6,302 (see December 12, 2017 Federal                   • Category 2: FSS Performance score
                                               methodology, HUD has recalculated the                          Register Notice at page 82 FR 58437 for               between 4.26 and 7.99.
                                               thresholds for translating the FSS                             an explanation of this statistical test).               • Category 3: FSS Performance score
                                               performance measures into individual                              • 5 points: All PHAs that do not                   between 3.26 and 4.25.
                                               component scores and the final                                 qualify for a 10, 7.5, or a 0.                          • Category 4: FSS Performance score
                                               composite score and notes the final                               b. FSS Graduation Rate (30 percent of              of 3.25 or lower.
                                               thresholds below.                                              final score):
                                                                                                                 • 10 points: FSS graduation rate of 38             IV. Environmental Impact
                                               B. Updated Thresholds for FSS                                  percent or higher.                                       This notice does not direct, provide
                                               Performance Scores                                                • 7.5 points: FSS graduation rate                  for assistance or loan and mortgage
                                                 The following are the updated                                between 28 percent and 37.9 percent.                  insurance for, or otherwise govern or
                                               thresholds HUD will use to compute an                             • 0 points: FSS graduation rate below              regulate, real property acquisition,
                                               FSS Performance Score for each PHA.                            10 percent.                                           disposition, leasing, rehabilitation,
                                               See the December 12, 2017 Federal                                 • 5 points: All PHAs that do not                   alteration, demolition, or new
                                               Register Notice and the updated                                qualify for a 10, 7.5, or a 0                         construction, or establish, revise or
                                               complete methodology, which can be                                c. Participation Rate (20 percent of               provide for standards for construction or
                                               found on HUD’s website at https://                             final score):                                         construction materials, manufactured
                                               www.hud.gov/program_offices/public_                               • 10 points: Participation rate of 2.0             housing, or occupancy. Accordingly,
                                               indian_housing/programs/hcv/fss, for                           or higher.                                            under 24 CFR 50.19(c)(1), this notice is
                                                                                                                 • 9 points: Participation rate between
                                               more information on each of the two                                                                                  categorically excluded from
                                                                                                              1.8 and 1.99.
                                               steps in this process.                                                                                               environmental review under the
                                                                                                                 • 8 points: Participation rate between
                                                                                                                                                                    National Environmental Policy Act of
                                               1. Step One: Assigning Scores to Each                          1.6 and 1.79.
                                                                                                                 • 7 points: Participation rate between             1969 (42 U.S.C. 4321).
                                               of the Three Measures
                                                                                                              1.4 and 1.59.                                           Dated: November 7, 2018.
                                                  In Step One, HUD will assign a score                           • 6 points: Participation rate between             Dominique Blom,
                                               of 0 to 10 to each PHA’s FSS program                           1.2 and 1.39.                                         General Deputy Assistant Secretary, Public
                                               for each of the three measures. Scores                            • 5 points: Participation rate between             and Indian Housing.
                                               will be assigned using the thresholds                          .96 and 1.19.                                         [FR Doc. 2018–24949 Filed 11–14–18; 8:45 am]
                                               and procedures described below. The                               • 0 points: Participation rate of .95 or           BILLING CODE 4210–67–P
                                               ranges for awarding points between two                         lower.
                                               values include those values as well as
                                               all intermediary values.                                       2. Step Two: Developing the Final FSS
                                                  a. Earnings Performance Measure (50                         Performance Score and Grade                           DEPARTMENT OF THE INTERIOR
                                               percent of final score):                                          In Step Two, after computing
                                                  • 10 points: Earnings performance                           individual scores for each of the three               Fish and Wildlife Service
                                               measure of $8,700 or higher.                                   measures, HUD will aggregate each
                                                  • 7.5 points: Earnings performance                          PHA’s scores using the weights noted                  [FWS–R3–ES–2018–N115;
khammond on DSK30JT082PROD with NOTICES




                                               measure between $6,950 and $8,699.99.                                                                                FXES11130300000–189–FF03E00000]
                                                                                                              above to develop a final FSS
                                                  • 0 points: Earnings performance                            Performance Score from 0 to 10. Based                 Endangered and Threatened Species;
                                               measure below $4,050 and a p-value of                          on this score, HUD will assign the                    Receipt of Recovery Permit
                                               <.10 on a statistical test measuring the                       following ranking to the PHA’s                        Applications
                                               likelihood that a PHA’s earnings                               performance:
                                               performance measure is significantly                              • Category 1: FSS Performance score                AGENCY:     Fish and Wildlife Service,
                                               lower than the median measure of                               of 8.0 or higher.                                     Interior.


                                          VerDate Sep<11>2014       16:53 Nov 14, 2018      Jkt 247001   PO 00000   Frm 00102   Fmt 4703   Sfmt 4703   E:\FR\FM\15NON1.SGM   15NON1



Document Created: 2018-11-15 04:00:00
Document Modified: 2018-11-15 04:00:00
CategoryRegulatory Information
CollectionFederal Register
sudoc ClassAE 2.7:
GS 4.107:
AE 2.106:
PublisherOffice of the Federal Register, National Archives and Records Administration
SectionNotices
ActionNotice of new performance measurement system (``Composite Score'') for the Family Self-Sufficiency Program.
DatesApplicability Date: December 17, 2018.
ContactQuestions on this notice may be
FR Citation83 FR 57493 

2024 Federal Register | Disclaimer | Privacy Policy
USC | CFR | eCFR