81_FR_2887 81 FR 2876 - Announcement of Requirements and Registration for “Pill Image Recognition Challenge”

81 FR 2876 - Announcement of Requirements and Registration for “Pill Image Recognition Challenge”

DEPARTMENT OF HEALTH AND HUMAN SERVICES
National Institutes of Health

Federal Register Volume 81, Issue 11 (January 19, 2016)

Page Range2876-2879
FR Document2016-00777

The Pill Image Recognition Challenge is a National Institutes of Health (NIH) Challenge under the America COMPETES (Creating Opportunities to Meaningfully Promote Excellence in Technology, Education, and Science) Reauthorization Act of 2010 (Pub. L. 111-358). Through this Challenge, the National Library of Medicine (NLM), part of NIH, seeks algorithms and software to match images of prescription oral solid-dose pharmaceutical medications (pills, including capsules and tablets). The objective of the Challenge is the development and discovery of high-quality algorithms and software that rank how well consumer images of prescription pills match reference images of pills in the authoritative NLM RxIMAGE database. NLM may use all or part of any Challenge entry (i.e., algorithm and software) to create a future software system and a future API (Application Programming Interface) for pill image recognition; the system will be freely usable and the API will be freely accessible.

Federal Register, Volume 81 Issue 11 (Tuesday, January 19, 2016)
[Federal Register Volume 81, Number 11 (Tuesday, January 19, 2016)]
[Notices]
[Pages 2876-2879]
From the Federal Register Online  [www.thefederalregister.org]
[FR Doc No: 2016-00777]


-----------------------------------------------------------------------

DEPARTMENT OF HEALTH AND HUMAN SERVICES

National Institutes of Health


Announcement of Requirements and Registration for ``Pill Image 
Recognition Challenge''

    Authority: 15 U.S.C. 3719

SUMMARY: The Pill Image Recognition Challenge is a National Institutes 
of Health (NIH) Challenge under the America COMPETES (Creating 
Opportunities to Meaningfully Promote Excellence in Technology, 
Education, and Science) Reauthorization Act of 2010 (Pub. L. 111-358). 
Through this Challenge, the National Library of Medicine (NLM), part of 
NIH, seeks algorithms and software to match images of prescription oral 
solid-dose pharmaceutical medications (pills, including capsules and 
tablets). The objective of the Challenge is the development and 
discovery of high-quality algorithms and software that rank how well 
consumer images of prescription pills match reference images of pills 
in the authoritative NLM RxIMAGE database. NLM may use all or part of 
any Challenge entry (i.e., algorithm and software) to create a future 
software system and a future API (Application Programming Interface) 
for pill image recognition; the system will be freely usable and the 
API will be freely accessible.

DATES: NLM will make a set of consumer-quality images and a companion 
set of reference images publicly available on January 15, 2016.
    The Challenge begins January 19, 2016.
    Submission period: April 4, 2016 to May 31, 2016.
    Judging period: June 6, 2016 to July 15, 2016.
    Winners announced: August 1, 2016.
    Submissions received by NLM after the submission period ends will 
not be considered. A submission is considered to meet the submission 
deadline if it is received by May 31, 2016, 5:00 p.m. EDT. While NLM 
plans to acknowledge receipt of each Challenge submission, the 
Government is under no obligation to acknowledge receipt of the 
information received or provide feedback to respondents with respect to 
any information submitted. NLM will amend this Federal Register notice 
if the timeline or the rules for the Challenge are modified. In 
addition, NLM will notify registered Challenge participants by email of 
any amendments and will include the modified Challenge showing the 
changes.

ADDRESSES: Notifications of any amendment to this Federal Register 
notice and answers to frequently asked questions about it will be 
posted at http://pir.nlm.nih.gov/challenge/notifications-and-FAQs. 
Submissions must be mailed to: Pill Image Recognition Challenge, 
Computational Photography Project for Pill Identification (C3PI), 
National Library of Medicine, Building 38A, Room B1-N30, 8600 Rockville 
Pike, Bethesda, MD 20894.

FOR FURTHER INFORMATION CONTACT: Michael J. Ackerman, Ph.D. at (301) 
402-4100 or [email protected].

SUPPLEMENTARY INFORMATION: 

The IC's Statutory Authority To Conduct the Challenge

    What has become today's National Library of Medicine began in 1836 
as a small collection of medical books and journals in the office of 
the U.S. Army Surgeon General. A 1956 act of Congress (Pub. L. 84-941) 
transferred the library to the Public Health Service and gave it its 
current name. That law authorizes NLM to ``assist the advancement of 
medical and related sciences and to aid the dissemination and exchange 
of scientific and other information important to the progress of 
medicine and to the public health'' and to ``promote the use of 
computers and telecommunications by health professionals (including 
health professionals in rural areas) for the purpose of improving 
access to biomedical information for health care delivery and medical 
research.'' In addition to its subject-matter authority, NLM is 
conducting this competition under the America COMPETES Reauthorization 
Act of 2010 (Pub. L. 111-358).

Subject of Challenge

    Unidentified and misidentified prescription pills present 
challenges for patients and professionals. Unidentified pills can be 
found by family members, health professionals, educators, and law 
enforcement. The nine out of 10 U.S. citizens over age 65 who take more 
than one prescription pill can be prone to misidentifying those pills. 
Taking such pills can result in adverse drug events that affect health 
or cause death. To reduce such errors, any person should easily be able 
to confirm that a prescription pill or a refill is correct. For 
example, a person should be able to easily verify--or not--that a 
refill that has a different color, shape, or text imprinted on the pill 
is a different generic version of equivalent drugs he or she was 
already taking.
    To help address these problems, the NLM Computational Photography 
Project for Pill Identification (C3PI) is developing infrastructure and 
tools for identifying prescription pills. The infrastructure includes 
photographs of such pills taken under laboratory lighting conditions, 
from a camera directly above the front and the back faces of the pill, 
and at high resolution. Specialized digital macro-photography 
techniques were then used to capture JPEG pill images. The NLM RxIMAGE 
database contains these high-quality images and associated pill data 
such as appearance (color, shape, size, text imprinted on the pill, 
etc.), ingredients, and identifiers such as its National Drug Code 
(NDC) [http://www.fda.gov/Drugs/InformationOnDrugs/ucm142438.htm]. 
RxIMAGE images and data are freely available. The freely accessible 
RxIMAGE API provides text-based search and retrieval of images and data 
from the RxIMAGE database. By contributing their algorithm and 
software, Challenge participants will take part in a broader NLM effort 
to develop a freely usable software system and a freely accessible API 
for image-based search and retrieval from a mobile device.
    In a typical scenario for a future NLM mobile app, a person will 
download the app and use it to photograph a prescription pill, possibly 
under poor lighting conditions, from an angle, or at low resolution. 
The future app will communicate with the future pill image recognition 
software system, which may use all or part of any Challenge entry, to 
compare that photo to reference images in the RxIMAGE database, and 
will return one or more reference images that most likely match the 
photographed pill along with their associated pill data.

[[Page 2877]]

    NLM provides two directories of images to Challenge participants 
for use in preparing their submissions:
     Directory DR contains 2000 JPEG reference images of 1000 
pills. For each pill there are two reference images, one of the front 
of the pill and one of the back of the pill. These pill images are the 
same as in the RxIMAGE database.
     Directory DC contains 5000 JPEG consumer-quality images of 
the same 1000 pills that were photographed for DR. However, they were 
taken with a variety of digital cameras, under various lighting 
conditions, and at camera angles not necessarily perpendicular to the 
faces of the pills. They are akin to photos of prescription pills that 
the general public might take.
    For a pill for which there is at least one consumer-quality image 
in DC, DR has two reference images of that pill, one of the front of 
the pill and one of the back of the pill. Conversely, for a pill for 
which there are two reference images in DR (one of the front of the 
pill and one of the back of the pill), DC has two or more consumer-
quality images of that pill, taken under different conditions.
    DR and DC come with a ``ground truth table'' that is a two-column 
table with column headers ref_images and cons_images. Each row of the 
table gives in the first column the name of a reference image and in 
the second column the name of a consumer-quality image corresponding to 
that reference image. There is a separate row in the table for each 
(reference image, consumer-quality image) pair, even when multiple 
reference and consumer-quality images are all photos of the same pill. 
Respondents can use the images in DR and DC, the ground truth table, 
and the RxIMAGE database in developing, training, and validating their 
algorithms and software. They can also supplement these data.

Rules for Participating in the Challenge

    Teams of one or more members can participate in this Challenge. 
There is no maximum team size. Each team must have a captain. 
Individual team members and team captains must register in accordance 
with the Registration Process for Participants below. The role of the 
team captain is to serve as the corresponding participant with NLM 
about the Challenge and to submit the team's Challenge entry. While NLM 
will notify all registered Challenge participants by email of any 
amendments to the Challenge, the team captain is expected to keep the 
team members informed about matters germane to the Challenge.
    (1) To be eligible to win the Challenge prize, a team--
    a. Shall have registered to participate in the Challenge under the 
rules promulgated by the NIH as published in this Notice;
    b. Shall have complied with all the requirements set forth in this 
Notice;
    c. In the case of a private entity, shall be incorporated in and 
maintain a primary place of business in the United States, and in the 
case of an individual, whether participating singly or in a group, 
shall be a citizen or permanent resident of the United States. However, 
non-U.S. citizens and non-permanent residents can participate as a 
member of a team that otherwise satisfies the eligibility criteria. 
Non-U.S. citizens and non-permanent residents are not eligible to win a 
monetary prize (in whole or in part). Their participation as part of a 
winning team, if applicable, may be recognized when the results are 
announced.
    d. May not be a Federal entity;
    e. May not be a Federal employee acting within the scope of the 
employee's employment and further, in the case of HHS employees, may 
not work on their submission(s) during assigned duty hours. Note: 
Federal ethical conduct rules may restrict or prohibit Federal 
employees from engaging in certain outside activities, so any Federal 
employee seeking to participate in this Challenge outside the scope of 
employment should consult his/her agency's ethics official prior to 
developing an submission;
    f. May not be an employee of the NIH, a judge of the challenge, or 
any other party involved with the design, production, execution, or 
distribution of the Challenge or the immediate family of such a party 
(i.e., spouse, parent, step-parent, child, or step-child).
    g. All team members must be at least 18 years old at the time of 
submission.
    (2) Federal grantees may not use Federal funds to develop their 
Challenge submissions unless use of such funds is consistent with the 
purpose of their grant award and specifically requested to do so due to 
the Challenge design, and as announced in the Federal Register.
    (3) Federal contractors may not use Federal funds from a contract 
to develop their Challenge submissions or to fund efforts in support of 
their Challenge submission.
    (4) By participating in this Challenge, each individual (whether 
competing singly or in a group) and entity agrees to assume any and all 
risks and waive claims against the Federal government and its related 
entities (as defined in the COMPETES Act), except in the case of 
willful misconduct, for any injury, death, damage, or loss of property, 
revenue, or profits, whether direct, indirect, or consequential, 
arising from participation in this Challenge, whether the injury, 
death, damage, or loss arises through negligence or otherwise.
    (5) Based on the subject matter of the Challenge, the type of work 
that it will possibly require, as well as an analysis of the likelihood 
of any claims for death, bodily injury, property damage, or loss 
potentially resulting from Challenge participation, no individual 
(whether competing singly or in a group) or entity participating in the 
Challenge is required to obtain liability insurance or demonstrate 
financial responsibility in order to participate in this Challenge.
    (6) By participating in this Challenge, each individual (whether 
competing singly or in a group) and entity agrees to indemnify the 
Federal government against third party claims for damages arising from 
or related to Challenge activities.
    (7) An individual or entity shall not be deemed ineligible because 
the individual or entity used Federal facilities or consulted with 
Federal employees during the Challenge if the facilities and employees 
are made available to all individuals and entities participating in the 
Challenge on an equitable basis.
    (8) By participating in this Challenge, each individual (whether 
participating singly or in a group) and entity grants to the NIH, in 
any existing or inchoate copyright or patent rights owned by the 
individual or entity, an irrevocable, paid-up, royalty-free, 
nonexclusive worldwide license to use, reproduce, post, link to, share, 
and display publicly on the Web the submission, except for source code. 
This license includes without limitation posting or linking to the 
submission, except for source code, on the NLM Pill Image Recognition 
Web site [http://pir.nlm.nih.gov/challenge]. In developing its future 
software system and future API, NLM may include algorithms and software 
from Challenge entries and may consult with individuals or teams that 
submitted entries. Thus, the license also permits NLM to develop the 
future software system and the future API, independently or with 
others, using any algorithms or software from Challenge entries, 
including those obtained from other Challenges or solicitations, and 
NLM may freely use, reproduce, modify and distribute the resulting 
future software system and API without restriction. NLM may work with 
individuals or teams that submitted entries to write articles about 
pill image recognition and submit them to peer-

[[Page 2878]]

reviewed journals. Each participant will retain all other intellectual 
property rights in their submissions, as applicable.
    (9) NIH reserves the right, in its sole discretion, to (a) cancel, 
suspend, or modify the Challenge through amendment to this Federal 
Register notice, and/or (b) not award any prizes if no entries are 
deemed worthy. In addition, NLM reserves the right to disqualify any 
Challenge participants or entries in instances where cheating or other 
misconduct is identified.
    (10) Each individual (whether participating singly or in a group) 
or entity agrees to follow all applicable federal, state, and local 
laws, regulations, and policies.
    (11) Each individual (whether participating singly or in a group) 
and entity participating in this Challenge must comply with all terms 
and conditions of these rules, and participation in this Challenge 
constitutes each such participant's full and unconditional agreement to 
abide by these rules. Winning is contingent upon fulfilling all 
requirements herein.
    (12) Each individual (whether participating singly or in a group) 
and entity grants to NLM and NLM contractors assisting NLM with C3PI 
the right to review the submission, study the algorithms and the code, 
and run the software on other sets of images.
    (13) Submissions must not infringe upon any copyright, patent, 
trade secrets, or any other rights of any third party. Each individual 
(whether participating singly or in a group) or entity warrants that 
he/she or the team is the sole author and owner of any copyrightable 
work that the submission comprises, that the submission is wholly 
original with the participant or is an improved version of an existing 
work that the participant has sufficient rights to use and improve. In 
addition, the submission must not trigger any reporting or royalty 
obligation to any third party. A submission must not include 
proprietary, classified, confidential, or sensitive information.
    (14) The submission does not contain malicious code such as 
viruses, timebombs, cancelbots, worms, trojan horses, or other 
potentially harmful programs or other material or information.
    (15) Notwithstanding the above and consistent with the principal 
objective of the Challenge to make results widely available to the 
public. If the submitter distributes their executable code or source 
code NLM encourages every individual and team to distribute their 
submission's executable code and preferably also its source code to the 
public under an Apache 2.0 License that permits the public to benefit 
from and improve upon the submission. In this case and by mutual 
agreement, NLM may also post or link to the code from the Pill Image 
Recognition Web site. The entry must include a description of how and 
under what license terms it intends to make any code that is part of 
the entry available to the public.
    (16) Challenge participants are free to discuss their submission 
and the ideas and technologies that it contains with other parties, 
except as stated in #7 above and are free to contract with any third 
parties so long as they do not sign any agreement or undertake any 
obligation that conflicts with any agreement that they have entered 
into, such as with any team members, or do enter into regarding their 
submission for the Challenge. For the purpose of clarity, Challenge 
participants acknowledge that the intent of the Challenge is to 
encourage people to collaborate and share ideas and innovations.

Registration Process for Participants

    To participate in this Challenge, team captains must register their 
teams, including providing the names and email addresses of all team 
members, at http://pir.nlm.nih.gov/challenge/register. Early 
registration is encouraged in order to be able to receive email 
notifications if this Federal Register notice is amended to change the 
timeline or the rules of this Challenge.

Submission Requirements

    Participants must provide a complete submission as defined below to 
be considered for the prize. The submission must be saved to a USB 
storage device containing a virtual machine and must be received (not 
simply post-marked) by NLM by May 31, 2016, 5 p.m. EDT. Submissions 
must be mailed to: Pill Image Recognition Challenge, Computational 
Photography Project for Pill Identification (C3PI), National Library of 
Medicine, Building 38A, Room B1-N30, 8600 Rockville Pike, Bethesda, MD 
20894.
    The Submission is defined to include:
    1. Executable software for ranking how well consumer images of 
pills taken by digital cameras match reference images. The software 
shall be a batch-mode program or a script whose input consists of a 
directory of consumer images and a directory of reference images. The 
output shall be a comma-separated-value (csv) M-by-N matrix MR of ranks 
that for i = 1,...,M compares consumer image i with reference images j 
= 1,...,N. For each consumer image, no rank can appear more than once. 
The software does not need to identify pills by name.
    2. Source code for the executable that is both human- and machine-
readable. The source code can be written in any programming 
language(s).
    3. A .csv file containing the matrix MRC (C for Challenge) of ranks 
that is the output from executing the executable using DC and DR as 
input. In this case MRC is a matrix that has at least 5000 rows and has 
2000 columns. For each row i, MRC(i,j) will rank how well reference 
image j matches consumer-quality image i, for j = 1,...,2000. If 
reference image J best matches consumer-quality image I then MRC(I,J) = 
1, and if reference image K is the worst match to consume-quality image 
I then MRC(I,K) = 2000.
    4. A text file written in English and containing the algorithm in 
pseudo-code that the source code implements, and a description of how 
it works and any tools or packages that it uses. The pseudo-code is to 
have the complete pipeline from the input directories to a matrix of 
ranks, and also include any code that implements features or does 
offline training.
    5. A one-page text file written in English that contains the 
following:
a. Title of entry
b. Names and email addresses of the team captain and all team members
c. A five or more character identifier for the entry that is used as a 
prefix in the names of all of the team's submitted files
d. A brief description of the submission

Amount of the Prize; Award Approving Official

    Up to five monetary prizes may be awarded: $25,000 for 1st Place, 
$15,000 for 2nd Place, $5,000 for 3rd Place, and two $2,500 prizes for 
Honorable Mention for a total prize award pool of up to $50,000. The 
names of the winners and the titles of their entries will be posted on 
NLM Web sites. The Award Approving Official is the Director of the 
National Library of Medicine.

Payment of the Prize

    Prizes awarded under this Challenge will be paid by electronic 
funds transfer and may be subject to Federal income taxes. HHS/NIH will 
comply with IRS (U.S. Internal Revenue Service) withholding and 
reporting requirements, where applicable.

Basis Upon Which Winners Will Be Selected

    NLM will first review submissions to determine their suitability 
for judging and eligibility to win the prize. An

[[Page 2879]]

eligible submission (a) complies with the rules in this Federal 
Register notice, (b) follows the detailed submission instructions at 
http://pir.nlm.nih.gov/challenge/, (c) is complete (e.g., meets the 
Submission Requirements above), and (d) is confirmed by NLM that the 
executable is an implementation of the submitted source code, can be 
run on the submitted virtual machine using directories DC and DR as 
input, and the output matrix is the same as the submission's matrix 
MRC.
    Eligible submissions will proceed to the judging process, and will 
be evaluated based on how well the submissions can match pill images 
across a large number of queries. NLM has developed evaluation software 
and created directories of images to use in selecting the Challenge 
winners. For example, directories DRJ and DCJ (J for Judging) contain 
reference and consumer-quality images similar to those in directories 
DR and DC provided to potential Challenge participants, and the ground 
truth matrix for judging MGTJ has MGTJ(i,j)=1 if DCJ(i) and DRJ(j) are 
photos of the same pill, else MGTJ(i,j)=0. The evaluation software 
calculates the mean average precision (MAP) for directories and ground 
truth matrix such as DRJ, DRC, and MGTJ. Mean average precision is a 
widely used measure for evaluating how well information retrieval 
systems (for example, search engines) retrieve results across a large 
number of queries. The MAP formula and examples of MAP calculations for 
this Challenge are at http://pir.nlm.nih.gov/challenge/MAP_example.
    The eligible submissions will be submitted to the evaluation 
software. The submission with the highest MAP score will be recommended 
as the first place winner, with the second, third, fourth, and fifth 
best MAPs, respectively being recommended to earn second place, third 
place, and two honorable mentions. In the event of tied scores, the 
tied submissions will be tested against additional DRJ and DCJ 
directories until a winner is determined. Dr. Terry Yoo will serve as 
the judge for the competition, thereby overseeing the evaluation 
software process and being responsible for its proper application.

Additional Information

    The NLM Computational Photography Project for Pill Identification 
(C3PI) is a research and development project in the Office of High 
Performance Computing and Communications (OHPCC) within the NLM Lister 
Hill National Center for Biomedical Communications (LHNCBC). C3PI 
computer scientists conduct computer vision R&D in text- and image-
based search and retrieval. C3PI's overall goal is to help improve the 
prescription drug information made available to health professionals 
and consumers. The NLM ``Pill Image Recognition Request for 
Information'' (PIR RFI) (https://www.fbo.gov/index?s=opportunity&mode=form&id=a1a694718366ea7cbaf8f715047d63e1&tab=core&_cview=0) was a pilot for this Challenge. The RFI was announced in 
February 2015 and responses were due in May 2015. RFI responses were 
used to test, evaluate, and as needed refine the components of the 
Challenge, including its instructions. NLM appreciates the work done by 
the parties that responded to the RFI.

    Dated: January 11, 2016.
Betsy L. Humphreys,
Acting Director, National Library of Medicine, National Institutes of 
Health.
[FR Doc. 2016-00777 Filed 1-15-16; 8:45 am]
BILLING CODE 4140-01-P



                                                    2876                          Federal Register / Vol. 81, No. 11 / Tuesday, January 19, 2016 / Notices

                                                      Contact Person: Weijia Ni, Ph.D., Chief/                Submissions received by NLM after                    Subject of Challenge
                                                    Scientific Review Officer, Center for                   the submission period ends will not be
                                                    Scientific Review, National Institutes of               considered. A submission is considered                    Unidentified and misidentified
                                                    Health, 6701 Rockledge Drive, Room 3100,                to meet the submission deadline if it is               prescription pills present challenges for
                                                    MSC 7808, Bethesda, MD 20892, (301) 594–                                                                       patients and professionals. Unidentified
                                                    3292, niw@csr.nih.gov.
                                                                                                            received by May 31, 2016, 5:00 p.m.
                                                                                                            EDT. While NLM plans to acknowledge                    pills can be found by family members,
                                                    (Catalogue of Federal Domestic Assistance                                                                      health professionals, educators, and law
                                                    Program Nos. 93.306, Comparative Medicine;
                                                                                                            receipt of each Challenge submission,
                                                                                                            the Government is under no obligation                  enforcement. The nine out of 10 U.S.
                                                    93.333, Clinical Research, 93.306, 93.333,                                                                     citizens over age 65 who take more than
                                                    93.337, 93.393–93.396, 93.837–93.844,                   to acknowledge receipt of the
                                                    93.846–93.878, 93.892, 93.893, National                 information received or provide                        one prescription pill can be prone to
                                                    Institutes of Health, HHS)                              feedback to respondents with respect to                misidentifying those pills. Taking such
                                                                                                            any information submitted. NLM will                    pills can result in adverse drug events
                                                      Dated: January 12, 2016.                                                                                     that affect health or cause death. To
                                                    Natasha M. Copeland,
                                                                                                            amend this Federal Register notice if
                                                                                                            the timeline or the rules for the                      reduce such errors, any person should
                                                    Program Analyst, Office of Federal Advisory                                                                    easily be able to confirm that a
                                                    Committee Policy.
                                                                                                            Challenge are modified. In addition,
                                                                                                            NLM will notify registered Challenge                   prescription pill or a refill is correct. For
                                                    [FR Doc. 2016–00794 Filed 1–15–16; 8:45 am]                                                                    example, a person should be able to
                                                                                                            participants by email of any
                                                    BILLING CODE 4140–01–P
                                                                                                            amendments and will include the                        easily verify—or not—that a refill that
                                                                                                            modified Challenge showing the                         has a different color, shape, or text
                                                                                                            changes.                                               imprinted on the pill is a different
                                                    DEPARTMENT OF HEALTH AND                                                                                       generic version of equivalent drugs he
                                                    HUMAN SERVICES                                          ADDRESSES:   Notifications of any                      or she was already taking.
                                                                                                            amendment to this Federal Register                        To help address these problems, the
                                                    National Institutes of Health
                                                                                                            notice and answers to frequently asked                 NLM Computational Photography
                                                    Announcement of Requirements and                        questions about it will be posted at                   Project for Pill Identification (C3PI) is
                                                    Registration for ‘‘Pill Image                           http://pir.nlm.nih.gov/challenge/                      developing infrastructure and tools for
                                                    Recognition Challenge’’                                 notifications-and-FAQs. Submissions                    identifying prescription pills. The
                                                                                                            must be mailed to: Pill Image                          infrastructure includes photographs of
                                                       Authority: 15 U.S.C. 3719                            Recognition Challenge, Computational                   such pills taken under laboratory
                                                                                                            Photography Project for Pill                           lighting conditions, from a camera
                                                    SUMMARY:   The Pill Image Recognition                   Identification (C3PI), National Library of
                                                    Challenge is a National Institutes of                                                                          directly above the front and the back
                                                                                                            Medicine, Building 38A, Room B1–N30,                   faces of the pill, and at high resolution.
                                                    Health (NIH) Challenge under the                        8600 Rockville Pike, Bethesda, MD
                                                    America COMPETES (Creating                                                                                     Specialized digital macro-photography
                                                                                                            20894.                                                 techniques were then used to capture
                                                    Opportunities to Meaningfully Promote
                                                    Excellence in Technology, Education,                                                                           JPEG pill images. The NLM RxIMAGE
                                                                                                            FOR FURTHER INFORMATION CONTACT:
                                                    and Science) Reauthorization Act of                                                                            database contains these high-quality
                                                                                                            Michael J. Ackerman, Ph.D. at (301)
                                                    2010 (Pub. L. 111–358). Through this                                                                           images and associated pill data such as
                                                                                                            402–4100 or PIR@nlm.nih.gov.
                                                    Challenge, the National Library of                                                                             appearance (color, shape, size, text
                                                    Medicine (NLM), part of NIH, seeks                      SUPPLEMENTARY INFORMATION:                             imprinted on the pill, etc.), ingredients,
                                                    algorithms and software to match                                                                               and identifiers such as its National Drug
                                                                                                            The IC’s Statutory Authority To
                                                    images of prescription oral solid-dose                                                                         Code (NDC) [http://www.fda.gov/Drugs/
                                                                                                            Conduct the Challenge
                                                    pharmaceutical medications (pills,                                                                             InformationOnDrugs/ucm142438.htm].
                                                    including capsules and tablets). The                       What has become today’s National                    RxIMAGE images and data are freely
                                                    objective of the Challenge is the                       Library of Medicine began in 1836 as a                 available. The freely accessible
                                                    development and discovery of high-                      small collection of medical books and                  RxIMAGE API provides text-based
                                                    quality algorithms and software that                    journals in the office of the U.S. Army                search and retrieval of images and data
                                                    rank how well consumer images of                        Surgeon General. A 1956 act of Congress                from the RxIMAGE database. By
                                                    prescription pills match reference                      (Pub. L. 84–941) transferred the library               contributing their algorithm and
                                                    images of pills in the authoritative NLM                to the Public Health Service and gave it               software, Challenge participants will
                                                    RxIMAGE database. NLM may use all or                    its current name. That law authorizes                  take part in a broader NLM effort to
                                                    part of any Challenge entry (i.e.,                      NLM to ‘‘assist the advancement of                     develop a freely usable software system
                                                    algorithm and software) to create a                     medical and related sciences and to aid                and a freely accessible API for image-
                                                    future software system and a future API                 the dissemination and exchange of                      based search and retrieval from a mobile
                                                    (Application Programming Interface) for                 scientific and other information                       device.
                                                    pill image recognition; the system will                 important to the progress of medicine                     In a typical scenario for a future NLM
                                                    be freely usable and the API will be                    and to the public health’’ and to                      mobile app, a person will download the
                                                    freely accessible.                                      ‘‘promote the use of computers and                     app and use it to photograph a
                                                    DATES: NLM will make a set of                           telecommunications by health                           prescription pill, possibly under poor
                                                    consumer-quality images and a                           professionals (including health                        lighting conditions, from an angle, or at
                                                                                                            professionals in rural areas) for the                  low resolution. The future app will
asabaliauskas on DSK5VPTVN1PROD with NOTICES




                                                    companion set of reference images
                                                    publicly available on January 15, 2016.                 purpose of improving access to                         communicate with the future pill image
                                                       The Challenge begins January 19,                     biomedical information for health care                 recognition software system, which may
                                                    2016.                                                   delivery and medical research.’’ In                    use all or part of any Challenge entry,
                                                       Submission period: April 4, 2016 to                  addition to its subject-matter authority,              to compare that photo to reference
                                                    May 31, 2016.                                           NLM is conducting this competition                     images in the RxIMAGE database, and
                                                       Judging period: June 6, 2016 to July                 under the America COMPETES                             will return one or more reference images
                                                    15, 2016.                                               Reauthorization Act of 2010 (Pub. L.                   that most likely match the photographed
                                                       Winners announced: August 1, 2016.                   111–358).                                              pill along with their associated pill data.


                                               VerDate Sep<11>2014   17:50 Jan 15, 2016   Jkt 238001   PO 00000   Frm 00040   Fmt 4703   Sfmt 4703   E:\FR\FM\19JAN1.SGM   19JAN1


                                                                                  Federal Register / Vol. 81, No. 11 / Tuesday, January 19, 2016 / Notices                                            2877

                                                       NLM provides two directories of                         (1) To be eligible to win the Challenge             willful misconduct, for any injury,
                                                    images to Challenge participants for use                prize, a team—                                         death, damage, or loss of property,
                                                    in preparing their submissions:                            a. Shall have registered to participate             revenue, or profits, whether direct,
                                                       • Directory DR contains 2000 JPEG                    in the Challenge under the rules                       indirect, or consequential, arising from
                                                    reference images of 1000 pills. For each                promulgated by the NIH as published in                 participation in this Challenge, whether
                                                    pill there are two reference images, one                this Notice;                                           the injury, death, damage, or loss arises
                                                    of the front of the pill and one of the                    b. Shall have complied with all the                 through negligence or otherwise.
                                                    back of the pill. These pill images are                 requirements set forth in this Notice;                    (5) Based on the subject matter of the
                                                    the same as in the RxIMAGE database.                       c. In the case of a private entity, shall           Challenge, the type of work that it will
                                                       • Directory DC contains 5000 JPEG                    be incorporated in and maintain a                      possibly require, as well as an analysis
                                                    consumer-quality images of the same                     primary place of business in the United                of the likelihood of any claims for death,
                                                    1000 pills that were photographed for                   States, and in the case of an individual,              bodily injury, property damage, or loss
                                                    DR. However, they were taken with a                     whether participating singly or in a                   potentially resulting from Challenge
                                                    variety of digital cameras, under various               group, shall be a citizen or permanent                 participation, no individual (whether
                                                    lighting conditions, and at camera                      resident of the United States. However,                competing singly or in a group) or entity
                                                    angles not necessarily perpendicular to                 non-U.S. citizens and non-permanent                    participating in the Challenge is
                                                    the faces of the pills. They are akin to                residents can participate as a member of               required to obtain liability insurance or
                                                    photos of prescription pills that the                   a team that otherwise satisfies the                    demonstrate financial responsibility in
                                                    general public might take.                              eligibility criteria. Non-U.S. citizens and            order to participate in this Challenge.
                                                                                                            non-permanent residents are not eligible                  (6) By participating in this Challenge,
                                                       For a pill for which there is at least
                                                                                                            to win a monetary prize (in whole or in                each individual (whether competing
                                                    one consumer-quality image in DC, DR
                                                                                                            part). Their participation as part of a                singly or in a group) and entity agrees
                                                    has two reference images of that pill,                                                                         to indemnify the Federal government
                                                    one of the front of the pill and one of                 winning team, if applicable, may be
                                                                                                            recognized when the results are                        against third party claims for damages
                                                    the back of the pill. Conversely, for a                                                                        arising from or related to Challenge
                                                    pill for which there are two reference                  announced.
                                                                                                               d. May not be a Federal entity;                     activities.
                                                    images in DR (one of the front of the pill                 e. May not be a Federal employee                       (7) An individual or entity shall not
                                                    and one of the back of the pill), DC has                acting within the scope of the                         be deemed ineligible because the
                                                    two or more consumer-quality images of                  employee’s employment and further, in                  individual or entity used Federal
                                                    that pill, taken under different                        the case of HHS employees, may not                     facilities or consulted with Federal
                                                    conditions.                                             work on their submission(s) during                     employees during the Challenge if the
                                                       DR and DC come with a ‘‘ground truth                 assigned duty hours. Note: Federal                     facilities and employees are made
                                                    table’’ that is a two-column table with                 ethical conduct rules may restrict or                  available to all individuals and entities
                                                    column headers ref_images and cons_                     prohibit Federal employees from                        participating in the Challenge on an
                                                    images. Each row of the table gives in                  engaging in certain outside activities, so             equitable basis.
                                                    the first column the name of a reference                any Federal employee seeking to                           (8) By participating in this Challenge,
                                                    image and in the second column the                      participate in this Challenge outside the              each individual (whether participating
                                                    name of a consumer-quality image                        scope of employment should consult                     singly or in a group) and entity grants
                                                    corresponding to that reference image.                  his/her agency’s ethics official prior to              to the NIH, in any existing or inchoate
                                                    There is a separate row in the table for                developing an submission;                              copyright or patent rights owned by the
                                                    each (reference image, consumer-quality                    f. May not be an employee of the NIH,               individual or entity, an irrevocable,
                                                    image) pair, even when multiple                         a judge of the challenge, or any other                 paid-up, royalty-free, nonexclusive
                                                    reference and consumer-quality images                   party involved with the design,                        worldwide license to use, reproduce,
                                                    are all photos of the same pill.                        production, execution, or distribution of              post, link to, share, and display publicly
                                                    Respondents can use the images in DR                    the Challenge or the immediate family                  on the Web the submission, except for
                                                    and DC, the ground truth table, and the                 of such a party (i.e., spouse, parent,                 source code. This license includes
                                                    RxIMAGE database in developing,                         step-parent, child, or step-child).                    without limitation posting or linking to
                                                    training, and validating their algorithms                  g. All team members must be at least                the submission, except for source code,
                                                    and software. They can also supplement                  18 years old at the time of submission.                on the NLM Pill Image Recognition Web
                                                    these data.                                                (2) Federal grantees may not use                    site [http://pir.nlm.nih.gov/challenge].
                                                                                                            Federal funds to develop their                         In developing its future software system
                                                    Rules for Participating in the Challenge
                                                                                                            Challenge submissions unless use of                    and future API, NLM may include
                                                       Teams of one or more members can                     such funds is consistent with the                      algorithms and software from Challenge
                                                    participate in this Challenge. There is                 purpose of their grant award and                       entries and may consult with
                                                    no maximum team size. Each team must                    specifically requested to do so due to                 individuals or teams that submitted
                                                    have a captain. Individual team                         the Challenge design, and as announced                 entries. Thus, the license also permits
                                                    members and team captains must                          in the Federal Register.                               NLM to develop the future software
                                                    register in accordance with the                            (3) Federal contractors may not use                 system and the future API,
                                                    Registration Process for Participants                   Federal funds from a contract to develop               independently or with others, using any
                                                    below. The role of the team captain is                  their Challenge submissions or to fund                 algorithms or software from Challenge
                                                    to serve as the corresponding                           efforts in support of their Challenge                  entries, including those obtained from
asabaliauskas on DSK5VPTVN1PROD with NOTICES




                                                    participant with NLM about the                          submission.                                            other Challenges or solicitations, and
                                                    Challenge and to submit the team’s                         (4) By participating in this Challenge,             NLM may freely use, reproduce, modify
                                                    Challenge entry. While NLM will notify                  each individual (whether competing                     and distribute the resulting future
                                                    all registered Challenge participants by                singly or in a group) and entity agrees                software system and API without
                                                    email of any amendments to the                          to assume any and all risks and waive                  restriction. NLM may work with
                                                    Challenge, the team captain is expected                 claims against the Federal government                  individuals or teams that submitted
                                                    to keep the team members informed                       and its related entities (as defined in the            entries to write articles about pill image
                                                    about matters germane to the Challenge.                 COMPETES Act), except in the case of                   recognition and submit them to peer-


                                               VerDate Sep<11>2014   17:50 Jan 15, 2016   Jkt 238001   PO 00000   Frm 00041   Fmt 4703   Sfmt 4703   E:\FR\FM\19JAN1.SGM   19JAN1


                                                    2878                          Federal Register / Vol. 81, No. 11 / Tuesday, January 19, 2016 / Notices

                                                    reviewed journals. Each participant will                public under an Apache 2.0 License that                more than once. The software does not
                                                    retain all other intellectual property                  permits the public to benefit from and                 need to identify pills by name.
                                                    rights in their submissions, as                         improve upon the submission. In this                      2. Source code for the executable that
                                                    applicable.                                             case and by mutual agreement, NLM                      is both human- and machine-readable.
                                                       (9) NIH reserves the right, in its sole              may also post or link to the code from                 The source code can be written in any
                                                    discretion, to (a) cancel, suspend, or                  the Pill Image Recognition Web site. The               programming language(s).
                                                    modify the Challenge through                            entry must include a description of how                   3. A .csv file containing the matrix
                                                    amendment to this Federal Register                      and under what license terms it intends                MRC (C for Challenge) of ranks that is
                                                    notice, and/or (b) not award any prizes                 to make any code that is part of the                   the output from executing the
                                                    if no entries are deemed worthy. In                     entry available to the public.                         executable using DC and DR as input. In
                                                    addition, NLM reserves the right to                       (16) Challenge participants are free to              this case MRC is a matrix that has at
                                                    disqualify any Challenge participants or                discuss their submission and the ideas                 least 5000 rows and has 2000 columns.
                                                    entries in instances where cheating or                  and technologies that it contains with                 For each row i, MRC(i,j) will rank how
                                                    other misconduct is identified.                         other parties, except as stated in #7                  well reference image j matches
                                                       (10) Each individual (whether                        above and are free to contract with any                consumer-quality image i, for j =
                                                    participating singly or in a group) or                  third parties so long as they do not sign              1,...,2000. If reference image J best
                                                    entity agrees to follow all applicable                  any agreement or undertake any                         matches consumer-quality image I then
                                                    federal, state, and local laws,                         obligation that conflicts with any                     MRC(I,J) = 1, and if reference image K
                                                    regulations, and policies.                              agreement that they have entered into,                 is the worst match to consume-quality
                                                       (11) Each individual (whether                        such as with any team members, or do                   image I then MRC(I,K) = 2000.
                                                    participating singly or in a group) and                 enter into regarding their submission for                 4. A text file written in English and
                                                    entity participating in this Challenge                  the Challenge. For the purpose of                      containing the algorithm in pseudo-code
                                                    must comply with all terms and                          clarity, Challenge participants                        that the source code implements, and a
                                                    conditions of these rules, and                          acknowledge that the intent of the                     description of how it works and any
                                                    participation in this Challenge                         Challenge is to encourage people to                    tools or packages that it uses. The
                                                    constitutes each such participant’s full                collaborate and share ideas and                        pseudo-code is to have the complete
                                                    and unconditional agreement to abide                    innovations.                                           pipeline from the input directories to a
                                                    by these rules. Winning is contingent                                                                          matrix of ranks, and also include any
                                                    upon fulfilling all requirements herein.                Registration Process for Participants
                                                                                                                                                                   code that implements features or does
                                                       (12) Each individual (whether                          To participate in this Challenge, team               offline training.
                                                    participating singly or in a group) and                 captains must register their teams,                       5. A one-page text file written in
                                                    entity grants to NLM and NLM                            including providing the names and                      English that contains the following:
                                                    contractors assisting NLM with C3PI the                 email addresses of all team members, at                a. Title of entry
                                                    right to review the submission, study                   http://pir.nlm.nih.gov/challenge/                      b. Names and email addresses of the
                                                    the algorithms and the code, and run the                register. Early registration is encouraged                team captain and all team members
                                                    software on other sets of images.                       in order to be able to receive email                   c. A five or more character identifier for
                                                       (13) Submissions must not infringe                   notifications if this Federal Register                    the entry that is used as a prefix in the
                                                    upon any copyright, patent, trade                       notice is amended to change the                           names of all of the team’s submitted
                                                    secrets, or any other rights of any third               timeline or the rules of this Challenge.                  files
                                                    party. Each individual (whether                                                                                d. A brief description of the submission
                                                    participating singly or in a group) or                  Submission Requirements
                                                    entity warrants that he/she or the team                   Participants must provide a complete                 Amount of the Prize; Award Approving
                                                    is the sole author and owner of any                     submission as defined below to be                      Official
                                                    copyrightable work that the submission                  considered for the prize. The                            Up to five monetary prizes may be
                                                    comprises, that the submission is                       submission must be saved to a USB                      awarded: $25,000 for 1st Place, $15,000
                                                    wholly original with the participant or                 storage device containing a virtual                    for 2nd Place, $5,000 for 3rd Place, and
                                                    is an improved version of an existing                   machine and must be received (not                      two $2,500 prizes for Honorable
                                                    work that the participant has sufficient                simply post-marked) by NLM by May                      Mention for a total prize award pool of
                                                    rights to use and improve. In addition,                 31, 2016, 5 p.m. EDT. Submissions must                 up to $50,000. The names of the
                                                    the submission must not trigger any                     be mailed to: Pill Image Recognition                   winners and the titles of their entries
                                                    reporting or royalty obligation to any                  Challenge, Computational Photography                   will be posted on NLM Web sites. The
                                                    third party. A submission must not                      Project for Pill Identification (C3PI),                Award Approving Official is the
                                                    include proprietary, classified,                        National Library of Medicine, Building                 Director of the National Library of
                                                    confidential, or sensitive information.                 38A, Room B1–N30, 8600 Rockville                       Medicine.
                                                       (14) The submission does not contain                 Pike, Bethesda, MD 20894.
                                                    malicious code such as viruses,                           The Submission is defined to include:                Payment of the Prize
                                                    timebombs, cancelbots, worms, trojan                      1. Executable software for ranking                     Prizes awarded under this Challenge
                                                    horses, or other potentially harmful                    how well consumer images of pills                      will be paid by electronic funds transfer
                                                    programs or other material or                           taken by digital cameras match                         and may be subject to Federal income
                                                    information.                                            reference images. The software shall be                taxes. HHS/NIH will comply with IRS
                                                       (15) Notwithstanding the above and                   a batch-mode program or a script whose
asabaliauskas on DSK5VPTVN1PROD with NOTICES




                                                                                                                                                                   (U.S. Internal Revenue Service)
                                                    consistent with the principal objective                 input consists of a directory of                       withholding and reporting
                                                    of the Challenge to make results widely                 consumer images and a directory of                     requirements, where applicable.
                                                    available to the public. If the submitter               reference images. The output shall be a
                                                    distributes their executable code or                    comma-separated-value (csv) M-by-N                     Basis Upon Which Winners Will Be
                                                    source code NLM encourages every                        matrix MR of ranks that for i = 1,...,M                Selected
                                                    individual and team to distribute their                 compares consumer image i with                           NLM will first review submissions to
                                                    submission’s executable code and                        reference images j = 1,...,N. For each                 determine their suitability for judging
                                                    preferably also its source code to the                  consumer image, no rank can appear                     and eligibility to win the prize. An


                                               VerDate Sep<11>2014   17:50 Jan 15, 2016   Jkt 238001   PO 00000   Frm 00042   Fmt 4703   Sfmt 4703   E:\FR\FM\19JAN1.SGM   19JAN1


                                                                                  Federal Register / Vol. 81, No. 11 / Tuesday, January 19, 2016 / Notices                                                  2879

                                                    eligible submission (a) complies with                   and image-based search and retrieval.                  710, Bethesda, MD 20892, 301–594–5973,
                                                    the rules in this Federal Register notice,              C3PI’s overall goal is to help improve                 mrinaudo@mail.nih.gov.
                                                    (b) follows the detailed submission                     the prescription drug information made                   Name of Committee: National Institute of
                                                    instructions at http://pir.nlm.nih.gov/                 available to health professionals and                  Nursing Research Initial Review Group.
                                                    challenge/, (c) is complete (e.g., meets                consumers. The NLM ‘‘Pill Image                          Date: February 18, 2016.
                                                                                                                                                                     Time: 8:00 a.m. to 6:00 p.m.
                                                    the Submission Requirements above),                     Recognition Request for Information’’                    Agenda: To review and evaluate grant
                                                    and (d) is confirmed by NLM that the                    (PIR RFI) (https://www.fbo.gov/                        applications.
                                                    executable is an implementation of the                  index?s=opportunity&                                     Place: Bethesda Marriott Suites, 6711
                                                    submitted source code, can be run on                    mode=form&id=a1a694718366ea                            Democracy Boulevard, Bethesda, MD 20817.
                                                    the submitted virtual machine using                     7cbaf8f715047d63e1&tab=core&_                            Contact Person: Weiqun Li, MD, Scientific
                                                    directories DC and DR as input, and the                 cview=0) was a pilot for this Challenge.               Review Officer, National Institute of Nursing
                                                    output matrix is the same as the                        The RFI was announced in February                      Research, National Institutes of Health, 6701
                                                    submission’s matrix MRC.                                2015 and responses were due in May                     Democracy Blvd., Ste. 710, Bethesda, MD
                                                       Eligible submissions will proceed to                                                                        20892, (301) 594–5966, wli@mail.nih.gov.
                                                                                                            2015. RFI responses were used to test,
                                                    the judging process, and will be                        evaluate, and as needed refine the                       Name of Committee: National Institute of
                                                    evaluated based on how well the                                                                                Nursing Research Special Emphasis Panel;
                                                                                                            components of the Challenge, including                 Palliative and End-of-Life Care Research.
                                                    submissions can match pill images                       its instructions. NLM appreciates the                    Date: February 24, 2016.
                                                    across a large number of queries. NLM                   work done by the parties that responded                  Time: 8:00 a.m. to 5:00 p.m.
                                                    has developed evaluation software and                   to the RFI.                                              Agenda: To review and evaluate grant
                                                    created directories of images to use in                                                                        applications.
                                                                                                              Dated: January 11, 2016.
                                                    selecting the Challenge winners. For                                                                             Place: Bethesda Marriott Suites, 6711
                                                    example, directories DRJ and DCJ (J for                 Betsy L. Humphreys,                                    Democracy Boulevard, Bethesda, MD 20817.
                                                    Judging) contain reference and                          Acting Director, National Library of Medicine,           Contact Person: Tamizchelvi Thyagarajan,
                                                    consumer-quality images similar to                      National Institutes of Health.                         Ph.D., Scientific Review Officer, National
                                                    those in directories DR and DC provided                 [FR Doc. 2016–00777 Filed 1–15–16; 8:45 am]            Institute of Nursing Research, National
                                                    to potential Challenge participants, and                BILLING CODE 4140–01–P
                                                                                                                                                                   Institutes of Health, Bethesda, MD 20892,
                                                                                                                                                                   301–594–0343, tamizchelvi.thyagarajan@
                                                    the ground truth matrix for judging                                                                            nih.gov.
                                                    MGTJ has MGTJ(i,j)=1 if DCJ(i) and
                                                                                                            DEPARTMENT OF HEALTH AND                               (Catalogue of Federal Domestic Assistance
                                                    DRJ(j) are photos of the same pill, else                                                                       Program Nos. 93.361, Nursing Research,
                                                    MGTJ(i,j)=0. The evaluation software                    HUMAN SERVICES
                                                                                                                                                                   National Institutes of Health, HHS)
                                                    calculates the mean average precision
                                                    (MAP) for directories and ground truth                  National Institutes of Health                            Dated: January 11, 2016.
                                                    matrix such as DRJ, DRC, and MGTJ.                                                                             Sylvia Neal,
                                                                                                            National Institute of Nursing Research;                Program Analyst, Office of Federal Advisory
                                                    Mean average precision is a widely used                 Notice of Closed Meetings
                                                    measure for evaluating how well                                                                                Committee Policy.
                                                    information retrieval systems (for                        Pursuant to section 10(d) of the                     [FR Doc. 2016–00801 Filed 1–15–16; 8:45 am]
                                                    example, search engines) retrieve results               Federal Advisory Committee Act, as                     BILLING CODE 4140–01–P
                                                    across a large number of queries. The                   amended (5 U.S.C. App.), notice is
                                                    MAP formula and examples of MAP                         hereby given of the following meetings.
                                                    calculations for this Challenge are at                    The meetings will be closed to the                   DEPARTMENT OF HEALTH AND
                                                    http://pir.nlm.nih.gov/challenge/MAP_                   public in accordance with the                          HUMAN SERVICES
                                                    example.                                                provisions set forth in sections
                                                       The eligible submissions will be                                                                            National Institutes of Health
                                                                                                            552b(c)(4) and 552b(c)(6), Title 5 U.S.C.,
                                                    submitted to the evaluation software.                   as amended. The grant applications and                 National Institute of Diabetes and
                                                    The submission with the highest MAP                     the discussions could disclose                         Digestive and Kidney Diseases; Notice
                                                    score will be recommended as the first                  confidential trade secrets or commercial               of Closed Meetings
                                                    place winner, with the second, third,                   property such as patentable material,
                                                    fourth, and fifth best MAPs, respectively               and personal information concerning                      Pursuant to section 10(d) of the
                                                    being recommended to earn second                        individuals associated with the grant                  Federal Advisory Committee Act, as
                                                    place, third place, and two honorable                   applications, the disclosure of which                  amended (5 U.S.C. App.), notice is
                                                    mentions. In the event of tied scores, the              would constitute a clearly unwarranted                 hereby given of the following meetings.
                                                    tied submissions will be tested against                 invasion of personal privacy.                            The meetings will be closed to the
                                                    additional DRJ and DCJ directories until                                                                       public in accordance with the
                                                                                                              Name of Committee: National Institute of
                                                    a winner is determined. Dr. Terry Yoo                                                                          provisions set forth in sections
                                                                                                            Nursing Research Special Emphasis Panel;
                                                    will serve as the judge for the                         MHealth Tools for Underserved Populations.             552b(c)(4) and 552b(c)(6), Title 5 U.S.C.,
                                                    competition, thereby overseeing the                       Date: February 9, 2016.                              as amended. The grant applications and
                                                    evaluation software process and being                     Time: 10:00 a.m. to 1:00 p.m.                        the discussions could disclose
                                                    responsible for its proper application.                   Agenda: To review and evaluate grant                 confidential trade secrets or commercial
                                                                                                            applications.                                          property such as patentable material,
                                                    Additional Information                                    Place: National Institutes of Health, One            and personal information concerning
                                                      The NLM Computational Photography                     Democracy Plaza, Office of Review, National
asabaliauskas on DSK5VPTVN1PROD with NOTICES




                                                                                                                                                                   individuals associated with the grant
                                                    Project for Pill Identification (C3PI) is a             Institute of Nursing Research, National                applications, the disclosure of which
                                                    research and development project in the                 Institutes of Health, 6701 Democracy
                                                                                                                                                                   would constitute a clearly unwarranted
                                                    Office of High Performance Computing                    Boulevard, Suite 710, Bethesda, MD 20892,
                                                                                                            (Telephone Conference Call).                           invasion of personal privacy.
                                                    and Communications (OHPCC) within                         Contact Person: Mario Rinaudo, MD,                     Name of Committee: National Institute of
                                                    the NLM Lister Hill National Center for                 Scientific Review Officer, One Democracy               Diabetes and Digestive and Kidney Diseases
                                                    Biomedical Communications                               Plaza, Office of Review, National Institute of         Special Emphasis Panel; DDK–D Member
                                                    (LHNCBC). C3PI computer scientists                      Nursing Research, National Institutes of               Conflict SEP.
                                                    conduct computer vision R&D in text-                    Health, 6701 Democracy Boulevard, Suite                  Date: February 5, 2016.



                                               VerDate Sep<11>2014   17:50 Jan 15, 2016   Jkt 238001   PO 00000   Frm 00043   Fmt 4703   Sfmt 4703   E:\FR\FM\19JAN1.SGM   19JAN1



Document Created: 2016-01-16 01:11:27
Document Modified: 2016-01-16 01:11:27
CategoryRegulatory Information
CollectionFederal Register
sudoc ClassAE 2.7:
GS 4.107:
AE 2.106:
PublisherOffice of the Federal Register, National Archives and Records Administration
SectionNotices
DatesNLM will make a set of consumer-quality images and a companion set of reference images publicly available on January 15, 2016.
ContactMichael J. Ackerman, Ph.D. at (301) 402-4100 or [email protected]
FR Citation81 FR 2876 

2025 Federal Register | Disclaimer | Privacy Policy
USC | CFR | eCFR