National Institute of Standards and Technology logo

AI Research Scientist, Applied Systems

National Institute of Standards and Technology
Full-time
On-site
San Francisco, California, United States
$0 - $197,200 USD yearly
Ai Research Scientist

Duties

In this position, you will:

  • Identify new, impactful research areas and questions with a focus on evaluating AI systems in real settings, such as use in businesses, federal agencies, and other organizations.
  • Design and conduct rigorous evaluations and analyses, leveraging methodologies from a range of fields.
  • Perform data analysis to synthesize and visualize research findings and evaluation results.
  • Develop guidelines and tooling that can be open-sourced to support good practice (e.g., in the federal government).
  • Adapt and improve existing evaluation techniques, and develop novel, rigorous techniques where needed.
  • Write research publications and publicize findings via blog posts, guidance, and briefings.
  • Communicate complex AI topics and research findings in a compelling and clear manner to a range of audiences from subject matter experts to practitioners to non-technical decision makers.
  • Be a force multiplier, supporting work across the Applied Systems team and CAISI, mentoring new hires and interns, and contributing to an innovative and dynamic information environment.


Requirements

Conditions of employment

  • U.S. citizenship
  • Males born after 12-31-59 must be registered for Selective Service
  • Suitable for Federal employment
  • Completion of Confidential Financial Disclosure, Form OGE-450
  • Designated and/or random drug testing required
  • Bargaining Unit Position: No

Qualifications

All applicants must submit a resume NOT TO EXCEED two pages on standard-size paper. If the resume exceeds two pages, only the first two pages will be reviewed for qualifications or assessment determinations.

Basic Requirements: Experience must be IT related; the experience may be demonstrated by paid or unpaid experience and/or completion of specific, intensive training (for example, IT certification), as appropriate.

For all positions individuals must have IT-related experience demonstrating each of the four competencies listed below. The employing agency is responsible for identifying the specific level of proficiency required for each competency at each grade level based on the requirements of the position being filled.

  1. Attention to Detail - Is thorough when performing work and conscientious about attending to detail.
  2. Customer Service - Works with clients and customers (that is, any individuals who use or receive the services or products that your work unit produces, including the general public, individuals who work in the agency, other agencies, or organizations outside the Government) to assess their needs, provide information or assistance, resolve their problems, or satisfy their expectations; knows about available products and services; is committed to providing quality products and services.
  3. Oral Communication - Expresses information (for example, ideas or facts) to individuals or groups effectively, taking into account the audience and nature of the information (for example, technical, sensitive, controversial); makes clear and convincing oral presentations; listens to others, attends to nonverbal cues, and responds appropriately.
  4. Problem Solving - Identifies problems; determines accuracy and relevance of information; uses sound judgment to generate and evaluate alternatives, and to make recommendations.

ZP-2210-IV: In addition to the basic requirements, applicants must have one year (52 weeks) of specialized experience equivalent to at least the GS-12 level (ZP-III at NIST). Specialized experience is defined as advanced technical understanding of generative artificial intelligence (AI) models and machine learning (ML) algorithms; demonstrated experience analyzing and evaluating AI systems; a track record of authorship on high-quality, peer-reviewed research; experience capably carrying out rigorous, cutting-edge research from start to finish.

ZP-2210-V: In addition to the above requirements, applicants must have one year (52 weeks) of specialized experience equivalent to at least the GS-14 level (ZP-IV at NIST). Specialized experience is defined as advanced technical understanding of generative artificial intelligence (AI) models and machine learning (ML) algorithms; demonstrated experience analyzing and evaluating AI systems; a track record of authorship on high-quality, peer-reviewed research; have not only contributed to, but designed and led rigorous, cutting-edge AI evaluation research from start to finish.

Experience refers to paid and unpaid experience, including volunteer work done through National Service programs (e.g., Peace Corps, AmeriCorps) and other organizations (e.g., professional; philanthropic; religious; spiritual; community, student, social). Volunteer work helps build critical competencies, knowledge, and skills and can provide valuable training and experience that translates directly to paid employment. You will receive credit for all qualifying experience, including volunteer experience.

The qualification requirements in this vacancy announcement are based on the U.S. Office of Personnel Management (OPM) Qualification Standards Handbook.

If requesting reconsideration of your qualification determination, please refer to the following site: Applicant Reconsideration

Education

Qualifications are based upon meeting specialized experience only. Education cannot be used to qualify for this position.

Additional information

This position is covered under NIST's Alternative Personnel Management System (APMS), a pay-for-performance system with excellent HR flexibilities to help NIST recruit and retain top talent Learn more about the APMS here!

  • We may share your application package with other selecting officials at NIST with opportunities like this one. Additional selections may be made through this vacancy.
  • Click all links in this vacancy announcement to view additional information or instructions.
  • You MUST select at least ONE ELIGIBILITY to be considered for this position.
  • All documents submitted for this announcement must be legible to make qualification or eligibility determinations.
  • A trial period may be required.
  • This appointment may be extended up to four years without further competition.
  • This position requires the passing of a drug test.
  • This position requires filing an OGE-450 Confidential Financial Disclosure Report within 30 days of onboarding and annually thereafter.

As a condition of employment for accepting this position, you may be required to serve a 1-year trial period during which we will evaluate your fitness and whether your continued employment advances the public interest. In determining if your employment advances the public interest, we may consider:
  • your performance and conduct;
  • the needs and interests of the agency;
  • whether your continued employment would advance organizational goals of the agency or the Government; and
  • whether your continued employment would advance the efficiency of the Federal service.
Upon completion of your trial period, your employment will be terminated unless you receive certification, in writing, that your continued employment advances the public interest.

Candidates should be committed to improving the efficiency of the Federal government, passionate about the ideals of our American republic, and committed to upholding the rule of law and the United States Constitution.