Product & AI Quality Intern - Technical Projects Group

Hillspire, LLC, is an integrated family office management company that serves the business and philanthropic activities of Eric and Wendy Schmidt and their family and supports more than 700 employees worldwide. Hillspire provides legal, finance, accounting, facilities and real estate, human resources, and information technology services to the organization.

Eric and Wendy Schmidt have created a number of philanthropic organizations and initiatives that work toward a healthy, resilient, secure world for all. These philanthropic organizations include:

The Schmidt Family Foundation works to restore a balanced relationship between people and planet. It has two grant-making and investment programs: The 11th Hour Project, which works to create a world with fresh air, clean water and healthy food for all people; and Schmidt Marine Technology Partners, which supports scientists, engineers and entrepreneurs in developing technologies that restore ocean health.

Schmidt Ocean Institute is a virtual institute that operates the research vessel Falkor (too). The ship and its assets are available at no cost to scientists worldwide working to explore, discover and understand the ocean. Schmidt Ocean catalyzes ocean exploration and research and educates and engages the public to inform the wise stewardship of the planet.

Schmidt Sciences works to deepen human understanding of the natural world and develop solutions to global issues with science and technology. The core focus areas of the organization include: AI and advanced computing, astrophysics and space, biosciences, climate and cross-science programs.

11th Hour Racing works with the sailing community and maritime industry to advance solutions and practices that protect and restore the health of the ocean.

Agog is a groundbreaking initiative at the intersection of technology, communications and social impact. The organization helps creators and nonprofit leaders harness the power of extended reality (XR) technologies to spur positive social transformation, opening new avenues for empathy, understanding and activism.

The Schmidt Initiative for Long Covid advances clinical care for Long Covid patients globally. The organization works to raise the level of Long Covid care and understanding around the world by connecting specialists and primary care providers to support patients and share knowledge virtually, in real time.

Remain is a charitable organization that supports the economic, social and environmental vitality of Nantucket.

Hillspire, LLC is an equal opportunity employer and we strive to create an atmosphere where diversity of identity, experience, and background are welcomed, valued, and supported.

We believe that diversity brings about greater results on all levels and we aim to use our resources to generate greater impact through our work. Candidates who contribute to this diversity are strongly encouraged to apply.

Key Responsibilities:
• LLM Evaluation: Review and score outputs from our AI features, helping us understand where the model gets it right and where it falls short. You'll develop a real intuition for what "good" looks like in AI-assisted civic tech.

• Automated Testing: Contribute to building out our automated LLM test suite, including writing and maintaining test cases that help us catch regressions as the product evolves.

• QA: Systematically test product features, document bugs with clear reproduction steps, and help us maintain a high bar for what ships.

• Bug Triage: Help review incoming bug reports, identify patterns, and prioritize issues alongside the engineering team.

• User Research Support: Help coordinate and set up user interviews with organizers, including scheduling, note-taking, and synthesizing what we hear.

• Other duties and projects as assigned.

Knowledge, Skills, and Abilities:
• Ability to proactively lead, design, and create research projects, workflows, and initiatives.

• Demonstrated excellence in advanced research and analytical skills, including primary and secondary source research, writing, and editing.

• Project management skills, including capabilities to drive efforts independently and ensure effective implementation.

• Ability to coordinate efforts across multiple stakeholders, partners, and teams.

• Ability to work under pressure and across multiple work-streams to meet timelines.

• Exceptional analytical mind with the ability to solve complex, multifaceted problems, synthesize arguments, and generate new ideas.

• Strong teamwork skills and a record of impact in high-intensity, team-based environments.

• Commitment to the highest standards of ethics and confidentiality.

• Excellent written and verbal communication skills, with reasonable ability to use common software tools for word processing, presentation, and spreadsheets.

• Curiosity and optimism in the face of uncertainty.

Requirements:
• Maintain the highest level of ethics, integrity, and discretion for confidentiality.

• Be based at the Schmidt offices in New York City and be able to travel within the U.S. as needed.