AI Software Engineer - Evaluation Platform

at Perplexity AI
📍 San Francisco, United States
USD 200,000-270,000 per year
MIDDLE
✅ On-site

SCRAPED

Used Tools & Technologies

Not specified

Required Skills & Competences ?

Software Development @ 6 Docker @ 3 TypeScript @ 3 Python @ 3 AWS @ 3 Communication @ 6 Debugging @ 3 LLM @ 3

Details

Perplexity is changing the way people search the internet and we are seeking a founding engineer for a new team that will change how Perplexity employees search through internal data.

Our team behind Deep Research and other cutting-edge AI features is looking for a full stack engineer that is passionate about building an evaluation platform for LLM answers and Agent behaviors. You will be partnering with AI engineers to redefine the debugging and evaluation of answer quality tooling process to supercharge our AI development. If you value working on greenfield projects and enjoy high levels of ownership, this is the right role for you.

Tech Stack

NextJS | TypeScript | Python | Postgres | Docker | AWS

Responsibilities

  • Building new 0-1 full-stack platform for debugging and evaluating LLM outputs.
  • Design intuitive front-end interfaces and robust back-end systems for monitoring the performance of AI product and AI systems.
  • Collaborate with researchers and engineers to understand their needs and deliver effective full-stack solutions.
  • Continuously improve existing tools and develop new features to meet evolving requirements.
  • Work closely with Engineers, Product, Design, and Data to ensure deep insights into Perplexity’s performance.

Requirements

  • Strong experience in full-stack software development, with the ability to work across the full-stack necessary to build scientific research platform or production tools.
  • Self-motivated with a willingness to take ownership of tasks
  • Good quantitative understanding of data and visualization
  • Strong communication skills and the ability to work collaboratively in a team environment.
  • 3+ years of industry experience

Bonus

  • Bonus: Experience working with generative AI tools or LLMs.

The cash compensation range for this role is $200,000 - $270,000.

Equity: In addition to the base salary, equity is part of the total compensation package.

Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.