---
title: "Software Engineer, Model Routing & Inference"
company: "Cursor"
company_url: "https://www.remjobs.works/companies/cursor"
url: "https://www.remjobs.works/job/cursor-software-engineer-model-routing-inference-bb5efe2c-bb5b-45b1-a30e-29448e508880"
apply_url: "https://jobs.ashbyhq.com/cursor/45c815b0-5100-4934-8558-0e750b8aed79"
workplace: onsite
location: "New York"
employment_type: full-time
seniority: mid
role: software-engineering
region: united-states
date_posted: 2026-04-07T04:19:55.390Z
first_seen_by_remjobs: 2026-08-26T15:14:53.019Z
---

# Software Engineer, Model Routing & Inference

**Cursor** — New York

Apply: https://jobs.ashbyhq.com/cursor/45c815b0-5100-4934-8558-0e750b8aed79

## About Cursor

Built to make you extraordinarily productive, agents turn ideas into code. Accelerate development by handing off tasks to Cursor.

## About the role

Our mission is to automate coding. The first step in our journey is to build the best tool for professional programmers, using a combination of inventive research, design, and engineering. Our organization is very flat, and our team is small and talent dense. We particularly like people who are truth-seeking, passionate, and creative. We enjoy spirited debate, crazy ideas, and shipping code.

#### About the Role

As a Software Engineer on the **Model Routing & Inference** team at Cursor, you'll build the inference platform that powers every AI interaction in the product.

This team owns the full inference path: making Cursor's AI faster, more reliable, and more cost-effective at a scale few teams in the world get to operate at. Every agent session, every tab completion, and every chat message flows through your stack.

##### Example projects include...

- Building and evolving our inference gateway, a single abstraction over every provider's API semantics, so model onboarding becomes a config change.

- Designing intelligent cross-provider failover so no single provider outage causes user-visible degradation.

- Designing routing backpressure and admission control so traffic spikes don't cascade into providers.

#### You may be a fit if

- You have deep experience building high-throughput, low-latency distributed systems, especially in inference serving, traffic routing, or real-time data pipelines.

- You're comfortable reasoning about cost/performance tradeoffs at scale (GPU utilization, provider economics, capacity planning).

- You have strong software engineering fundamentals and enjoy shipping production systems that handle millions of requests.

- You make good calls in the gray area: weighing reliability, cost, latency, and user experience when there isn't a single "right" answer.

#### Applying

If there appears to be a fit, we'll reach to schedule 2-3 short technicals. After, we'll schedule an onsite in our office, where you'll work on a small project, discuss ideas, and meet the team.

#LI-DNI

---

Source: Cursor's own career page, read by RemJobs. Canonical HTML version: https://www.remjobs.works/job/cursor-software-engineer-model-routing-inference-bb5efe2c-bb5b-45b1-a30e-29448e508880