Hybrid opportunity at
RoSenior Engineer, Applied AI
Ro operates a vertically integrated digital health platform connecting telehealth, diagnostic testing, online pharmacy, and fulfillment services. The company is hiring a Senior Engineer, Applied AI…
Career Tools
About This Role
Ro operates a vertically integrated digital health platform connecting telehealth, diagnostic testing, online pharmacy, and fulfillment services. The company is hiring a Senior Engineer, Applied AI to join a newly established team building LLM-driven features for patient care workflows, internal tools, and clinical operations. This position is suited for a seasoned software developer who enjoys working closely with clinical and operational staff to prototype, launch, and maintain production AI systems…
Job Description
Ro operates a vertically integrated digital health platform connecting telehealth, diagnostic testing, online pharmacy, and fulfillment services. The company is hiring a Senior Engineer, Applied AI to join a newly established team building LLM-driven features for patient care workflows, internal tools, and clinical operations. This position is suited for a seasoned software developer who enjoys working closely with clinical and operational staff to prototype, launch, and maintain production AI systems from the ground up.
In this capacity, you will own the entire lifecycle of artificial intelligence features, focusing on reliability, safety, and operational efficiency within a hybrid work environment based in New York. You will collaborate alongside a Senior AI Lead and an Engineering Manager, creating orchestration layers, retrieval systems, and evaluation frameworks. Success in this role requires comfort with ambiguity, strong product instincts, and the ability to translate operational challenges into robust technical solutions.
Responsibilities
- Design, build, and deploy production-ready LLM features from end to end
- Develop the AI application layer encompassing tool calling, RAG, embeddings, agent workflows, prompt orchestration, and structured outputs
- Create evaluation pipelines including regression suites, synthetic datasets, human review workflows, and LLM-as-a-judge tests
- Implement observability frameworks to track accuracy, latency, cost, and hallucination rates in live environments
- Establish safety and reliability guardrails that fulfill compliance and quality standards
- Assess and integrate third-party model providers, vector databases, and orchestration frameworks
- Collaborate directly with clinical teams, Patient Advocates, and EHR operators to analyze workflows
- Provide technical leadership through mentorship, code reviews, and system design
Requirements
- At least 5 years of professional software development experience
- Minimum 1 to 2 years of experience building and launching LLM-powered applications into production
- Proficiency in Python with a background in backend service development and integrating modern AI APIs
- Familiarity with AI-assisted software development tools across the development lifecycle
Qualifications
- Experience with orchestration frameworks such as LangChain, LangGraph, or AgentCore
- Familiarity with retrieval-augmented generation (RAG) architectures and vector databases
- Experience managing prompts and versioning
- Knowledge of evaluation and observability platforms like LangSmith, Braintrust, or Arize Phoenix
Core Skills
Benefits
- Competitive equity package
- Comprehensive benefits package
Frequently Asked Questions
What is the location and work arrangement for this role?
The position is based in New York and operates on a hybrid remote status.
What is the employment type?
This is a full-time position.
What is the salary range for this position?
The target base salary ranges from $190,800 to $234,500, supplemented by equity and benefits.
Who will I report to?
The reporting structure is flexible and depends on the specific shape of the newly forming team, rather than a pre-determined spot on an organizational chart.
Sample Interview Questions
AI-generated questions tailored to this specific role — a preview of the full practice set.
