Staff Software Engineer, Applied AI

Job Description

• This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Staff Software Engineer, Applied AI based in the United States. This role sits within a fast-moving, incubation-style AI team focused on expanding intelligent capabilities across a healthcare technology ecosystem. You will design and ship production-grade AI systems that directly impact how patients access critical medical equipment and supplies at home. The work spans applied machine learning, LLM-driven agentic workflows, and full-stack product engineering in a highly iterative environment. You will collaborate closely with product and engineering teams to identify high-impact use cases and bring AI solutions from concept to production. This is a hands-on role for someone who thrives at the intersection of AI research pragmatism and real-world software delivery. You will also help define best practices for evaluation, reliability, and observability of LLM-powered systems.
• Accountabilities: Design and build agentic LLM pipelines that power AI-driven product features across the platform, ensuring scalability and production reliability. Develop full-stack applications using Python (FastAPI) and TypeScript/React to support AI-enabled workflows and user-facing tools. Build and maintain robust evaluation frameworks, including curated datasets, automated testing, regression detection, and performance benchmarking for LLM systems. Iterate on prompt engineering strategies and model usage, balancing accuracy, latency, and cost considerations. Enhance production observability by implementing feedback loops, monitoring accuracy signals, and improving system reliability over time. Partner with cross-functional product and engineering teams to identify opportunities for AI integration and guide implementation strategy. Provide technical direction on when and how to apply AI/LLM solutions effectively to maximize impact and avoid unnecessary complexity. Requirements: 5+ years of professional software engineering experience in production environments. Strong background in full-stack development, particularly with Python-based web applications (FastAPI or similar frameworks). Proven experience building and shipping agentic LLM workflows to production using orchestration tools (e.g., LangChain, LangGraph, or similar). Hands-on experience designing evaluation systems for LLM applications, including test datasets, eval harnesses, and regression tracking. Familiarity with prompt engineering and iterative LLM optimization practices. Experience working in fast-paced startup or 0-to-1 environments with high ownership and autonomy. Strong communication skills with the ability to drive alignment across technical and non-technical stakeholders. Must be legally authorized to work in the United States. Benefits: Medical, dental, and vision insurance with low-to-no-cost premium options. Employer-funded Health Savings Account (HSA) contributions. 401(k) retirement savings plan. Equity incentive plan participation. Annual performance-based bonus opportunity of up to 15%. Remote-first work culture with access to a NYC office and co-working space reimbursement. Flexible vacation policy plus additional summer Fridays off. Home office setup and wellness stipend. Monthly internet reimbursement. Annual learning and professional development budget.
• How Jobgether works: We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team. We appreciate your interest and wish you the best! Why Apply Through Jobgether? Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time. #LI-CL1
• We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
• apply for this job