Backend / AI Systems Engineer

Job Description

• This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Backend / AI Systems Engineer in Canada. This role is focused on building and scaling the backend systems and AI infrastructure that power a modern legal AI copilot used by thousands of legal professionals worldwide. You will work at the intersection of distributed systems, high-performance APIs, and LLM-driven workflows embedded directly into core product experiences. The environment is fast-paced, product-driven, and deeply technical, requiring strong ownership from design through production. You will contribute to both traditional backend services and advanced AI orchestration layers, including retrieval systems and inference pipelines. This position is ideal for an engineer who thrives on solving ambiguous, high-impact problems and turning them into reliable, production-grade systems. You will collaborate closely with product, design, and engineering peers to balance performance, scalability, and user experience.
• Accountabilities In this role, you will design, build, and operate the backend and AI systems that enable high-performance product experiences and scalable intelligent workflows. Build and scale backend services supporting core product features such as document review, chat, and knowledge libraries Design and implement low-latency, high-reliability AI systems including inference, orchestration, and retrieval layers Develop and optimize production-grade RAG systems with strong performance, accuracy, and secure data isolation Own platform-level concerns such as rate limiting, retries, fallbacks, consistency, and graceful degradation Work on distributed backend systems involving APIs, queues, concurrency, and data modeling Collaborate with product and design teams to balance latency, UX, accuracy, and system reliability Participate in on-call rotations and incident response, improving system resilience over time Use modern development workflows, including AI-assisted development tools, while maintaining rigorous engineering standards Requirements The ideal candidate brings strong backend engineering fundamentals combined with experience or interest in AI-driven systems and scalable distributed architectures. 5+ years of experience in backend engineering and production system development Strong foundation in distributed systems, APIs, concurrency, and data modeling Experience with NoSQL databases (MongoDB preferred), including schema design, indexing, and performance tuning Ability to translate ambiguous product ideas into clear technical designs and shipped solutions Strong communication skills with the ability to explain technical decisions clearly to diverse stakeholders Pragmatic engineering mindset with an understanding of when and how to design for scale Self-driven problem solver with strong ownership and curiosity for system improvement Experience working with LLM-powered systems (prompting, tool use, retrieval, or agent workflows) is a strong plus Experience building or optimizing retrieval systems (vector and/or lexical search) is an asset Familiarity with AWS and infrastructure-as-code tools (e.g., CDK) is a plus Experience building evaluation frameworks for AI or data-driven systems is highly valued Benefits Flexible remote-first work environment across Canada Competitive compensation with equity (stock options) as part of the total rewards package Comprehensive health, dental, and wellness benefits for employees and families Mental health support allowance (up to $1,000) Generous paid time off, including holiday shutdown periods Monthly meal support and annual wellness allowance Parental leave top-ups and family support benefits Opportunity to work on cutting-edge AI and legal technology at scale High autonomy and ownership in a fast-moving engineering culture Inclusive and supportive environment with strong commitment to equity and accessibility
• How Jobgether works: We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team. We appreciate your interest and wish you the best! Why Apply Through Jobgether? Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time. #LI-CL1
• We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
• apply for this job