Summary
Parallel Partners is seeking an AI Backend Engineer to join a global, fully remote engineering team. The role focuses on building and operating scalable backend systems for AI-powered insurance workflows, designing orchestration and inference pipelines, optimizing performance and cost, and ensuring reliability across distributed AI systems.
Responsibilities
- Build and operate backend systems that serve AI-powered insurance workflows in production
- Design and implement AI orchestration layers that connect models, APIs, workflows, and business logic
- Build inference pipelines for LLM-based and AI-assisted automation systems
- Optimize latency, throughput, and cost across AI services (caching, batching, streaming, routing)
- Design stable service boundaries between backend systems, ML components, and product APIs
- Implement observability: logging, metrics, tracing, alerting, and incident response workflows
- Debug production issues across distributed AI systems and resolve root causes
- Collaborate closely with frontend, product, operations, and ML teams to ship end-to-end features
- Continuously improve system reliability, scalability, and performance
Skills
- Strong backend engineering experience in production systems
- Artificial Intelligence (AI) experience required
- Experience building or operating high-throughput, low-latency services
- Familiarity with AI Systems (LLMs, Embeddings, or AI Workflows)
- Experience with distributed systems and production debugging
- Strong understanding of APIs, data flows, and system design principles
- Experience with observability tools (logging, monitoring, tracing)
- Strong ownership mindset and bias toward shipping
- Comfortable working in fast-paced, globally distributed teams
- Tech Stack: Anthropic, Claude, Artificial Intelligence (AI), Distributed Systems Tooling, Docker, Kubernetes, LLM APIs, Node.js, NoSQL, Observability Tools, OpenAI, Open-Source Models, Python, SQL
Qualifications
Must Haves
- Strong backend engineering experience in production systems
- Artificial Intelligence (AI) experience required
- Experience building or operating high-throughput, low-latency services
- Familiarity with AI Systems (LLMs, Embeddings, or AI Workflows)
- Experience with distributed systems and production debugging
- Strong understanding of APIs, data flows, and system design principles
- Experience with observability tools (logging, monitoring, tracing)
- Strong ownership mindset and bias toward shipping
- Comfortable working in fast-paced, globally distributed teams
- Tech Stack: Anthropic, Claude, Artificial Intelligence (AI), Distributed Systems Tooling, Docker, Kubernetes, LLM APIs, Node.js, NoSQL, Observability Tools, OpenAI, Open-Source Models, Python, SQL
Benefits
- Medical insurance
- Dental insurance
- Vision insurance
- Savings Plan Options
- PTO
- Fully remote position
- 100% Remote