Back to All Openings
AI & Data ScienceDirect HireHybrid
Lead AI / MLOps Engineer (LLM & Vector Pipelines)
New York, NY$180,000 - $220,000 / yrPosted August 06, 2026
Role Overview
An elite financial technology institution in NYC has engaged Qudrix Technologies to recruit a Lead AI / MLOps Engineer. In this high-impact position, you will build robust infrastructure for LLM model serving, vector indexing, and real-time inference monitoring.
Key Responsibilities
Build end-to-end MLOps automation pipelines using PyTorch, MLflow, and Kubeflow.
Implement scalable RAG pipelines using vector databases (Pinecone, Qdrant, Milvus).
Establish model latency, drift monitoring, and cost-efficient GPU cluster scaling.
Partner with data scientists and enterprise risk managers.
Qualifications & Experience
Master’s or Ph.D. in Computer Science, Machine Learning, or related field.
5+ years building production-grade ML engineering and pipeline infrastructure.
Hands-on experience deploying Large Language Models (LLMs) and fine-tuning workloads.
Strong knowledge of Docker, Kubernetes, Triton Inference Server, and Python.
Benefits & Perks
Top-tier equity compensation package.
Comprehensive medical coverage & wellness benefits.
3 weeks PTO + paid company holidays.
Executive career progression path.