AI Inference / Product Engineer
Focus: Production LLM serving and AI infrastructure
What you'll do
- Build and operate high-performance LLM inference services on GPUs.
- Optimize inference throughput, latency, GPU utilization, and serving costs.
- Develop reliable production systems, including deployment, monitoring, autoscaling, and fault recovery.
- Work with inference frameworks such as vLLM, SGLang, and related technologies.
- Bring new AI models into production quickly and reliably.
What we're looking for
- Strong experience in Python, C++, Linux, and distributed systems.
- Hands-on experience building and deploying production systems.
- Experience with LLM serving, GPU computing, cloud infrastructure, or performance engineering.
- Familiarity with Kubernetes, Docker, and CI/CD is a plus.
- Ability to take ownership of engineering projects and deliver working products.