Senior Lead Software Engineer – AI/ML Deep Learning & GPU ML Serving
JPMorgan Chase · Hyderabad
| Company | JPMorgan Chase |
|---|---|
| Role | Senior Lead Software Engineer – AI/ML Deep Learning & GPU ML Serving |
| Location | Hyderabad |
| Work mode | On-site |
| Experience | 3–6 years |
| Job type | Full-time |
About this job
JPMorgan Chase is hiring a Senior Lead Software Engineer in Hyderabad for Payments Technology in the Commercial & Investment Bank. You will lead the design of ML serving platforms that run deep learning models on GPUs at low latency.
The role covers model serving with tools such as Triton or TorchServe, GPU scheduling and cost, inference optimisation, and graph neural networks. You will guide teams, contractors and vendors and drive product design decisions.
Eligibility
- Formal training or certification in software engineering and 5+ years of applied experience
- Strong Python with TensorFlow or PyTorch
- Experience running GPU workloads on Kubernetes (EKS)
- Hands-on with TorchServe, TF Serving, Triton or similar
- Inference optimisation: quantisation, batching and caching
Skills required
What you will do
- Give technical direction to teams, contractors and vendors
- Design scalable, low-latency ML serving systems
- Optimise deep learning models for production inference
- Manage GPU resources, scheduling and cost
- Drive AI-assisted engineering practices across teams
How to apply
- Open the official JPMorgan Chase job page with the Apply button and submit your application there.
- Tailor your resume to ML serving systems you built, latency and throughput numbers, and GPU cost work.
Before the interview, prepare:
- Serving design: dynamic batching, model versions and canary rollouts on Triton
- Inference optimisation: quantisation, TensorRT, KV caching and their trade-offs
- GPU on Kubernetes: device plugins, bin packing and autoscaling
- GNN basics: message passing and serving graph models for fraud detection
Get jobs like this every day on WhatsApp. Free, no spam, only verified openings.
Join channelStay safe: DailyITJobs is not a recruitment agency and is not connected to JPMorgan Chase. Apply only on the official website. Never pay anyone for a job, interview or offer letter.