Lead Data Engineer – PySpark, Big Data & Client Consulting (Bengaluru)
Thoughtworks · Bengaluru
| Company | Thoughtworks |
|---|---|
| Role | Lead Data Engineer – PySpark, Big Data & Client Consulting (Bengaluru) |
| Location | Bengaluru |
| Work mode | Hybrid |
| Experience | 6+ years |
| Job type | Full-time |
About this job
Thoughtworks is hiring a Lead Data Engineer in Bengaluru to design modern data architecture and end-to-end data solutions for clients. You may run deep technical reviews with new clients or lead the start of a new data product.
You will lead data projects from start to finish, design and build complex pipelines, turn data scientists' models into scalable systems, choose storage and compute tools, build data models and make data quality part of daily work, while coding hands-on with TDD. The role is hybrid.
Eligibility
- 10+ years leading system design and delivery
- Built Big Data architecture and production pipelines
- Clean, high-quality PySpark code
- Deep data modelling and SQL, NoSQL and data lake skills
- Stakeholder management and mentoring
Skills required
What you will do
- Lead data projects end to end
- Design and build data pipelines
- Scale data science models
- Advise clients on storage and compute choices
- Build data models and quality checks
How to apply
- Open the official Thoughtworks job page with the Apply button and submit your application there.
- Tailor your resume to data platforms you led, PySpark pipelines you built and client outcomes.
Before the interview, prepare:
- Designing a lakehouse for a new client
- Testing PySpark pipelines with TDD
- Choosing a data model for analytics
- Building data quality into pipelines
Get jobs like this every day on WhatsApp. Free, no spam, only verified openings.
Join channelStay safe: DailyITJobs is not a recruitment agency and is not connected to Thoughtworks. Apply only on the official website. Never pay anyone for a job, interview or offer letter.