Senior Data Engineer
Apply now
Job no: 551896
Work type: Full time
Location: Bangalore, India, Pune, India, India
Categories: Information Technology
Office Location: Bangalore
We never ask for payment as part of our selection process, and we always contact candidates via our corporate accounts and platforms. If you are approached for payment, this is likely to be fraudulent. Please check to see whether the role you are interested in is posted on our career website.
About TMF Group
TMF Group is a leading provider of administrative services, helping clients invest and operate safely around the world. As we’re a global company with 11,000+ colleagues based in over 125 offices across 87 jurisdictions, we actively seek out people with the talent and potential to flourish at TMF Group, whatever their background, and offer job opportunities to the broadest spectrum of people. Once on board we nurture and promote talented individuals, making sure that senior positions are open to all.
TMF India is a Great Place to Work, ISO & ISAE certified organization.
Discover the role
As a Senior Data Engineer, you will design and develop highly scalable, reliable, and self-heal data engineering pipelines to process large volumes of data across disparate data sources effectively addressing functional and non-functional concerns while adhering to well-established engineering concepts, as well as data quality system to identify data issues proactively, rather than reactively.
On the other side, you will be supported for growth by the management and TMF Business Academy to stay ahead of the technology by researching and learning new technologies and developing innovative solutions for complex problems in data engineering to serve the AI and Data Science needs of the future.
Key Responsibilities
Work closely with the Analytics and Business teams to understand Business requirements
Work closely with Data architect to design and document data models, source to target mapping
Create Physical data models
Propose design solutions for data integration challenges
Develop POCs for proposing new solutions and technologies
Maintain and manage master data
Design and develop a data quality system to identify data issues proactively, rather than reactively
Develop and promote best practices, reference architecture, and engineering standards in data engineering
Automate pipeline deployments through CI/CD processes
Review designs and code of junior developers and share feedback to improve the quality of deliverables
Automate pipeline execution and monitoring
Manage code repository and ensure timely code check-ins
Work collaboratively as a member of the development team to build a best-in-class data platform in an agile environment
Identify areas of improvement and propose solutions
Ensure process compliance
Provide Daily / Weekly updates on the progress of work
About you
Ideally, you meet the following criteria:
Bachelor of Engineering in Computer Science, Information Systems or equivalent
Experience with Azure is a must-have, at least 5+ years
Certifications in Big Data related technologies and/or Microsoft certifications will be considered a plus
Deep understanding of Data Structures and algorithms
Experience with relational SQL and NoSQL databases
Experience with stream-processing systems: Storm, Spark-Streaming, etc.
Experience in building operational ETL data pipelines from a number of disparate sources
Strong development experience with SSIS / ADF / DataBricks
Experience with Spark and other distributed processing frameworks
Understanding of code management, CI/CD concepts and their application in the Big-data universe
Experience in implementing solutions for Master Data Management
Experience with Data Cataloging tools
Experience in Agile development methodologies
Have a passion for solving problems with data
Willing to learn new skills and technologies
What's in it for you?
Pathways for career development
Work with colleagues and clients around the world on interesting and challenging work.
We provide internal career opportunities, so you can take your career further within TMF.
Continuous development is supported through global learning opportunities from the TMF Business Academy.
Making an impact
You’ll be helping us to make the world a simpler place to do business for our clients.
Through our corporate social responsibility program, you’ll also be making a difference in the communities where we work.
A supportive environment
Strong feedback culture to help build an engaging workplace.
Our inclusive work environment allows you to work from our offices around the world, as well as from home, helping you find the right work-life balance to perform at your best.
Other Benefits
Marriage Gift policy
Paternity & Adoption leaves
Interest free loan policy
Salary advance policy
Covid support taskforce
Well being initiatives
We are looking forward to getting to know you!
Advertised: 29 Aug 2024 India Standard Time
Applications close: 30 Sep 2024 India Standard Time
Back to search results Apply now Refer a friend