Data Engineer
Bangalore, IN
Job Number: 67602
Group: Magna Corporate
Division: IT India
Job Type: Permanent/Regular
Location: BANGALORE
Work Style: Hybrid
About us
We see a future where everyone can live and move without limitations. That’s why we are developing technologies, systems and concepts that make vehicles safer and cleaner, while serving our communities, the planet and, above all, people.
Forward. For all.
Group Summary
Magna is more than one of the world’s largest suppliers in the automotive space. We are a mobility technology company built to innovate, with a global, entrepreneurial-minded team. With 65+ years of expertise, our ecosystem of interconnected products combined with our complete vehicle expertise uniquely positions us to advance mobility in an expanded transportation landscape.
About the Role
Magna IT is looking for a strong and ambitious Data Engineer for our Analytics practice. The Data Engineer role will build and orchestrate synchronous and asynchronous data pipelines integrating heterogeneous business systems for both EAI and BI use cases.
Your Responsibilities
• Builds ETL data pipelines using Talend tool portfolio and SQL code.
• Models Database objects to fulfil data pipeline requirements
• Designs following integrations:
o ETL jobs using incremental load patterns, using technologies like Change Data Capture (CDC) or Change Tracking
o Services for APIs using technologies such as REST to be consumed synchronously by client application
o Subscription based workflows triggering ETL actions based on events at source system
o Embedded mapping and casting of data from heterogenous source and target systems and formats
• Responsible for development, testing, documentation and performance of data pipelines, understanding and optimizing impact on source and target systems.
• Works closely with:
o Business analysts, system owners to gain understanding of business processes and corporate data
o Business intelligence developers to ensure that integrations are correct and performing optimally.
• Contribute to architectural decisions to support business processes
• Provide production support for data solutions
o Complete root cause analysis and contribute to remediation planning and implementation
o Perform data quality analysis, report data quality issues and propose solutions for data quality management
Who we are looking for
• Familiarity with various relational and non-relational database management systems, in particular Microsoft classic and cloud ecosystem
• Architectural understanding of data hub oriented integrations as single point of orchestration.
• Hands on knowledge in the design of data flows that facilitate data harvesting for automated genealogy documentation in a data catalog
• Able to work in various delivery methodologies (Agile – Scrum/SAFe, Waterfall, Kanban, etc.).
• Ability to read, interpret, analyze, and communicate effectively verbally and in written form.
• Familiarity with UML Sequence diagrams.
• Knowledge of data integration patterns across various functions of the enterprise.
• Experience with cloud-based solutions preferably on Microsoft stack.
o Azure Synapse
o Data Factory
o Data Lake
• Experience implementing and supporting scalable solutions, with a solid understanding of database locking escalation and other concurrency related mechanisms.
• Understanding of when and how to use table partitioning and other data insertion, storage and distribution approaches.
Your preferred qualifications
• Bachelor’s in Information Technology or a related field (experience will be considered in lieu of education requirement)
• 3+ years of
o ETL development experience with T-SQL, Talend or other graphical ETL tools (Datastage, SSIS, Informatica, Ab Initio, PowerCenter, IBM InfoSphere, Pentaho,)
o SQL development, preferably in multiple database management platforms, and working with normalized relational databases and dimensional data warehouse implementation
• Ability to manage multiple projects simultaneously and deliver results in a timely manner. Ability to work independently, under pressure, and adaptable to change.
• Manufacturing experience and SAP knowledge are a plus
What we offer
At Magna, you can expect an engaging and dynamic environment where you can help to develop industry-leading automotive technologies. We invest in our employees, providing them with the support and resources they need to succeed. As a member of our global team, you can expect exciting, varied responsibilities as well as a wide range of development prospects. Because we believe that your career path should be as unique as you are.
Site Benefits
Awareness. Unity. Empowerment.
At Magna, we believe that a diverse workforce is critical to our success. That’s why we are proud to be an equal opportunity employer. We hire on the basis of experience and qualifications, and in consideration of job requirements, regardless of, in particular, color, ancestry, religion, gender, origin, sexual orientation, age, citizenship, marital status, disability or gender identity. Magna takes the privacy of your personal information seriously. We discourage you from sending applications via email to comply with GDPR requirements and your local Data Privacy Law.