Data Engineer Job at Tata Consultancy Services, Deerfield, IL

NXF3U29UN2pvRjBOcE80Y2g1MlBXUzJm
  • Tata Consultancy Services
  • Deerfield, IL

Job Description

Senior RunOps Azure Data Engineer:

Must Have Technical/Functional Skills

• A Minimum of 5 Years' experience

• Design & Develop data pipelines ETL/ELT solutions using Azure Data Factory, Databricks, and Synapse Analytics to process structured and unstructured data.

• Implement and manage Azure Data Lake, Azure SQL Database and other data storage solutions.

• Optimize data workflow and ensure data integrity using SQL/Synapse and other tools on Azure.

• Azure Data Services: - Azure Data Factory, Databrick, Azure Synapse Analytics, Azure Data Lake.

• Databases & Storage: -SQL Server, Azure SQL Database, Blob storage, Synapse Analytics.

• Cloud Integration: Connect and integrate data source from on-prime, cloud and third-party APIs into Azure -based System.

• Performance Optimization: Monitoring and enhance query performance, cost efficiency and scalability of data platform.

• Automation and DevOps: Implement CI/CD pipeline for data workflows using Azure DevOps with tools like ARM templates.

Roles & Responsibilities

Production support & Monitoring:

• Act as the primary escalation point for complex issues related to Azure Data factory, Databricks.

• Monitor and troubleshoot data ingestion pipelines to ensure smooth data flow for digital marketing campaigns.

• Perform root cause analysis (RCA) and implement permanent fixes for recuring issues.

• Working Closely with team, providing guidance and resolving critical incident.

Data Pipeline Management (Azure Data factory & Databricks)

• Manage and optimize ETL/ELT pipeline in Azure Data Factory and Databricks for data ingestion.

• Implement data validation and error -handling mechanisms to maintain data integrity.

Adobe Campaign Classic Support & Digital Marketing data integration:

• Ensure seamless data flow from Azure to Adobe Campaign Classic for marketing campaign execution.

• Support Campaign team by troubleshooting data sync issues, segmentation errors and delivery failures

Incident & Problem management:

• Handle high priority incidents, perform impact analysis and communicate resolution timelines.

• Implement long-term fixes and preventive measures to minimize recurring issues.

• Work with Adobe support and Microsoft Azure team for vendor escalations and resolution.

Performance Tunning & Optimization:

• Monitor and improve Azure data factory pipeline execution times and data bricks cluster performance

• Fine-Tune query performance for large -scale data ingestion.

• Ensure Adobe Campaign classic campaigns run efficiently with optimized data input.

Documentation and Knowledge Sharing

• Maintain Detailed SOPs, troubleshooting guides and runbooks.

• Conduct training session for team members on Azure Data factory, data brick and Adobe Campaign classic best practices. Document incident resolutions and RCA reports for future reference.

Job Tags

Permanent employment,

Similar Jobs

Ultimate Staffing

Entry Level Lab- Data Entry Job at Ultimate Staffing

 ...Job Title: Data Entry/Accessioning TEMP TO HIRE Position Type: Full-time Schedule Options: Monday-Friday, 9:00 AM - 5:00...  ...to various case-by-case situations Comfortable with extended computer use and capable of occasionally lifting up to 10 lbs All... 

Hexaware Technologies

Sr. Java Consultant Job at Hexaware Technologies

 ...SQL Developer, Postman, SOAPUI ~ Very good understanding of Software design and architectural patterns ~ Experience working in an...  ...innovative, eager to learn every day ~ Define, maintain, and support Java development environment and standard methodologies, such as... 

Tata Consultancy Services

Junior Java Developer Job at Tata Consultancy Services

 ...Please find one of the urgent jobs opening and send across your updated resume if you are available. Job Title: Junior Java Developer Location : New Jersey and Florida Job Type: Full Time Responsibilities Develop, create, and modify general computer... 

Ontic

Quality Engineer Job at Ontic

 ...stability and developing ground-breaking technology. Responsibilities of the Quality Engineer: Understanding of Quality Management System Standards: AS9100, ISO 9001, and ISO 9000 AS9102 First Article Inspection using DISCUS/Net Inspect. Investigating Root Causes... 

Cardinal Roofing

Roofing Superintendent Job at Cardinal Roofing

 ...Job Title: Roofing Superintendent Location: 169 Cahaba Valley Pkwy, Pelham, AL 35124 Salary: $65,000 - $75,000 per year Are...  ...Superintendent to join our team and take charge of managing subcontractor crews, overseeing projects, and making sure every job is completed...