We are seeking a talented and motivated Data Operations Lead Analyst to join our dynamic team. In this role, you will be responsible for ensuring the smooth execution and optimization of data workflows using tools such as Airflow, Informatica Intelligent Cloud Services (IICS) and other Cloud applications. Your primary focus will be on maintaining operational excellence, troubleshooting job failures, and overseeing the end-to-end execution of data processes.
**Please note this is onsite hybrid schedule in the greater metro Boston, MA area**
Key Responsibilities:
- Maintain scalable data pipelines using Apache Airflow and IICS to ensure efficient data processing and integration.
- Proactively monitor job performance and troubleshoot issues to ensure data integrity and reliability. Address and resolve job failures promptly to minimize downtime.
- Provide oversight and management of job executions, ensuring adherence to SLAs and optimizing workflows for performance and efficiency.
- Work closely with cross-functional teams including data engineers, data analysts, and IT operations to understand requirements, troubleshoot issues, and implement solutions.
- Document operational procedures, workflows, and best practices. Continuously improve processes to enhance reliability and scalability.
Requirements:
- Proven experience in data operations, managing and troubleshooting data workflows.
- Hands-on experience with Apache Airflow and Informatica IICS.
- Strong debugging and problem-solving skills with the ability to analyze complex issues and drive resolution.
- Solid understanding of data integration concepts and best practices.
- Experience in scripting (Python, Shell scripting) along with Spark and working in a Linux environment is a plus.
- Excellent communication skills and ability to work effectively in a team-oriented environment.
- Experience with cloud platforms (AWS) and containerization technologies (Docker, Kubernetes).
- Familiarity with database systems and SQL.
- Certification in Apache Airflow / Informatica IICS / AWS Developer is a plus.