Lead Data Engineer The Lead Data Engineer will collaborate with stakeholders across the organization to assess requests for analytics and reporting solutions. This role involves designing, developing, and refining data sourcing, modeling, pipelines, and orchestrations. Additionally, the individual will contribute to crafting strategies for data governance, user access, dashboard deployment, and data report optimization. The scope of responsibilities extends to proactive exploration of tools and platforms to enhance operational efficiency and cost-effectiveness. Strong interpersonal skills are essential for effective collaboration, and a steadfast dedication to delivering incremental business value is paramount.
Responsibilities
Collaborate with Business Analysts, Data Modelers, and ELT Technical resources to lead projects aimed at designing and implementing data sourcing, loading, and consumption models that align with reporting metrics.
Construct data pipelines within Azure Data Factory to facilitate the ingestion of inbound data and distribution of outbound data to external applications, integrating integrity and control checks throughout the process.
Develop and implement data sourcing strategies and pipelines to seamlessly integrate the analytics platform with enterprise applications such as SAP, Right Angle, Ariba, and Sales Force.
Define detailed business requirements, identifying challenges, opportunities, and solutions for delivering enterprise Datamart & analytics platform.
Engage with business stakeholders to generate functional specifications for the development of end-to-end analytics solutions.
Create and execute scripts for data exploration in Big Data systems, constructing models to visualize trends, patterns, and outliers for business insights.
Design and implement control scripts for monitoring daily data feeds from various systems and external flat files.
Develop SQL scripts in SQL Server or Oracle for conducting data quality checks against validation metrics and generating comparison reports to ensure data accuracy.
Collaborate with the release management team to plan and execute production deployments.
Address challenges in report utilization with users and facilitate necessary changes to reports and dashboards to enhance usability.
Cultivate and maintain relationships with users to identify and develop additional analytic and reporting capabilities.
Design and deploy data orchestrations supporting reports, dashboards, and visualizations to drive insights and enable timely business decisions.
Present complex ideas and solutions concisely to stakeholders.
Innovate and problem-solve difficult reporting and data visualization issues.
Evaluate emerging trends in data analytics, including predictive analytics, and recommend continuous improvements to the reporting platform.
Provide guidance in creating user-friendly, self-service reporting and analytical solutions.Train and support users in reporting toolsets like Power BI to foster a self-service reporting platform.
Collaborate across multiple departments and business segments to support all team initiatives for Reporting, Dashboards, and Data Visualizations.
Advocate for industry standards and simplification within Motiva, influencing change and managing stakeholder expectations across business segments.
Qualifications
Bachelor's degree in Computer Science or a related field preferred.
Minimum of 8 years of experience in the IT industry.
Proficiency in analyzing and designing business process improvements.
Action-oriented with a high level of energy and focus on delivering results.
Ability to implement best practices and enhancements in various aspects of daily work.
Self-reliant individual with a demonstrated ability to quickly contribute value to an organization.
Proven ability to collaborate with cross-functional teams to meet requirements.
Strong oral and written communication skills.
Capability to manage competing priorities across multiple stakeholders.
Hands-on experience with Databricks or similar tools, and Power BI or equivalent BI tools.
Experience working with Microsoft Azure cloud technologies, including Data Factory, Data Lake, or similar platforms.
Ability to read and interpret data schemas and models.
Proficiency in SQL or similar query languages.
Knowledge and experience in prototyping, designing, and requirement analysis.
Ability to lead or contribute effectively in a fast-paced delivery team environment.
Track record of successfully designing and implementing reports, dashboards, and visualizations using Power BI or similar tools.
Familiarity with data management and data quality processes and requirements.
Experience working on or supporting large enterprise-wide data projects and initiatives.
Strong analytical skills.
Strong interpersonal skills demonstrated through previous work experience.
Understanding of data mapping concepts and building requirements.
Preferred Education and Experience:
Experience implementing business process changes.
Familiarity with change management activities.
Proficiency in package software implementation.
Track record of delivering insightful reports and dashboards.
Prior experience in the Oil and Gas sector.
Understanding of data warehousing, data cleaning, and data pipelines.