RocketSource is on the hunt for a seasoned Data Engineer to join our growing team. We're a small but mighty company providing data solutions to large enterprise accounts. We're looking for a talented individual who can drive end-to-end data processes and help us scale data services effectively.
Key Responsibilities:
Design, build, and maintain data pipelines to ensure efficient data flow across our systems.
Perform data transformations and manage data tables to support business intelligence, reporting, and data-driven decision-making.
Develop and optimize data warehouses, primarily on Google Cloud Platform (GCP) and BigQuery, with integration into other cloud solutions like Snowflake, AWS, and Azure.
Write and optimize complex SQL queries, develop data models, and manage data tables to enable seamless analytics.
Collaborate with data visualization teams to support accurate, timely insights and visualizations.
Utilize AI/ML tools to enhance data processes, support predictive modeling, and drive business value for clients.
Key Qualifications:
Technical Mastery: Strong proficiency in Google Cloud Platform (especially BigQuery), SQL, and familiarity with data warehouses like Snowflake, AWS, and Azure.
Data Modeling Expertise: Proven experience developing efficient data models that support large-scale analytics.
Data Transformation Skills: Deep understanding of data transformation techniques to ensure accuracy and performance across all systems.
ETL Proficiency: Experienced in building ETL (Extract, Transform, Load) workflows that support robust data movement and processing.
SQL Optimization: Advanced skills in writing and optimizing complex SQL queries for high performance.
AI/ML Experience: Familiarity with applying machine learning models to data processes and enhancing data pipeline functionality.
Cloud Infrastructure Knowledge: Understanding of cloud infrastructure management and best practices for security, scalability, and cost efficiency.
Data Governance: Strong knowledge of data governance practices, including data quality, lineage, and security protocols.
Collaborative Communication: Able to work cross-functionally with data scientists, analysts, and visualization teams to deliver comprehensive insights.
Analytical Problem-Solving: Ability to troubleshoot data issues and proactively improve processes to enhance data reliability.
Daily Responsibilities:
In this role, you'll be managing the end-to-end data architecture for RocketSource's clients, ensuring the highest standards of data quality, efficiency, and scalability. Your day-to-day will include:
?
Pipeline Management: Oversee and refine data pipelines, ensuring data is collected, transformed, and stored accurately across all systems. This includes monitoring and troubleshooting pipelines to prevent downtime and improve efficiency.
ETL Development: Build, maintain, and improve ETL workflows that support data integration from multiple sources, handling various data types and frequencies.
Data Modeling & Transformation: Design data models that align with business needs and perform data transformations to create usable data sets for analysis and reporting.
SQL Query Optimization: Write, test, and optimize SQL queries to ensure efficient data retrieval and processing.
Collaboration with Analytics Teams: Work closely with data scientists, analysts, and stakeholders to support data requests, visualization needs, and other analytics functions.
Cloud Infrastructure Management: Monitor and manage GCP infrastructure and other cloud platforms (Snowflake, AWS, Azure) to maintain scalability and ensure secure data access.
Data Quality Assurance: Conduct regular quality checks, clean data sets, and implement data governance practices to maintain accuracy and reliability.
AI/ML Integration: Use AI/ML models to enhance data pipelines, improve predictive analytics, and support automation within data workflows.
Documentation & Reporting: Keep thorough documentation of data processes, configurations, and workflows. Provide regular updates on system performance and data availability.
Innovation & Continuous Improvement: Stay up-to-date on industry trends, experiment with new data tools and techniques, and apply best practices to drive continuous improvement.
About RocketSource:
RocketSource is committed to helping enterprises unlock the power of data for actionable insights and business growth. Join us, and be part of a team that values innovation, data integrity, and collaborative problem-solving.