Exciting Opportunity for Senior Data Engineers to Join a Leading Firm in Machine Learning and Data Engineering!
Are you a passionate data engineer with strong Python and PostgreSQL skills? Do you thrive in environments where innovation drives success? If so, the company is looking for a talented Senior Data Engineer to play a pivotal role in their data architecture and machine learning initiatives.
Company Overview:
The company is a prestigious investment firm with a focus on quality and value. With its roots in top-tier investment groups, the company leverages machine learning to revolutionize investigative journalism and augment research capabilities. The company fosters a collaborative, cutting-edge environment where technology and innovation thrive, providing team members with the opportunity to work on some of the most exciting data engineering projects in the industry.
Role Overview:
As a Senior Data Engineer, you will be responsible for building, optimizing, and managing complex data pipelines that support machine learning workflows. This is an exciting opportunity to work closely with the company's data architecture, collaborate with cross-functional teams, and make a meaningful impact on data transformation initiatives. You will also help shape the database infrastructure, ensuring best practices in data governance and security.
Key Responsibilities:
Database Management & Architecture: Collaborate with the team to manage the database architecture, including database permissions and optimization.
ETL Pipeline Development: Build and optimize ETL pipelines to support ML initiatives and remove bottlenecks in data flow.
Data Onboarding & Integration: Onboard new data sets and integrate them into existing data systems.
Implement Change Data Capture (CDC): Convert high-priority tasks to CDC to streamline data processing.
Data Security & Governance: Ensure best practices are followed in data governance and security, including permission management.
Optimization & Performance Tuning: Develop high-performance Python code and fine-tune database queries for optimal performance.
Skills for Success:
Python: Proficiency in Python for building high-performance data pipelines and optimizing code.
PostgreSQL: Strong experience with PostgreSQL, including query optimization, indexing, and performance tuning.
ETL Tools: Experience with data transformation tools such as dbt, SQL mesh, or similar.
Database Architecture & Security: Solid understanding of database design, security practices, and managing permissions.
Change Data Capture (CDC): Familiarity with implementing CDC for efficient data processing.
NoSQL: Experience with NoSQL databases like Cassandra is a plus.
Machine Learning Knowledge: Understanding of how data pipelines integrate with machine learning workflows is desirable.
Key Selling Points:
Competitive Salary: Base salary range of $110K - $165K, with opportunities for growth.
Generous Benefits: Comprehensive health insurance (dental, vision), 15 days PTO (increasing over time), 401k with 3% match, and extended leave options for caregivers and adoptive parents.
Innovative Work Environment: Opportunity to work on cutting-edge machine learning projects and be a key part of the company's data engineering initiatives.
Career Growth: Strong focus on professional development and the potential for long-term growth within the company.
Flexible & Collaborative Culture: Work in a flexible and dynamic environment with a passionate, collaborative team.
If you're ready to take your career to the next level and work on exciting, impactful projects, the company is eager to hear from you! Apply today to join a team at the forefront of innovation in data engineering and machine learning.