Our large digital transformation company is seeking a talented and experienced Data Engineer to join our team, specializing in Databricks and the financial industry. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining data pipelines and infrastructure through data bricks to support financial clients' data-driven initiatives.
Key Responsibilities Include:
- Architect and design end-to-end data solutions using Databricks to process and analyze large-scale financial data.
- Collaborate with stakeholders to understand business requirements and translate them into technical solutions.
- Develop and implement data integration, transformation, and validation processes to ensure data accuracy and consistency.
- Lead the development and optimization of ETL pipelines to ingest data from various sources into data lakes and warehouses.
- Ensure the reliability, performance, and scalability of data architectures.
Must haves:
7+ years in data architecture helping to design solutions within financial industry
Strong proficiency in SQL, Python, and Spark
Deep understanding of data warehousing concepts and technologies (e.g., Snowflake, Redshift).