As Data Engineer, you will be responsible for helping to scale, implement, and architect new data initiatives across the business. This role will require someone who is eager to learn and work on new technologies. This role is a combination of data engineering, data governance, and data integration.
Company Description:
Our client is a startup with a few years under their belt that focuses on quality investments to build capital. As their needs expand they are looking to add to the team and hire someone who is dedicated, hungry, and knowledgeable.
Role Description:
Design and implement scalable, reliable data pipelines using technologies like Apache Spark, Hadoop, and Kafka.
Leverage AWS or Azure services (e.g., EC2, RDS, S3, Lambda, Azure Data Lake) for efficient data handling and processing.
Develop and optimize data models and storage solutions (SQL, NoSQL) to ensure data quality and accessibility for operational and analytical applications.
Automate data workflows with ETL tools and frameworks (e.g., Apache Airflow, Talend) for efficient data integration and timely availability.
Collaborate with data scientists, providing the necessary infrastructure and tools for complex analytical models, using Python or R.
Ensure data governance and security compliance, implementing best practices in encryption, masking, and access controls within a cloud environment.
Skills and Experience:
Bachelor's degree in Computer Science, MIS, or equivalent education/experience.
Extensive background and experience in ETL/ELT pipelining - preferably with DBT.
MUST have PostGreSQL experience and be able to speak to it extensively.
Able to code extensively in Python and SQL.
Experience with cloud computing environments (AWS, Azure, GCP) and Data/ML platforms (Databricks, Spark).
Experience with NoSQL databases like Apache Cassandra or MongoDB.
Typical Python Data Engineering library experience like Scikit-learn, Pandas, NumPy, Airflow, Kafka, and Spark.
Benefits:
Health, Dental, and Vision Insurance
Specifics on benefits to be determined.
Please note: Candidates must be authorized to work in the United States to be considered at this time.