Job Description:
Location: REMOTE
Salary: $60.00 USD Hourly - $65.00 USD Hourly
Description: Our client is currently seeking a Data Engineer for aa W2 role
Job Description:
- As a Sr. Data Engineer, you will be responsible for developing and delivering technological solutions to achieve targeted business outcomes.
- This includes analyzing, designing, and developing enterprise data and information architecture deliverables, with a focus on treating data as a valuable asset.
- Adhere to reusable standards, design patterns, guidelines, and configurations to provide valuable data and information across the enterprise, including collaboration as needed.
- Uphold the company's core values of respect, honesty, integrity, diversity, inclusion, and safety.
Required Skills and Experience:
- 4+ years of experience with Python
- Strong proficiency in SQL, including complex joins and conditional updates
- DevOps skills: Linux, GitHub, Bash
- Experience with CI/CD lifecycles
- Proficient in writing unit, integration, and regression tests
- Familiarity with static code analysis tools, linters, and PEP 8 standards
- Experience with Microsoft Azure and/or Google Cloud Platform
- Experience with Agile SCRUM projects
Highly Desired Skills and Experience:
- Data Management: Databricks, PySpark, Spark Structured Streaming, Delta Live Tables, Delta Sharing
- Expert knowledge of SQL
- Experience with streaming technologies: Apache Kafka, Azure EventHub's Avro
- DevOps tools: GitHub Actions, Terraform, Artifactory
Key Responsibilities:
- Implement enterprise standards for data domains and solutions, focusing on integration and streamlined operational and analytical uses
- Utilize innovative technologies to renovate, extend, and transform core data assets, including SQL-based, NoSQL-based, and cloud-based platforms
- Develop high-level migration plans to bridge gaps between current and future states
- Contribute to cost/benefit analyses to inform architectural decisions
- Analyze technology environments to identify critical deficiencies and recommend improvements
- Promote the reuse of data assets, including managing the data catalog for reference
- Create architectural diagrams, interface specifications, and other design documents
if available or interested, apply now! W2 only.
Contact: mshadab@judge.com
This job and many more are available through The Judge Group. Find us on the web at www.judge.com
More jobs in New York, New York
|
New York University |
|
New York University |
|
Mizuho Americas Services LLC |