Lead Data Engineer at BC Forward in San Francisco, California

Job Description:

Lead Data Engineer



BCforward is currently seeking a highly motivated Lead Data Engineer for an opportunity in San Jose CA!




Position Title: [Lead Data Engineer]



Location: [San Jose CA]

Anticipated Start Date: [ASAP]


Please note this is the target date and is subject to change. BCforward will send official notice ahead of a confirmed start date.



Expected Duration: [12+ Months contract]



Job Type: [FULL TIME (>=30 HRS WEEKLY)/ Remote]

Pay Range: [$70/hr] - [$72/hr]


Please note that actual compensation may vary within this range due to factors such as location, experience, and job responsibilities, and does not encompass additional non-standard compensation (e.g., benefits, paid time off, per diem, etc.).

Job Description:

• Ability to design and develop a high performance data pipeline framework from scratch


• Data ingestion across systems


• Data quality and curation


• Data transformation and efficient data storage


• Data reconciliation, monitoring and controls


• Support reporting model and other downstream application needs


• Skill in technical design documentation, data modeling and performance tuning applications


• Lead and manage a team of data engineers, contribute towards code reviews, and guide the team in designing and developing convoluted data pipelines adhering to the defined standards.


• Be hands on, performs POCs on the open source/licensed tools in the market and share recommendations.


• Provide technical leadership and contribute to the definition, development, integration, test, documentation and support across multiple platforms (GCP, Python, HANA)


• Establish a consistent project management framework and develop processes to deliver high quality software, in rapid iterations, for the business partners in multiple geographies


• Participate in a team that designs, develops, troubleshoots, and debugs software programs for databases, applications, tools etc.


• Experience in balancing production platform stability, feature delivery and reduction of technical debt across a broad landscape of technologies.

Skill in the following platform, tools and technologies

• GCP cloud platform - GCS, Big Query, Streaming (pub/sub), data proc and data flow, NIFI


• Python, PYSpark, Kafka, SQL, shell scripting & Stored procs


• Data warehouse, distributed data platforms and data lake


• Database definition, schema design, Looker Views, Models


• CI/CD pipeline


• Proven track record in scripting code in Python, PySpark and SQL


• Excellent structured thinking skills, with the ability to break down multi-dimensional problems


• Ability to navigate ambiguity and work in a fast-moving environment with multiple stakeholders


• Good communication skills and ability to coordinate and work with cross functional teams.

Benefits:



BCforward offers all eligible employees a comprehensive benefits package including, but not limited to major medical, HSA, dental, vision, employer-provided group life, voluntary life insurance, short-term disability, long-term disability, and 401k.

About BCforward:



Founded in 1998 on the idea that industry leaders needed a professional service, and workforce management expert, to fuel the development and execution of core business and technology strategies, BCforward is a Black-owned firm providing unique solutions supporting value capture and digital product delivery needs for organizations around the world. Headquartered in Indianapolis, IN with an Offshore Development Center in Hyderabad, India, BCforward's 6,000 consultants support more than 225 clients globally.


BCforward champions the power of human potential to help companies transform, accelerate, and scale. Guided by our core values of People-Centric, Optimism, Excellence, Diversity, and Accountability, our professionals have helped our clients achieve their strategic goals for more than 25 years. Our strong culture and clear values have enabled BCforward to become a market leader and best in class place to work.


BCforward is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or protected veteran status and will not be discriminated against based on disability.


To learn more about how BCforward collects and uses personal information as part of the recruiting process, view our Privacy Notice and CCPA Addendum. As part of the recruitment process, we may ask for you to disclose and provide us with various categories of personal information, including identifiers, professional information, commercial information, education information, and other related information. BCforward will only use this information to complete the recruitment process.


This posting is not an offer of employment. All applicants applying for positions in the United States must be legally authorized to work in the United States. The submission of intentionally false or fraudulent information in response to this posting may render the applicant ineligible for the position. Any subsequent offer of employment will be considered employment at-will regardless of the anticipated assignment duration.


Interested candidates please send resume in Word format Please reference job code 233725 when responding to this ad.


Get job alerts by email.Sign up now!Join Our Talent Network!



Job Snapshot




Employee Type

Contractor



Location

San Francisco, CA (Onsite)



Job Type

Information Technology



Experience

Not Specified



Date Posted

12/30/2024 Apply Now