Data Engineer at The Select Group in San Jose, California

Job Description:

Job Title: Data Scientist
Job Duration: 12 months


Project Details: This role will be assisting in the implementation of Big Eye which is a Data Monitoring tool that sits on top of a Data Warehouse.

Top 3 Skills:

Experience with AI/ML to profile, identify rules, transform and cleanse data within data warehouse, data lakes
Job Responsibilities:

• Develop interface with Snowflake


• Establish metadata from Snowflake within Bigeye along with generating extracts so that the metadata can be shared with Alation data catalog in agreed format


• Establish data lineage of data residing within Snowflake


• Automated monitoring of data pipelines going into Snowflake


• Automated monitoring of data within Snowflake


• Snowflake Data lineage through Bigeye


• Configuration of reports, metrics to showcase data anomalies within Snowflake


• Develop workflows, notifications about data anomalies


• In partnership with business and IT stakeholders, adhere to schedule of deliverables and milestones to ensure that data can be standardized in a timely manner.


• Lead meetings with stakeholders to demonstrate tool capabilities, configurations, and walkthrough of the solution.

Profile data to ensure each source to target attribute is properly mapped based on its definition and use case. Additionally, understand the extent to which each attribute is standardized (e.g., naming conventions, value formats, domain of values, etc.), accurate, complete, and unique (e.g., duplicates, records not accurately categorized).

• Bachelor's Degree (B.A. or B.S.) in Computer Science / Information Science / Data Engineering related degree


• 3-5 years of relevant job experience in developing reports for data profiling and data quality


• At a minimum, experience of 1-2 projects using Bigeye or any other comparable data observability tool.


• Understanding of Snowflake and Operational data managed within Snowflake.


• Skilled at using SQL scripts to analyze and transform data.


• Excellent interpersonal and communication skills


• Ability to act independently and as part of a team


• Track record of dealing well with ambiguity, prioritizing needs, planning and managing multiple projects, and delivering measurable results in a fast-paced environment


• Demonstrated partnering skills with both technical and non-technical partners.


• Self-motivated and results-oriented with a drive to learn new technologies.

TSG is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

#LI-AM1


70517