[Hiring] Data Engineer @Foundation for California Community Colleges

Role Description

The California College Guidance Initiative (CCGI) is looking for a data engineer to join the Cloud Infrastructure Team. As part of the team, you will be a key contributor in the expansion, refinement, and continued development of CCGI’s infrastructure utilizing Snowflake and Amazon Web Services (AWS), as well as continuing to build out our data analytics and engineering tools.

The ideal candidate has extensive experience building out data ETL/ELT workloads, including the testing, maintenance, and refinement of containerized workloads in cloud architectures. The Data Engineer should also have experience successfully scaling up an organization’s data intake from batch to streaming data, as well as automating data delivery. This person is comfortable working with data storage and can troubleshoot data accessibility via SQL, Python, shell scripting, AWS, Snowflake, and take on a leadership role in special projects when needed. Additionally, this person should have experience developing technical documentation and implementing security governance protocols.

While there are no direct supervisory responsibilities for this position, the ideal candidate will have proactively and successfully collaborated with other subject matter experts to move time-bound projects to completion. Additionally, the ideal candidate will have experience working with K-12 or education data and/or have an interest in large educational systems and the equity challenges students face when navigating such systems.

We work to solve large scale, system-level problems. You must be comfortable working with unknowns and ambiguous solutions, as well as passionate about promoting public education and advancing educational equity. This role reports to the Director, Cloud Infrastructure.

Qualifications

• Relevant BA/BS in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field.
• Minimum of three (3) years of experience as a Data Engineer or a related role.
• Ability to build processes supporting data transformation, data structures, metadata, dependency, and workload management.
• Advanced proficiency with cloud data warehousing analytical tools such as Snowflake, Redshift, Spark, Kafka, etc.
• Expert SQL knowledge (SQL Server, PostgreSQL, MySQL, etc.) and understanding of relational databases, query authoring and optimization, as well as working familiarity with a variety of databases.
• Advanced proficiency using ETL tools like Jupyter Notebooks, dbt, Talend, etc.
• Advanced proficiency with scripting languages like Python, Scala, R, etc.
• Advanced proficiency building and optimizing data pipelines and data sets.
• A successful history of manipulating, processing and extracting value from large structured and unstructured datasets.
• Demonstrated ability to consistently develop strong technical documentation.
• Advanced certifications such as SnowPro Core, AWS Cloud Practitioner Certification, or AWS Certification, Solutions Architect - Associate are a plus.
• Experience working with K-12 data and/or education data is encouraged.

Requirements

• Lead the development, maintenance, and optimization of batch and streaming ETL/ELT processes.
• Develop, containerize, test and maintain workflows within integrated development environments (IDEs) using AWS cloud services, Snowflake data warehouses, Python and SQL scripts, dbt, and shell scripts.
• Review, redesign, and expand data models supporting data warehousing and self-service business intelligence architecture.
• Design and implement data pipeline automation requiring Python scripting and SQL statements.
• Participate in meetings, research processes, requirement collection, data analysis, and collaborate with key project stakeholders.
• Develop and maintain expert knowledge of CaliforniaColleges.edu data, systems, and business processes.
• Continuously improve data pipelines and architecture by staying updated on industry trends and best practices.
• Other duties as assigned by your supervisor.

Benefits

• Paid holidays, sick and vacation leave.
• Medical, dental, and vision insurance.
• Employee Assistance Program.
• Defined benefit retirement plan (CalPERS).
• 403(b) and 457(b) retirement plans.
• $50,000 Basic Life and Accidental Death and Dismemberment insurance coverage for eligible employees.
• Flexible Spending Accounts.
• Tuition Reimbursement.
• Voluntary Life Insurance.
• Pet insurance and more.

Application Instructions

• Go to foundationccc.wd1.myworkdayjobs.com .
• Find “Data Engineer” and follow the directions to apply.
• Include both a cover letter and resume with your application.
• The application process will be open until the position is filled.