WHAT IS THE POSITIONAre you an innovative and collaborative technology professional with more than 2 years of enterprise level data engineering experience? Join Edmentum's technology team as a Data Engineer and dive right into our data lake!Edmentum creates learning technology solutions designed to support educators and supplement existing curriculum with one goal in mind: positive student outcomes. Our solutions and services are in use in more than 43,000 schools, with 400,000 educators, and 5.2 million students in all 50 states and more than 100 countries worldwide.As a Data Engineer, you will be an essential contributor on our Technology team, a highly collaborative group that solves Edmentum's big data challenges. You will perform development and operations activities for our data lake, which serves as the foundational data architecture for Data Analytics and Research. You will be directly involved in the design, development and implementation of data infrastructure, pipelines, and storage at scale. You'll work to ingest and process both streaming and batch data using leading-edge cloud tools from AWS and Databricks that represent purpose-built architecture. We invite you to bring your passion for data and join us in operationalizing exciting data pipelines aligned to Edmentum's strategic goals.This is NOT a C2C role. WHAT YOU WILL DO· Design, develop, and implement data pipelines that collect, connect, centralize, and curate data from various internal and external data sources.· Contribute to a development team to deliver best-in-class data pipelines supporting key data initiatives for the data lake in AWS.· Implement purpose-built data architecture for data users including data marts, 3rd party integrations, and dimensional models that allow for efficient data consumption.· Develop and maintain APIs, microservices, and related component libraries in support of targeted platform capabilities in our technology ecosystem.· Work in close collaboration with your data-minded colleagues focused on application development, reporting, and Business Intelligence.WHAT IS REQUIRED· Bachelor of Science (B.S.) from a 4-year college or university in Computer Science, Information Management Systems, or equivalent experience.· 3 or more years of experience with Python and SQL programming skills· 2 or more years of experience working with Spark (pyspark data frames)· Previous Software Engineering experience working with Gitflow as a team with multi-environment deployments.· 2 or more years of experience working with relational databases such as SQL, RDBMS (SQL Server) or Postgres.· 1 or more years of experience with streaming data processing tools such as Kinesis or cloud functions such as AWS Lambda· 1 or more years of experience with batch data processing with ETL tools such as Databricks ETL· 1 or more years of experience with job administration and scheduling of complex data workloads using tools such as Apache Airflow· 1 or more years of experience working with non-rdbms data warehouse/lake stores (such as Big Query, Snowflake, Databricks Delta Lake, or Redshift)· Previous experience with Cloud data tools (GCP, Azure, AWS) such as: EMR, S3, EC2, Glue, and ECS· Experience with the Databricks platform tools such as Delta Lake and Unity Catalog.· Experience with at least 1 additional programming language (c#, scala, java, nodejs, etc.)· Foundational understanding of Data Lake architecture patterns.· Foundational understanding Cloud Infrastructure, Operations, and the Software Development Lifecycle (SDLC).· Ability to deeply understand business problems and how data solutions contribute to resolving or solving them.· Strong critical-thinking skills with the ability to think both logically and creatively to deliver elegant engineering solutions to complex problems.· Effective communications skills (both verbally and written) with the ability to clearly articulate the key considerations of complex topics.· Demonstrated ability to operate with a strong pride of ownership through the lifecycle of a solution and other work products.WHY JOIN EDMENTUM· Competitive compensation package and best in class Total Rewards offerings.· Opportunity to lead and shape the revenue generation strategy of a dynamic company.· Collaborative and inclusive Remote First work environment· Company culture that values innovation, growth, and impact.· Commitment to employee development and career advancement.
