About the Role:Data is the driver for our future at Cars Commerce. We're searching for a collaborative, analytical, and innovative engineer to build scalable and highly performant platforms, systems and tools to enable innovations with data. If you are passionate about building large scale systems and data driven products, we want to hear from you.Responsibilities Include:Build data pipelines and deriving insights out of the data using advanced analytic techniques, streaming and machine learning at scaleWork within a dynamic, forward thinking team environment where you will design, develop, and maintain mission-critical, highly visible Big Data and Machine Learning applicationsBuild, deploy and support data pipelines and ML models into production.Work in close partnership with other Engineering teams, including Data Science, & cross-functional teams, such as Product Management & Product DesignOpportunity to mentor others on the team and share your knowledge across the Cars.com organizationRequired SkillsExperience with one or more query language (e.g., SQL, PL/SQL, DDL, HiveQL, SparkSQL)Experience with data modeling, warehousing and building ETL pipelinesProficiency in at least one programming language commonly used within Data Engineering, such as Python, Scala, or Java.Solid understanding of Spark and ability to write, debug and optimize Spark code.Solid understanding of various file formats and compression techniques.Experience with any of ETL schedulers such as Airflow or similar frameworks.Experience with source code management systems such as Github and developing CI/CD pipelines with tools such as Jenkins for data.Excellent communication and collaboration skills. Ability to design, develop and debug at a cross-project level.Required ExperienceData Engineering | 3+ years of designing & developing complex, real-time applications at enterprise scale; specifically Python and/or Scala. Big Data Ecosystem | 2+ years of hands-on, professional experience with tools and platforms like Spark Streaming, EMR, Kafka.AWS Cloud | 2+ years of professional experience in developing Big Data applications in the cloud, specifically AWS.Preferred:Experience developing Spark streaming jobs to read data from Kafka.Experience developing REST APIsExperience in deploying machine learning models into production and integrating them into production applications for use.#LI-KO1 #LI-REMOTE
