What we're looking for:Join our dynamic team as a talented engineer tasked with maintaining and expanding our data warehouse to meet the diverse needs of both internal and external stakeholders. Reporting directly to the Manager of Engineering, this pivotal role collaborates closely with a diverse team of on-site and off-site software engineers to bring our data roadmap to fruition. As a Data Engineer, you'll play a crucial role in upholding our commitment to excellence by leveraging your engineering prowess to maintain and expand our data infrastructure. How you will create impact:Ensure use of engineering "best practices" for development, security, accessibility, compliance, performance, etc.Design, develop, and maintain scalable systems, data pipelines, architectures.Develop data processing algorithms and analytics in Python, leveraging libraries like Pandas, NumPy, and Matplotlib.Write well-designed, testable, and efficient code.Protect operations by keeping information and data confidential.Collaborate with cross-functional teams to identify and solve data-related technical challenges.Integrate and contribute to the development of REST APIs to facilitate data exchange and service communication.Contribute to the development and implementation of machine learning models, including data preparation, feature engineering, and model evaluation.Develop, optimize, and maintain databases, with proficiency in both SQL and NoSQL databases Ensure data integrity and system performance through rigorous testing and validation.Who you are:5+ years of professional experience in software development with familiarity in data engineering or data science. Relevant experience will be accepted in lieu of a Computer Science or related degree.5+ years experience collaborating with and working in cross functional teams including product, user experience, project management, etc.2+ years leading or mentoring other developers on the teamExpertise in Python, specifically with libraries like Pandas, NumPy, and Matplotlib.Experience in developing and consuming REST APIs.Strong knowledge of SQL and experience with NoSQL databases, specifically MongoDB.Proven ability to design and optimize data models and database schemas.Familiarity with machine learning concepts and tools. Desirable Skills:Experience with cloud platforms (AWS, GCP, Azure) and their data services.Experience with structured ETL frameworks like Apache Airflow, or related technologies such as AWS Glue/ AWS lambda step functions.Experience with cloud-based data warehousing solutions like Snowflake and data engineering platforms like DatabricksKnowledge of data streaming technologies like Kafka, AWS Kinesis, or RabbitMQ.Experience with data visualization and business intelligence tools.5+ years full stack development experience with back end technologies.
