DESCRIPTION Amazon Fashion & Fitness Data Engineering (F2DE) team is looking for a self-driven, analytical, and strategic Data Engineer. In this role, you will be working in one of the world's largest and most complex data environments. You should be passionate about working with huge datasets, search analytics and be someone who loves to bring data together and work on innovative Data Engineering solutions to answer business questions. You should have deep expertise in creation and management of datasets and the proven ability to translate the data into meaningful insights through collaboration with Software Development Engineers (SDEs), Business Intelligence Engineers (BIEs) and Scientists. In this role, you will have ownership of end-to-end development of data engineering solutions to complex questions and you'll play an integral role in strategic decision-making.
Key job responsibilities
As a Senior Data Engineer, you will work in one of the world's largest and most complex data warehouse environments, partnering with other engineers, Scientists, and Program Managers to develop scalable and maintainable data pipelines on both structured and/or unstructured data. You will develop scalable and innovative analytical solutions, process and store terabytes of low latency data, and enable F2DE team team to build successful, data-driven strategies.
You will be responsible for designing and implementing a new data architecture using third-party and in-house tools, writing scalable, highly tuned SQL queries running over billions of rows of data, and Python or Scala to automate the ETL, analytics, and data quality platform from the ground up. You will design and implement complex data models, model metadata, build reports and dashboards, and own data presentation and dashboarding tools for the end users of our data products and systems.
You will work with leading-edge technologies like AWS Redshift, Apache Spark, and more while helping the organization migrate away from legacy tools/technologies. The ideal candidate has strong business judgment, good sense of architectural design, written/documentation skills, and experience with big data technologies (Spark/Hive, Redshift, EMR, +Other AWS technologies). This role involves both overseeing existing pipelines as well as developing brand new ones for the Data Lake/Warehouse owned by the F2DE team.
You should have deep expertise in the design, creation, management, and business use of large datasets across a variety of data platforms. You should have excellent business and interpersonal skills to be able to work with business owners to understand data requirements and implement efficient and scalable ETL solutions. You should be an authority at crafting, implementing, and operating stable, scalable, low-cost solutions to replicate data from production systems into the BI data store.
About the team
The operating environment is fast-paced and dynamic, however, has a strong team spirit and welcoming culture. To thrive, you must be detail-oriented, enthusiastic, and flexible, in return, you will gain tremendous experience with the latest in big data technologies and DE methodologies.
We are open to hiring candidates to work out of one of the following locations:
Seattle, WA, USA BASIC QUALIFICATIONS - 5+ years of data engineering experience
- Experience with data modeling, warehousing and building ETL pipelines
- Experience with SQL
- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
- Experience mentoring team members on best practices
