DESCRIPTION Amazon Web Services (AWS), a leading cloud computing provider and subsidiary of Amazon.com, is seeking a talented and experienced Data Engineer to join our AWS Marketing Insights team. In this pivotal role, you will be responsible for designing, building, and maintaining robust data pipelines and data infrastructure to support data-driven insights across the organization.
Key job responsibilities
As a Data Engineer on the AWS Marketing Insights team, your pivotal role will revolve around designing, building, and maintaining robust data pipelines and infrastructure to drive data-driven insights. Core responsibilities include architecting scalable and fault-tolerant pipelines to extract, transform, and load data from various sources into data warehouses or lakes. Leveraging cutting-edge tools and technologies, you'll implement ingestion, transformation, and integration processes, ensuring stringent data quality through validation, cleansing, and deduplication.
You'll design and implement high-performance, scalable, and cost-efficient data storage solutions. Utilizing CI/CD principles, you'll automate infrastructure deployment and maintenance processes, ensuring a streamlined data ecosystem. Data modeling and engineering will be crucial, involving designing and implementing optimized data models, developing and maintaining ETL processes, and collaborating with analysts and functional managers to understand data needs and provide tailored data structures.
Ensuring data governance, security, and compliance will be paramount. You'll implement robust policies and processes, enforce access controls, encryption, and auditing mechanisms, and collaborate cross-functionally to establish and maintain data governance standards.
Continuous improvement and automation will be woven into your daily activities, continuously evaluating and optimizing processes, pipelines, and infrastructure, implementing automation and monitoring tools, and staying ahead of emerging data engineering technologies and trends.
We are open to hiring candidates to work out of one of the following locations:
Austin, TX, USA | Bellevue, WA, USA | Seattle, WA, USA BASIC QUALIFICATIONS - 5+ years of data engineering, database engineering, business intelligence or business analytics experience
- Bachelor's degree in computer science, engineering, analytics, mathematics, statistics, IT or equivalent
- Knowledge of distributed systems as it pertains to data storage and computing
- Knowledge of professional software engineering & best practices for full software development life cycle, including coding standards, software architectures, code reviews, source control management, continuous deployments, testing, and operational excellence
- Proficient in programming languages such as Python, Scala, or Java, and familiarity with SQL.
- Experience with data engineering tools and frameworks like Apache Spark, Apache Kafka, Apache Airflow, or similar.
- Knowledge of data warehousing concepts, dimensional modeling, data modeling techniques and building ETL pipelines.
- Strong problem-solving and analytical skills, with the ability to translate business requirements into technical solutions.
- Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams.
