Data Engineer With ( Aws, Hadoop, Spark )

Data Engineer With ( Aws, Hadoop, Spark )
Company:

Lorven Technologies, Inc.


Data Engineer With ( Aws, Hadoop, Spark )

Details of the offer

Bachelor's degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field with minimum of 2 to 8+ years of experience.

Strong Programming experience with object-oriented/object function scripting languages: Python, PySpark, Scala, etc.

Experience with big data tools: Hadoop, Apache Spark, Kafka, etc.

Experience with AWS cloud services: S3, EC2, EMR, RDS, Redshift

Experience with stream-processing systems: Storm, Spark-Streaming, etc.

Experience with relational SQL, Snowflake and NoSQL databases, including Postgres and Cassandra.

Create and maintain optimal data pipeline architecture, Assemble large, complex data sets that meet functional / non-functional business requirements.

Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability etc.

Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS 'Big data' technologies.

Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.

Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.

Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.

Demonstrate excellent communication skills including the ability to effectively communicate with internal and external customer

Ability to use strong industry knowledge to relate to customer needs and dissolve customer concerns and a high level of focus and attention to detail.

Strong work ethic with good time management with the ability to work with diverse teams and lead meetings


Source: Dice


Area:

Requirements


Knowledges:

  • Python
  • SQL

Infrastructure engineer in colombia

Our company is R&D focused with 200 of the brightest minds in DC. We are made up of 40% PhD level researchers and over 100 top notch engineers to support some...


New York

Published a month ago

Infrastructure engineer in colombia

If you are a Project Architect/Project Manager with experience, please read on! What You Need for this Position - LEED - Owner's Rep - License - Registered...


New York

Published a month ago

Cad designer

We are an upscale full-service marketing firm in Bethesda. We are looking for an experienced PPC Manager to help us get the most out of our ad campaigns for our...


Minnesota

Published a month ago

Multifamily lead superintendent

We are an ENR top ranked Contractor with an urgent opening for a Sr Project Engineer to build an iconic ground-up mixed-use project in Seattle. Top Reasons to...


Colorado

Published a month ago