Role Summary:
The Data Engineer Sr. will execute the full development life cycle of integrating data from disparate sources to consolidated repositories such as the operational data store, the data warehouse, and the data lake. Designs and develops data pipelines, data ingestion and ETL processes that are scalable, repeatable and secure. This will be accomplished by collaborating with team members and applying ETL, database and API development skills to devise best in class solutions. We are looking for an experienced, energetic, and entrepreneurial engineer who has successfully imagined, built and launched data integration solutions.
Role Responsibilities:
Strategic Work 25%
Educate and inform yourself and team members about data integration technology solutions and emerging trends
Continually participate in visioning exercises and contribute to the data strategy for VCI
Operational Work 75% of time
Design, develop, test and deploy data integration solutions based on business requirements
Troubleshoot and resolve production issues
Implement Data Warehouse data quality processes. Provide solutions where issues are identified
Participate in code reviews
Continually refine and document data integration best practices
Educate end users (where applicable) in the use of metadata and understanding where data originates
Identify, evaluate and refine leading-edge data integration tools and methods
Build prototypes and POCs
Bring a passion to stay on top of tech trends, experiment with and learn new technologies, participate in internal & external technology communities, and mentor other members of the engineering community
Collaborate with team members on data integration designs and alternatives
Own the development of cross-functional, multi-platform prototypes
Work within and across Agile teams to design, develop, test, implement, and support data analytics integration solutions.
Document and support deployment activities.
Report on status of IT Data Operations products and projects on a regular and timely basis.
Ensure the timely resolution of issues.
Follow VCI standards and guidelines.
Escalate anticipated risks to management promptly and properly.
Partner with Domain Architects regarding data integration design options
Experience:
Data integration development experience with the following skill sets:
Extract, transformation and load (ETL) of disparate
data sources to targets including databases, files
and API s. Informatica Power Center preferred
Ability to detect, identify and resolve source
to target performance / load issues
Expert level proficiency in structured query language (SQL)
Data Warehousing:
Thorough understanding of relational data models including third normal form and fact / dimension designs
Change data capture (CDC) design options
and application
Data marts
Oracle database platform features including
indexing, partitioning and PL/SQL
Open source integration technologies including
Hadoop, Hive, Hue, Spark and Kafka
Linux O/S commands and scripting
Secure File Transfer Protocol (SFTP)
KanBan and Agile methodologies
Desire to work in the data integration space (data warehouse, data lake, AWS, data API s) while continuing to grow skill sets
Excellent oral and written communication skills
Desired
Modern development practices e.g. DevOps
Experience with open source database platforms
such as MySQL and MariaDB
Data Lake integration design and development (Informatica Big Data Management a plus)
Experience with data quality tools such as SAS
DataFlux or Informatica IDQ
Experience with AWS platform : Kinesis / Firehose, Glue, Redshift, S3, etc
AWS Certifications
Experience in API development
Master data management integration and concepts
Experience with job scheduling solutions such as
Tidal
Experience in Financial Services (automotive
finance preferable)
Work Flexibility:
Travel possible up to 15%
Onsite, remote work on Manager s direction
Minimum 8 hours per day, M-F.
Will be responsible for level 2 support outside of normal working hours
We are proud to be an EEO employer M/F/D/V. We maintain a drug-free workplace and perform pre-employment substance abuse testing.
