Are you passionate about data integration and looking for an opportunity to design and implement cutting-edge solutions? Join our dynamic team and play a crucial role in transforming data into actionable insights. We're seeking an experienced Data Integration Specialist to create and maintain robust data integration workflows using the latest technologies.
Key Responsibilities:
Design and Develop Solutions: Create robust data integration solutions using ETL (Extract, Transform, Load) tools, APIs, and other advanced integration technologies.
ETL Workflows: Develop and maintain ETL workflows to extract data from various sources, transform it into usable formats, and load it into data warehouses or other target systems.
Data Quality and Security: Ensure data quality, integrity, and security throughout the integration process.
Data Validation: Implement data validation and error handling mechanisms to maintain data accuracy.
Governance and Compliance: Adhere to data governance policies and procedures to ensure compliance.
Data Pipelines: Create and manage data pipelines for both batch and real-time data processing.
Stakeholder Collaboration: Work closely with business stakeholders to understand their data requirements and translate them into technical specifications.
Team Collaboration: Collaborate with data architects, analysts, and other IT team members to develop comprehensive data integration solutions.
Mentorship: Provide technical guidance and mentorship to junior developers, fostering a collaborative and educational environment.
Optimization: Optimize data integration processes for performance and scalability.
Troubleshooting: Monitor and troubleshoot data integration issues, ensuring timely resolution and minimal disruption.
Continuous Improvement: Continuously enhance existing data integration solutions to improve efficiency and effectiveness.
Documentation: Maintain comprehensive documentation of data integration processes, workflows, and technical specifications.
Reporting: Generate reports and dashboards to provide insights into the performance and status of data integration processes.
Required Skills and Experience:
ETL Development: 5+ years of experience in ETL development.
SSIS Packages: 3+ years of experience creating SQL Server Integration Services (SSIS) packages.
Coding Skills: Proficiency in writing and understanding SSIS script components in C#.
SQL Proficiency: Hands-on experience with T-SQL or comparable database-specific SQL dialects.
Query Optimization: Proven ability to tune SQL queries and optimize ETL processes for large datasets.
Database Technologies: Solid proficiency in multiple database technologies.
Data Modeling: Strong knowledge of data modeling and data warehousing principles.
API and Middleware: Familiarity with APIs and middleware solutions for system integration.
Scripting Languages: Proficiency in scripting languages such as Python and PowerShell.
Agile Practices: Skilled in Agile development practices and techniques.
Version Control: Well-versed in version control tools, such as Git.
Communication: Excellent communication skills with the ability to mentor and guide team members.
Preferred Skills:
Database Platforms: Proficiency with SQL Server, DB2, Snowflake, and Postgres.
API Design: Knowledge of API design patterns and guidelines.
AWS Technologies: Experience with AWS native technologies such as API Gateway, Lambda, SQS, SNS, CloudWatch, Step Functions, and ElastiCache.
Azure DevOps: Well-versed in Azure DevOps for team collaboration.
ORM Tools: Skilled with ORM tools such as SQLAlchemy.
Real-time Processing: In-depth knowledge of real-time data processing frameworks like Apache Kafka.
CI/CD Practices: Hands-on experience with CI/CD and DevOps practices.
Infrastructure as Code: Experience with Infrastructure as Code (IaC) tools like Terraform.
Job Types:
Full-time
Contract
Compensation:
Pay: $65.00 - $75.00 per hour
Expected hours: 40 per week
Experience Level:
8-11+ years
Schedule:
8-hour shift
Monday to Friday
Work Location:
Remote
Join our team and help us turn data into powerful insights that drive decision-making and innovation. Apply now to make a significant impact as a Data Integration Specialist!
Employment Type: Contractor
Salary: $ 65.00 75.00 Per Hour
