Job summary
IT Concepts is looking for an experienced Senior-Level Data Engineer to support our intelligence customer.Design and develop end-to-end data pipelines in SQL Server database; oversee build, implementation, and optimization of these pipelines.Monitor and ensure data pipelines meet performance, availability, and quality standards.
Job seniority: mid-to-senior level
Responsibilities
• Design and develop end-to-end data pipelines in SQL Server database; oversee build, implementation, and optimization of these pipelines.• Monitor and ensure data pipelines meet performance, availability, and quality standards.• Implement data orchestration solutions for data pipelines.• Manipulate large volumes of data into formats suitable for analytics and reporting.• Adhere to data governance policies and best practices for protecting data.• Research, analyze, and document various technical approaches (including implementation, benefits, constraints, outcomes, and associated risks).• Collaborate with data architect/database administrator to address and resolve problems in the case of failed jobs.• Develop metadata documentation and architecture documents.• Engage with technical and functional program subject matter experts and stakeholders to understand business processes, data requirements, critical data elements, data mappings, data protection guidelines, etc.• Provide recommendations for improvements in data strategies, including governance, integration, and standardization changes.
Requirements
• Bachelor's degree in computer science, mathematics, engineering, information systems, or related.• 7+ years of experience as a data engineer (e.g., building data pipelines, coding best practices, maintaining data quality)• Demonstrated experience with ETL processes and concepts in relational (SQL) database management systems.• Expertise in Python and/or SQL• Proficient in Agile development, git operations• Experience translating requirements into technical tasks and developing data structures to support the generation of business insights and strategy.• Innovative problem-solving and root cause identification skills.• Knowledge of data modeling• Experience with data orchestration tools (e.g., Dagster, Prefect, Apache Airflow)• Experience communicating and presenting data to non-technical stakeholders, written and verbally.• Must be self-directed, detail-oriented, and able to coordinate and work with a dynamic team and multiple stakeholders.• Clearance requirements: Must have an active TS/SCI at the time of hire, and willing/able to get CI Polygraph
Key Skills Needed
• SQL• Python• ETL processes• Agile development• Git operations• Data modeling• Data orchestration• Communication• Problem-solving• Root cause identification
Benefits
• Competitive Paid Time Off• Medical, Dental and Vision Insurance• Identity Protection• Pet Insurance• 401(k) with company matching
