Agilious isseeking a highly skilled Data Engineer to join our team temporarily and play a key role in building and maintaining our data pipelines. The ideal candidate will have strong expertise in Fivetran for data extraction and Airflow for workflow orchestration. You will be responsible for designing, implementing, and automating the flow of data from various sources to our data warehouse.
Duration:
This opportunity is for a short term of 3 months only, from June-August, 2024.
Location/Remote:
This opportunity is remote and requires working with the East Coast Timezone.
Experience:
Minimum of 3–5 years of experience as a Data Engineer
Duties and Responsibilities
Design, develop, and implement data pipelines using Fivetran for efficient data extraction from various sources.
Build and maintain data workflows using Airflow to automate data ingestion, transformation, and loading (ETL) processes.
Write high-quality, maintainable, and efficient code for data transformations.
Collaborate with data analysts and business stakeholders to understand data requirements and design appropriate data pipelines.
Monitor and troubleshoot data pipelines to ensure smooth operation and data quality.
Implement best practices for data engineering, including version control, documentation, and testing.
Stay up-to-date on the latest advancements in Fivetran, Airflow, and data engineering technologies.
Required Skills and Qualifications
Bachelor's degree in Computer Science, Information Technology, or a related field (or equivalent experience).
Minimum 3+ years of experience as a Data Engineer or similar role.
Strong expertise in Fivetran, including connector configuration, data transformation, and scheduling.
Proficiency in Airflow (MWAA), including DAG creation, operators, and scheduling.
Knowledge of and hands-on experience with use of Dynamic Tables in Snowflake.
Knowledge of and hands-on experience with Data Build Tool (dbt).
Solid understanding of SQL for data manipulation and transformation.
Experience with cloud platforms (AWS, Azure) is a plus.
Excellent written and verbal communication skills.
Ability to work independently and as part of a team.
Strong problem-solving and analytical skills.
Tools and Technologies:
Fivetran
Airflow (MWAA)
Snowflake
SQL (e.g., MySQL, PostgreSQL)
Python (or similar scripting language)
Cloud platforms (AWS, Azure) (familiarity preferred)
Why Work at Agilious
We work hard, so we take care of each other and try to enjoy ourselves along the way:
We hire smart people.
We encourage our team to raise their hand when they see an opportunity to change our existing processes.
We value culture and believe our business thrives in the diversity of our teams.
We offer company-paid medical benefits that are designed to support our employees.
We offer competitive salaries and a 401(k) plan with profit sharing.
We operate like a startup with a proven business model that's growing fast!
We have a Casual dress code (jeans are welcome).
We have a remarkable professional development program that allows you to stay current and on top of your field.
We are passionate about our clients and live/breathe the client experience.
We encourage creativity and embrace change.
We believe in autonomy & taking initiative.
We collaborate with our leadership team daily to ensure vision alignment and transparency as an organization.
We are an equal-opportunity employer and value diversity at our company. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
#J-18808-Ljbffr
