- Leverage Azure Cloud to create and maintain ETL/ELT environments.
- Develop new features within the framework or as part of the native data-flow leading to it.
- SME in initial deploying and start of the framework in new clients environment.
• Stack: Python, PySpark, DataBricks, Azure DevOps, Azure Data Factory, SQL, Azure SQL, Delta Lakes.
-- ML /AI projects for Data Science
-- Visualization projects for Data Analytics.
• Leverage Azure Data Factory, Azure DataBricks, Azure DevOps, Azure SQL, Snowflake... to create and maintain ETL/ELT data pipelines having multiple ingestion points / transformations of variable data formats.
• Lead new features and high impact projects which coordinate resources from
multiple sources and teams in a decentralized department.
• Leverage and improve DataBricks spark environment for efficient data manipulation / transformation.
• Drive the improvement of current project architecture as follows:
-- Make use of the new Repos feature in DataBricks to improve upon current CI/CD.
-- Apply different layers to project structure to drive away from heavy notebooks scripting and towards modularization of code.
-- Migrate towards more functional & OOP structured code for better QA.
• Stack: Python, PySpark, DataBricks, Azure DevOps, Azure Data Factory, SQL, Java, Snowflake, Oracle SQL, Azure SQL, Delta Lakes.
Data Engineer
Contract type | Freelancers |
---|---|
Daily rate | 470$/day |
Experience | 2 years |
Location | France |
Data Engineer
Contract type | Freelancers |
---|---|
Daily rate | 390$/day |
Experience | 2 years |
Location | Romania |
Data Engineer
Contract type | Freelancers |
---|---|
Daily rate | 280$/day |
Experience | 2 years |
Location | France |
Data Engineer
Contract type | Freelancers |
---|---|
Daily rate | 415$/day |
Experience | 2 years |
Location | France |
Data Engineer
Contract type | Freelancers |
---|---|
Daily rate | 415$/day |
Experience | 2 years |
Location | France |
Data Engineer
Contract type | Freelancers |
---|---|
Daily rate | 415$/day |
Experience | 2 years |
Location | France |
Data Engineer
Contract type | Freelancers |
---|---|
Daily rate | 530$/day |
Experience | 2 years |
Location | France |
Data Engineer
Contract type | Freelancers |
---|---|
Daily rate | 460$/day |
Experience | 2 years |
Location | France |
Data Engineer
Contract type | Freelancers |
---|---|
Daily rate | 415$/day |
Experience | 2 years |
Location | France |
Data Engineer
Contract type | Freelancers |
---|---|
Daily rate | 375$/day |
Experience | 2 years |
Location | France |
Data Engineer
Contract type | Freelancers |
---|---|
Daily rate | 300$/day |
Experience | 2 years |
Location | France |
Data Engineer
Contract type | Freelancers |
---|---|
Daily rate | 75$/day |
Experience | 2 years |
Location | India |