Project: Create a Tax and Interest Calculation Integrated with UNIBANCO –Unicre Banking System
▪ Developing and testing spark notebook (Python, Scala) to perform data Extraction, Transformation, Loading (ETL) ▪ Performing the data processing, migration and validation between Spark and SAS/ Control-M. ▪ Reviewing and validating my colleges notebooks and performing the testing, migration and GIT branching ▪ Data processing and migrating between the different environments (Development, QA, Production) ▪ Databases Create, Read, Update, Delete (CRUD) queries depending on the orchestration processes and Cycles. ▪ Creating and Repairing ETL Pipelines and Power Apps within the Azure Data Factory ▪ Performing and validating the data inputs and the Spark streaming batch processing workflow ▪ Training, supporting and reviewing the codes of my collogues and junior/new coming member. ▪ Data repairing and validation with the clients and defining/correcting any errors or mismatch. ▪ Validating and Testing python/ Scalanotebooks including Review, Bug Solving, and Documentation ▪ Assisting to build the ELT layer (Airflow) from internal and external systems into the data warehouse ▪ Problem-solving with large sets of complex data -making the data transparent and visible when curating/collecting ▪ DevelopingAPI’s/ Requests that synchronize multiple data sources ▪ Performing the Data storage and conversation into multiple outputs ensuring the ACID transactions
ACCENT IT/ ALGURAIR –United Arabs EmiratesJanuary 2019 - March 2020
Project: Integrating a Big Data Infrastructure (Client: LASTRAL Chemicals Group) ▪ Developing an orchestrated process to handle the workflow and data processing (Ansible/AWS/ Grafana) ▪ Validating the data flow from multiple inputs/ IOT and perform the industrialization processes ▪ Data migrating from VM Spring/ RDMS to Spark/ Microsoft Azure
Project: Creating a 360° Online Virtual Reality (VR) for Modular Building (Client: SMARTBOX Prefabrication) ▪ Developing new spark notebooks (Python, Scala) to perform the structuring of multiple technical data sets. ▪ Developing ETL pipelinesto handle the Model generation depending on the stock availability and technical specs
KRAIS Web Services SARL–FranceFebruary 2017 - January 2019
Project: Ecommerce Platform Deployed with Django, AWS and Spark (Client: GSA INV -Luxembourg) ▪ Integrating new price comparator in an online Ecommerce Web application (APIs, Python) ▪ Big Data mining, Structuring and Analysis for marketing purposes ▪ Create an Automatized processes for storing and validating data inputs into Hadoop File System (HDFS) Project: Multilanguage Logistic and Warehousing Management Platform (Client: HSDTransit-Belgium) ▪ Integrating and existing project with Amazon VPC, RDS and Terraform ▪ Deploying new Machines for multiple datacenters (Dockers, Kubernetes, Ansible)
Project: Search Engine Optimization and SERP Platform (Client: Almrsal Network –Jordan) ▪ Maintain an RDMS corrupted Databases and Migrate the data to Cassandra DB ▪ Implementing a frontend React JS Application with Mobile Synchronization capabilities. Project: Logistic tracking Platform and Realtime Data Monitoring (Client: Ali Ben Ali Hospitality -KSA) ▪ Implementing an online resources management platform (Python, Django, JS) ▪ Implementation an internal warehouse management platform (ERP, REST, Pytho
NoSQL, Oracle, HBase, MongoDB, PostGreSQL, Cassandra, MySQL
Data processing, API, Problem Solving, Grafana, Project Management
Talend, ETL, Informatica, Power BI, CONTROL-M, Tableau Software
As Pentalog’s Talent Sourcing branch, SkillValue relies on a pool of 400,000+ Tech & Marketing Specialists – including 15,000+ Freelancers, a comprehensive catalog of IT assessments, available projects and job opportunities. Our SkillValue consultants are always ready and willing to help you boost your career.
Stay in the know with Pentalog tech & business updates
WHAT WE'RE ABOUT
Pentalog is a digital services platform dedicated to helping companies access world-class software engineering and product talent. With a global workforce spanning more than 16 locations, our staffing solutions and digital services power client success.