➢ Experience in data warehouse environment, which includes developing ETL/ELT pipelines, database designs, writing SQL transformation logic.
➢ Strong hands-on experience with Microsoft Azure Data & Analytics PaaS Services, including Azure Synapse, Azure Data Factory, Azure Data Lake Storage and other services within the Azure data analytics framework.
➢ Deep knowledge or expert level experience in Databricks. ➢ Works with Architects, Technical Leads and Business Teams and contributes to the development of technical designs.
➢ Secure data migrations & transformations to/from clients, customers, and vendors.
➢ Develops, constructs, tests, and maintains Azure Data factory flows/pipelines
➢ Working experience on PySpark, Spark SQL, Serverless SQL pool, Dedicated SQL pools
➢ Strong knowledge of various data structures and the ability to extract data from various data sources (such as Cognos, Informatica, Hyperion, etc.).
➢ Expose data to end users for consumption such as Power BI or other data integration sources ensuring that the proper security permissions are in place.
➢ Experience in writing complex SQL queries and creating data models. ➢ Proven experience performing large data migration and transformation efforts would be helpful Excellent Analytical skill to analyze the issues and ability to backtrack them until root cause
➢ Design, implement, and continuously expand ETL pipelines by performing extraction, transformation, and loading activities
➢ Candidate should be aware of Release management, Change management, CI/CD pipelines
Microsoft Azure Data & Analytics PaaSServices, including Azure Synapse, Azure Data Factory, Azure Data LakeStorage PySpark, Spark SQL, Serverless SQL pool, Databricks . ETL