[xrecnet] Urgent Req||Azure Data Engineer||Dallas, TX and Atlanta, GA

Please share resume to anurag.trivedi@vlinkinfo.com

 

Role: Azure Data Engineer

Location: Dallas, TX and Atlanta, GA

Duration: 12+ Months

 

Job Description:

Our Client is looking for data engineer experience developing and deploying applications on Microsoft Azure Databricks platform. This individual should be self-motivated to drive solutions and proactively create (in sufficient detail) the documentation required to support and describe technical solutions. The candidate will work with cloud architects to establish pipeline to Azure data stores using either NiFi or Data Bricks. Will build templates for engineering processes in cloud. NiFi experience preferred.

 

Responsibilities

• The data engineer will be responsible for development, deployment, maintenance, diagnostics and support of spark ETL jobs on the MS Databricks platform.
• Will streamline code, rationalize datasets and tables to arrive at single source of truth
• Will build detailed architecture diagrams or Entity Relationship Diagrams for all workflows and processes

 

Required Qualifications:

• 3 years of hands on experience with cloud automation and scripting in an Azure environment.
• Experience in development of apache Spark code using PySpark or Scala
• Experience in using Azure Databricks Platform
• Experience in using Azure Data Factory to call Azure Databricks notebook activities
• Experience in using Git based repositories
• Good fundamental knowledge about distributed computing, RDBMS and Dimensional modeling concepts
• Exposure to Azure DevOps
• Exposure to Azure Storage (Blob/Data Lake Store), Azure Catalog, Databricks Delta

Thanks & Regards,

 Anurag Trivedi

--
You received this message because you are subscribed to the Google Groups "Xrecnet IT Recruiters Network - Corp to Corp IT Jobs & Hotlists" group.
To unsubscribe from this group and stop receiving emails from it, send an email to xrecnet+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/xrecnet/CAJUuxZ1Wuzca8eeuyUc9LeuKidfzb%2B6Q117V3gd1tya3g9fK8A%40mail.gmail.com.