[xrecnet] DataBricks Admin /// Initial Remote

DataBricks Admin

Initial Remote

12 Months

 

The JD is as follows :

 

Create Databricks workspace and assigned the user access using SCIM API

Estimate the cluster size, monitoring and troubleshooting of the Spark DataBricks cluster.

Create All purpose and Job clusters for respective job in lower lanes and production environments. 

Define cluster policies which can be used for setting up the cluster

Creating pipelines, data flows and complex data transformations and manipulations using Pyspark with Databricks.

Create, provision multiple Databricks clusters needed for batch and continuous streaming data processing and installed the required libraries for the clusters.

Create custom scripts for deploying the Databricks jobs from lower lanes to Production environment with appropriate tags.

Upgrade the Databricks runtime version for jobs

Develop Azure Databricks notebooks to apply the business transformations and perform data cleansing operations.

AWS Databricks experience

 

Regards,

 
Satya
Technical Recruiter

Key Business Solutions, Inc|| Office: 916 646 2080 Ext 216 || Fax: 916 646 2081 || Email: satya@keybusinessglobal.com || Website: www.key-soft.com || Yahoo IM/G Talk: satyakeysoft 

Notice: This email is not intended to be a solicitation.  Please accept our apologies and reply in the subject heading with REMOVE to be removed from our Mailing list. Thank You.

 

--
You received this message because you are subscribed to the Google Groups "Xrecnet IT Recruiters Network - Corp to Corp IT Jobs & Hotlists" group.
To unsubscribe from this group and stop receiving emails from it, send an email to xrecnet+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/xrecnet/CAAd%3DnqevYwG-vsspJmrNuzMvyymin%3DtqfC4XEuLSh2BYL8t-ag%40mail.gmail.com.