Wednesday, June 23, 2021

[xrecnet] Sr Hadoop Admin - Architect ( CDH - HDP - CDP ) - Remote - Multiple Roles

 

 

 

Hi

 

This is Aravind, - Recruitment Team from MSR Cosmos

We have an urgent requirement as follows:

Please respond with resumes in MS-Word Format with the following details to 
aravind@msrcosmos.com

Full Name :
Location :

Relocation :
Contact Number :
Email

Skype Id :

Last 4 digit SSNO :
Availability for project :

Availability for Interviews :
Visa Status and Validity :

D O B :

Years of Exp :

 

Requirement Details

 

Requirement 1

 

Sr Hadoop Admin – Architect ( CDP )

Remote

We have an urgent request for an SSA role with a customer on specific dates, 

 

Dates: 21st June, 12th July, 26th July

Duration: 15

Scope:

Platform & Development

CDP Private Cloud Plus Cluster Health Check / Tuning / Optimization

This is an SSA who will possibly assist on new CDP and DR installation and security, but also needs to do Use Case Review and Optimization, and provide Advisory and Coaching services to the client. Needs to have deep knowledge and confident leadership and guidance.

1.0 Expert Services
For this engagement, Cloudera will assist Customer with the
following tasks:
CDP SmartDeploy
1. Planning
a. Review Prerequisites
b. Review Requirements
c. De lo ment Architecture
i. Brings thought leadership to design enterprise-wide Hadoop blueprint

j. Provides hands-on SME assistance with platform architecture and use case implementation 

 

Requirement 2

 

Sr Hadoop Admin – Architect ( CDH- CDP )

Remote

We have an urgent request for an SSA role with a customer on specific dates,   

 

Dates: 21st June, 12th July, 26th Jul, 9th August (Two further weeks TBC)

Duration: 30 Days

Scope:

Platform

CDP Private Cloud Plus Install

Disaster Recovery

Health check + CDP install + DR Implementation

This is an SA who will do a CDH health check, install CDP and all relevant security services, and design and install DR. 

1.0 Expert Services
For this engagement, Cloudera will assist Customer with the
following tasks:
CDP SmartDeploy
1. Planning
a. Review Prerequisites
b. Review Requirements
c. De lo ment Architecture
i. Brings thought leadership to design enterprise-wide Hadoop blueprint
j. Provides hands-on SME assistance with platform architecture and use case implementation

 

Requirement 3

 

Sr Hadoop Admin – Architect ( HDP to CDP Upgrade )

We have a short term project that is looking for support before the end of June, can you please review the scope below

 

Strat date: 21st June

Duration: 10 Days

Scope

Upgrade HDP
Task #
Task Description
1.0
Assessment / Planning for HDP to CDP Upgrade
Review current configuration (HDP 2.6.5) in the cluster and compose an upgrade plan to CDP 7.1.x (or recommended 7.x version prescribed by Solutions Architect), as per Cloudera standard format.
Assess the following to prepare for the upgrade:
Component differences
Infrastructure & data platform
Data storage and Applications
Security and Governance
Operation processes and skills
Workload and consumption
Performance and SLAs
Documentation status
Known issues
2.0
Cluster Upgrade; assist Customer with the following for Prod environment
Cluster backup
Replace Ambari with Cloudera Manager
Upgrade HDP to CDP
Cluster optimizations and testing
3.0
Post Upgrade Planning; assist Customer with the following:
Jointly update documentation
Provide knowledge transfer

 

Requirement 5

 

Sr Hadoop Admin – Architect ( CDH to CDP upgrade )

Start date: 28th June/July

Duration: 80 Days

Scope

CDP Private Cloud Base Cluster Health Check / Tuning / Optimization

CDH to CDP Migration / Upgrade Assistance

Direct interaction with the lead architect on designing CDP Clusters

•On-Site Support
o Tactical support for hard-to-solve configuration, behavioral and operational issues
o Application support for (visible) code bases/queries with issues
•DAP Architectural Consulting
o New/existing use case development/enhancement
o New access/usage patterns
o Production rollout for erasure code enabled active/active cluster
o Re-architecture of Impala Coordinator deployment
o Yarn / Impala resource scheduler provisioning and monitoring
o Review and update of new and existing best practice guidance
•Next-gen Architecture
o In-depth consulting on BofA's next-gen roadmap to include technology integration, cluster architecture and design, etc.
o CDP provisioning and associated migration strategies
•Automation
o Extend/augment existing automation of monitoring
o Extend/augment deployment automation for cluster installation and upgrades
o Advise on development of automation of testing

 

Requirement Details

 

Role: Two Solution Architect

Start date: 26th July

Duration: 65 Days

Scope

Data Architects: Responsible for the data migration from the legacy HDP to CDP, refines automation for such and ensures data integrity.

Migration HDP to CDP Private Cloud Base

1. Pilot CDP PvC base with Object Store and CDP PvC Plus experiences
● Set up Pilot environment including setting up & securing CDP PvC Base services,
● Integrate with Object Store
● Benchmark HDFS & Object Store Functionality
● Validate HDFS & Object Store Functionality
● Install & configure CDP Private Cloud Experience (CDW, CDE, CML)
● Deliver POC Results to Executives

2. Pre-Migration Phase
● Define and discuss Prerequisites for CDP including CDP Licenses, hardware install, network and other configuration, resource onboarding, obtaining application lists,
● Review and finalise current and target state architecture diagrams, reviewing compatibility of 3rd Party tools requirements
● Conduct discovery and review sessions related to application repositories, codebases, Data profiles & volumes, Platform & Infrastructure, as well as identify need for any component upgrades, Data Governance, Security requirements, Audit Review and Operations activities and processes
○ Review Cluster architecture design, components design, configuration, jobs and clients
○ Review implemented use cases and data processing pipelines including Ingest/ETL/Consumption
○ Review YARN queues/resource utilization, HIVE, Spark, and other HDP services implementations
○ Review current HDP Security implementation and implement necessary changes
○ Review Cluster operation challenges including frequently occurring issues and SLAs
○ Review team's daily operational activities, organization alignments and workload allocations
○ Review production/operations best practices including alerts, processes and applicable automations
○ Gain common understanding of specific known issues (if any) around Cluster implementation
○ Jointly troubleshoot to identify root cause(s) of known issues and recommend resolutions
● Create assessment summary document, recommended optimizations with priorities
● Document future state CDP PvC Base solution including guidance for application refactoring
● Planning the migration to Cloudera Data Platform Private Cloud Base (CDP PvC Base)
● Conduct Data Pre-migration activities including:
○ Identify Representative Data Lake schema
○ Customizing scripts for schema migration, schema validation, data migration, and data validation
● Representative Applications code change and validate
○ PySpark (1.6/2.x)
○ Scala (1.6/2.x)
○ SparklyR (1.6/2.x)
○ Hive
○ Sqoop
○ Nifi
● 3rd Party Integration, requisite code changes and validation
○ R/Rstudio
○ Zeppelin
○ Diyotta
○ Datameer
○ Edge Nodes
○ Talend
○ DataStage
○ NextPathway
○ Collibra
○ Storage Object
● Security Pre-Migration - Customize scripts for migrating Ranger, Atlas, Users, Roles
● Jointly create application testing plan and identify all customer resources
● Resolve all knows cluster issues before migration start to bring all services to green state
● Review Cluster and Integration architecture with Enterprise Services
● Create Cluster architecture design, components design, configurations, jobs and clients
● Develop end-to-end CDP PvC Base Migration plan including the pre-requisites, remote access, infrastructure required and gain concurrence with customer
● Documentation and knowledge transfer of the steps and activities - develop Runbook/Method of Procedures (MOPS)

 

 

 

 

 

 

Stay Safe

 

Thanks & Regards, 

Aravind
MSR COSMOS

6200 Stoneridge Mall Rd, Ste 300, Pleasanton, CA - 94588

Desk : 925 399 7145

Textnow : 732 574 5974

Fax : 925-219-0934

Email aravind@msrcosmos.com   
URLhttp://www.msrcosmos.com

https://media.licdn.com/mpr/mpr/shrink_200_200/AAMAAgDGAAoAAQAAAAAAAA75AAAAJGQ0MTUxMjliLWVhN2YtNDM1Zi05YzkxLTFhZWE1NjcyYTlkYQ.png

-          Microsoft Gold Partner

-          SAP Silver Partner

-          Oracle Gold Partner

-          Hortonworks Silver Partner

-          Cloudera Silver Partner

-          E-Verified

-          WBE Certified

 

 

Note: This email is not intended to be a solicitation.  Please accept our apologies and reply in the subject heading with REMOVE to be removed from our Mailing list.

 

Any information and documentations including Govt issued ID or government issued documents if forged, manipulated or Falsified is considered as a felony as per US laws Such actions are a punishable offense and can lead to Criminal Investigation or Indictment

 

Confidentiality Notice: 

Unless otherwise indicated, email transmission is not a secure form of communication and your reply may not be encrypted. The information contained in this message is proprietary and/or confidential. If you are not the intended recipient, please: (i) delete the message and all copies; (ii) do not disclose, distribute or use the message in any manner; and (iii) notify the sender immediately.

 

--
You received this message because you are subscribed to the Google Groups "Xrecnet IT Recruiters Network - Corp to Corp IT Jobs & Hotlists" group.
To unsubscribe from this group and stop receiving emails from it, send an email to xrecnet+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/xrecnet/CAMSx0H1EtzZC--9%3DoTGZD3wvhr57V8AL4ZR%3DzOhVUokQL0Z1nQ%40mail.gmail.com.

No comments:

Post a Comment