[xrecnet] AWS Big Data Engineer (12+ years)/// (Onsite role) //// New York, NY

 

AWS Big Data Engineer (12+ years)/// (Onsite role)

New York, NY

12 Months

 

Job Description:

 

We are looking for AWS Big Data Platform Engineers who are passionate about resolving the challenges of building robust and scalable data systems aligned to enterprise data strategy.

 

As Senior Data Platform Engineer you will be part of a team that leads the design and implementation of data platform to support the strategic data needs & support enterprise reporting needs including datamarts, reporting and business intelligence. You will build data capabilities and support a wide range of data flows and usecases to advance the data-driven investment decisioning and deliver transformational programs. 

 

Required skills:

 

Experience with AWS Data & Analytics, Cloud data platforms, data warehouse, data lakes and analytics products

Experience with batch job scheduling, leveraging Apache Airflow, AWS EMR (Multi Tenant ), PySpark, YARN, EKS, S3, HDFS, AWS Athena, AWS Glue, Lakeformation, AWS Step Functions, DMS

Experience building data tools using spark , performance tuning , AQE, Spark Listener Events,

Experience in data architecture and familiarity with ETL tools, data warehousing & big data architecture.

Knowledge of cloud-native approaches to build fast, flexible, and cost-effective data applications on any data lake, open-source column oriented DBMS and/or big data OLAP engines for analytical processing (Apache Pinot, Apache Hudi, Iceberg etc.)

 

Good to Have:

 

Experience with DataOps and various continuous delivery practices to deploy, support and operate data pipelines ( terraform , terragrunt)

Interests in the financial industry. 

Note- this is a Platform Data Engineer role. Strong experience in below data skills but good experience in devops.

JD- Required skills – Cloud Devops, python, Big Data Admin exp on AWS , AWS lake formation ( lake house vs Data fabric ), Data Product concepts, spark jobs auditing, monitoring and Instrumentation, spark perf tuning,  exp in creating service and tools to manage multi tenant env,  

Tech stack ( Must )– terraform,  knowledge of spark internals ( spark 3+ features ) – architecture, events, system metrices , AQE, job level resource management, Hudi, Parquet , IAM, AWS Glue, HIVE 

Good to have - Iceberg,  airflow, terragrunt, dynamo DB,,

 

Regards,

 
Satya
Technical Recruiter

Key Business Solutions, Inc|| Office: 916 646 2080 Ext 216 || Fax: 916 646 2081 || Email: satya@keybusinessglobal.com || Website: www.key-soft.com || Yahoo IM/G Talk: satyakeysoft 

Notice: This email is not intended to be a solicitation.  Please accept our apologies and reply in the subject heading with REMOVE to be removed from our Mailing list. Thank You.

 

--
You received this message because you are subscribed to the Google Groups "Xrecnet IT Recruiters Network - Corp to Corp IT Jobs & Hotlists" group.
To unsubscribe from this group and stop receiving emails from it, send an email to xrecnet+unsubscribe@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/xrecnet/CAAd%3DnqfFqjVCF3Fsmr2BzH-k6iXygDVC39RXJ9-r3EvhBdQrJw%40mail.gmail.com.