[xrecnet] AI/ML Test Automation Engineer@ Location - Remote (Support in PST hours) - Independent consultants Required

AI/ML Test Automation Engineer

 Location - Remote (Support in PST hours) 
   Independent consultants Required – who can work for any employer

W2 requriement

10+ yrs required

$60-65/hr on c2c

Experience level: 10 + years
Must have skills: SDET skills, Azure devops, python, pytest test automation and Framework, AI ML practices, RAGAS, LLMs

Brief JD:

• Experience in designing LLM/RAG test automation solutions
• Experience in testing for bias, drift, and fairness.
• Familiarity with performance metrics (precision, recall, F1, ROC-AUC).
• Knowledge of MLflow MLOps framework 
• Knowledge of tools for synthetic data generation and boundary testing
• Knowledge of Azure DevOps for CI/CD pipeline development
• Experience in RAG/pipeline evaluation frameworks - 
• pytest: Test automation framework
• DeepEval or TruLens: LLM test assertions
• RAGAS: RAG-specific metrics
• Eleuther: LLM evaluation harness
• Garak or Promptfoo: LLM red-teaming
• Evidently: Drift/performance monitoring
• Exposure to explainability frameworks (SHAP, LIME, Captum)

• Handson experience in API and Database testing.
• Practical knowledge of Databricks, Azure Cloud services land distributed data validation.
• Proficiency with Azure DevOps pipelines YAML templates, agent pools, CICD workflows.
• Experience in implementing AIML practices in testing e.g., test generation, anomaly detection, log analysis to improve test efficiency and coverage.
• Familiarity with Cucumber (BDD) and test reporting frameworks (e.g., Allure).
• Strong understanding of integration testing across Databricks streaming jobs, applications and microservices.
• Experience with performance testing tools (JMeter, LoadRunner, or equivalent).
• Experience with Pester framework for validating PowerShell scripts and infrastructure automation.
• Solid understanding of Agile/Scrum methodology and handson usage of JIRA.
• Excellent problem-solving, debugging, and communication skills, with the ability to advise development teams on testing best practices.
 

 1638018BR

Regards

Pavan

VDart Inc

Ph: (470) 251-2584 Ext:1866

Email: Pavankumar.s@vdartinc.com

Website: https://vdart.com

 

 

 

Confidentiality Notice

 

The information contained in this message may be privileged and confidential and protected from disclosure. If the reader of this message is not the intended recipient, or an employee or agent responsible for delivering this message to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this communication in error, please notify us immediately by replying to the message and deleting it from your computer.

 

 

--
You received this message because you are subscribed to the Google Groups "Xrecnet IT Recruiters Network - Corp to Corp IT Jobs & Hotlists" group.
To unsubscribe from this group and stop receiving emails from it, send an email to xrecnet+unsubscribe@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/xrecnet/CAGf9M09X2AXVRz4VZ0qBjqxSrmFQB2eor2O0Z0Skjsg-J8HhYQ%40mail.gmail.com.