Technology Internal Audit Lead

What you'll do

• Plan and execute technology audits and complex control assessments, including for LLM-powered products, information security, infrastructure, and privacy.
• Use data analytics to identify risks and review AI/ML controls covering data quality, privacy, security, safety testing, evaluation, and output monitoring.
• Develop risk-based recommendations, partner with engineering and product teams, and ensure audit quality and process improvement.

What they ask for

• Strong understanding of security fundamentals across cyber domains, including IAM, data security, application security, network security, and vulnerability management.
• Ability to assess complex technology environments against risks, best practices, internal standards, and regulatory requirements.
• Strong problem-solving, critical-thinking, collaboration, and communication skills, including the ability to provide technical challenge.

Nice to have

• Understanding of LLMs, ML pipelines, model lifecycle management, and data engineering architectures.
• Experience with technologies or credentials such as PyTorch, TensorFlow, HuggingFace, AWS, Azure, GCP, CISSP, CISA, or CIA.

Tools

LLMs, PyTorch, TensorFlow, HuggingFace, GitHub, Bitbucket, AWS, Azure

AI focus

Audits AI/ML architectures and controls, including data flows, training and fine-tuning, model serving, safety testing, hallucination mitigation, evaluation metrics, red-teaming, and output monitoring; uses analytics to identify model risks.