AI Technical Consultant Global Enterprise Application Department

Job Description

Appealing Points

• Enterprise AI at scale: a direct opportunity to drive cutting-edge GenAI, agentic workflows and MCP architectures into production within a global enterprise environment
• High-impact strategic role: influence the broader AI architecture and roadmap while working directly with key business functions to shape high-value use cases
• Modern tech stack integration: bridge state-of-the-art AI tooling with robust enterprise systems (SAP S/4HANA, Salesforce, ServiceNow) in a collaborative digital division

Annual Salary: 8 Million Yen and above

Job Description

The Digital Division is seeking a permanent AI Consultant in Tokyo to design, build and operationalize AI-driven solutions across the enterprise landscape. Sitting at the intersection of applied AI (LLMs, agents, MCP, automation) and enterprise integration, this role partners with functional teams, developers and business stakeholders to identify AI use cases, prototype solutions, and deploy them into production in a secure, governed, enterprise-grade manner across the SAP S/4HANA ecosystem and surrounding third-party platforms.

Job Responsibilities

• Identify and prioritize AI use cases across core business functions, including Finance, Supply Chain, Sales, Marketing, HR and IT Ops
• Design and build AI agents and assistants using modern frameworks (e.g., LangChain/LangGraph, Claude Agent SDK, OpenAI Agents SDK)
• Implement and integrate Model Context Protocol (MCP) servers and tools to securely expose enterprise systems and data to LLM-based agents
• Design integrations connecting AI solutions with the core landscape (SAP S/4HANA, Salesforce, ServiceNow, SAP Solution Manager, MuleSoft, SAP PI/PO)
• Build RAG pipelines and knowledge assistants using enterprise data (documents, tickets, master data, transactional data)
• Establish standards and guardrails for enterprise AI: prompt management, evaluation, observability, cost control, data privacy and responsible AI
• Support MLOps / LLMOps, including model versioning, prompt/version control, monitoring and refresh cycles
• Coach and upskill internal teams (developers, functional consultants, power users) on AI tools and best practices, while contributing to the AI roadmap and architecture

Required Qualifications

• AI and GenAI: Strong hands-on experience with LLMs (Claude, GPT, Gemini); proven record building AI agents, multi-step tool-using workflows and RAG pipelines (vector databases, embeddings, chunking); practical experience with MCP or tool-calling frameworks; expertise in Python (mandatory), prompt engineering, evaluation and guardrails
• Enterprise integration: Strong understanding of enterprise integration patterns (connecting AI agents to SAP S/4HANA, Salesforce, ServiceNow, MuleSoft, etc.); hands-on experience with REST/SOAP APIs, OData, OAuth2, JWT, webhooks and API gateways; ability to design MCP-based connectivity across heterogeneous systems with structured and unstructured data
• Engineering and cloud: Cloud experience (Azure preferred, including Azure OpenAI / AI Foundry; AWS/GCP acceptable); proficiency with Docker, Git and CI/CD; awareness of security and compliance (PII handling, data residency, enterprise SSO, role-based access)
• Soft skills: Strong stakeholder management and structured problem-solving skills to move from vague business requests to production-ready prototypes
• Core Technical Must-Haves
  • Agentic AI & Workflow Automation: Practical experience building agents using modern frameworks (LangGraph, CrewAI, AutoGen), managing state execution, tool calling, Optimizing the context, and human-in-the-loop fallback loops.
  • SAP & Enterprise Integration: Deep integration knowledge using SAP BTP, OData/REST APIs, S/4HANA ERP data pipelines, Model Context Protocol (MCP), and direct automation using SAP Joule / Joule Studio Agentic AI.
  • End-to-End Process Streamlining: Demonstrate ability to engineer AI systems that automate and streamline complex enterprise business workflows.
• Detailed Technical Skills 
  • AI & Machine Learning Fundamentals: Understanding of data preparation, model training, evaluation metrics, and modern AI/ML concepts.
  • Generative AI Solutions: Experience with RAG, vector databases, prompt engineering, semantic search, and LLM-based applications.  
  • Agentic AI & Workflow Automation: Hands-on experience with frameworks such as LangGraph, CrewAI, or AutoGen, including multi-agent workflows, tool integration, and human approval processes.
  • SAP & Enterprise Integration: Knowledge of SAP BTP, APIs, S/4HANA integration, MCP, security controls, and automation using SAP Joule/Joule Studio.
  • AI System Architecture: Ability to design scalable AI solutions with monitoring, caching, fallback mechanisms, and cost optimization strategies.
  • Security & Governance: Understanding of data privacy, AI safety, compliance requirements, and responsible AI practices.  
  • Problem Solving & Collaboration: Strong communication skills, architectural decision-making, and experience working with business and technical stakeholders.

Preferred Qualifications

• Experience deploying and managing local/self-hosted LLMs (Llama, Mistral, Qwen via Ollama, vLLM, LM Studio, Hugging Face) for strict data residency scenarios
• Experience with SAP Joule, SAP Business AI, or SAP AI Core / AI Launchpad
• Experience with agent frameworks (LangGraph, CrewAI, AutoGen, Claude Agent SDK), voice/multimodal AI, or TypeScript / Node.js
• Prior experience in the retail, beauty or consumer goods industry
• Professional certifications such as Azure AI Engineer or SAP BTP

Language Required: Fluent level English, Japanese language skills are preferred.