AI Consultant — LLM Architecture - 2-Month Mission at 40% Extendable

About the job

Mission Context

The bank has a language model (LLM) already operational on its internal infrastructure. It is seeking an AI consultant to assess the current state, define the target architecture, and implement the necessary changes to secure it and make it available within the bank.

The mission combines consulting, architecture, and implementation, in collaboration with internal teams and the offshore IT team based in Asia.

Responsibilities

• Conduct an assessment of the model, the on-premise infrastructure, and the current access and usage methods.
• Identify risks, technical gaps, and security needs.
• Define an architecture suited to the requirements of the banking information system: integration, access control, data protection, traceability, and supervision.
• Develop a prioritised roadmap for making the LLM available to internal users and applications.
• Implement the agreed changes and support their integration into the IS.
• Coordinate work with the offshore IT team in Asia and the bank’s infrastructure and security contacts.
• Document the solution and ensure knowledge transfer to the teams responsible for its operation.

Desired Profile

• Practical experience in deploying and operating AI solutions, notably LLMs, on on-premise infrastructures.
• Skills in architecture and integration of AI solutions into existing information systems.
• Strong knowledge of IS security: authentication, authorisations, network security, data protection, and logging.
• Ability to work on consulting, architectural choices, and technical implementation.
• Experience collaborating with international or offshore IT teams.
• Professional English enabling communication with the team based in Asia.
• Experience in a banking environment or a sector with high security requirements is an advantage.

Expected Deliverables

• Technical and security assessment of the existing solution.
• Architecture recommendations and prioritised action plan.
• Implementation of agreed changes to secure and make the model accessible internally.
• Technical documentation and operational instructions.