Alauda AI

Install TrustyAI

This document describes how to install TrustyAI operator.

TOC

Upload OperatorInstall OperatorNext steps

Upload Operator

Download the TrustyAI operator installation file (e.g., trustyai-service-operator.alpha.ALL.xxxx.tgz).

Use the violet command to publish to the platform repository:

violet push --platform-address=platform-access-address --platform-username=platform-admin --platform-password=platform-admin-password trustyai-service-operator.alpha.ALL.xxxx.tgz

Install Operator

  1. Go to the Administrator view in the Alauda Container Platform.

  2. In the left navigation, select Marketplace / Operator Hub.

  3. In the right panel, find Alauda Build of TrustyAI and click Install.

  4. Keep all parameters as default and complete the installation.

Next steps

After the operator is installed, users can use CRDs such as TrustyAIService, LMEvalJob, GuardrailsOrchestrator, and NemoGuardrails to deploy inference monitoring (TrustyAI Service), run model evaluation tasks, and manage AI guardrails orchestration (both FMS Guardrails and NeMo Guardrails).

See TrustyAI Service (TAS), Evaluate LLM, AI Guardrails for LLM safety, and NeMo Guardrails for details.