AI/ML Inference - TAHO

Inference Capabilities

TAHO supports Large Language Models (LLMs), ONNX Runtime integration, Stable Diffusion for image generation, and custom model support.

Model Management

Models can be loaded from content exchange with caching and optimization, resource allocation for inference, and multi-model orchestration.

Inference Workflows

TAHO supports single-node inference, distributed inference across The Mesh, and batching and optimization strategies.

Getting Started with the CLILearn the TAHO command-line interface basics

⌘I