gridprov The Inference Grid

Use this command to install gridprov:

winget install --id=TheInferenceGrid.gridprov -e

Gridprov is a command-line interface tool designed to facilitate provider operations for The Grid, enabling efficient GPU onboarding and cell management. This utility streamlines the process of integrating computational resources into The Inference Grid, ensuring seamless interaction between providers and the platform.

Key Features:

GPU Onboarding: Simplifies the integration of GPUs into The Grid's infrastructure.
Cell Management: Provides tools for managing and optimizing grid cells, enhancing operational efficiency.
Provider-Specific Commands: Offers tailored commands to support provider-specific tasks and workflows.

Audience & Benefit: Ideal for cloud service providers and data center operators seeking to contribute resources to The Grid. By using Gridprov, providers can efficiently manage their contributions, ensuring optimal performance and resource utilization within the grid ecosystem.

Gridprov can be installed via winget, making it accessible for integration into existing provider infrastructure.

The Grid CLI

Lab onboarding and model management CLI for The Inference Grid.

Install

Homebrew (macOS / Linux)

brew install The-AI-Grid/tap/grid

Download Binary

Download the latest release for your platform from Releases.

Debian / Ubuntu

curl -LO https://github.com/The-AI-Grid/grid-cli/releases/latest/download/grid-cli__linux_amd64.deb
sudo dpkg -i grid-cli_*.deb

Quick Start

# Authenticate
grid auth login --endpoint api.theinferencegrid.com:443 --api-key 

# Push a model
grid model push \
  --name my-model \
  --version 1 \
  --origin "r2://my-bucket/model.safetensors" \
  --sign-key lab-key.pem \
  --security-tier SEC0

# Check status
grid model status my-model --version 1

Provider CLI

The gridprov CLI is also available for provider operations:

brew install The-AI-Grid/tap/gridprov

License

Proprietary. See LICENSE for details.