Skill: VAST.ai GPU Rental
Overview
This skill allows you to provision on-demand GPU infrastructure. You must have a user-provided API Key before performing write actions.
Capabilities
- •Search: Find machines by GPU model (e.g., "RTX 4090") and max hourly price.
- •Rent: Instantiate a container (default: PyTorch) on a specific Offer ID.
- •Connect: Retrieve the SSH connection string for an active instance.
- •Balance: Check available credit and current hourly burn rate across all active machines.
Usage Protocol
- •Step 1: Ask the user for their VAST API Key if not already in context.
- •Pre-flight Check: Before renting, call
balanceto ensure the user has sufficient funds. - •Step 2: Search for offers and present the top 3 cheapest options to the user.
- •Step 3: Upon confirmation, call
rent. - •Reporting: If credit is below $5.00, warn the user after every successful rental.
- •Step 4: Wait 30-60 seconds, then call
connectto provide the SSH string.
Tool Definitions
- •
search(gpu: string, price: number) - •
rent(id: number, image: string) - •
connect(id: number) - •
balance()
Execution
Run the CLI wrapper for these tools.
Command: node /Users/sschepis/Development/vast-ai/dist/cli.js <action> [params]
Env: VAST_API_KEY must be set.
Examples
- •Search:
node dist/cli.js search --gpu "RTX 4090" --price 0.5 - •Rent:
node dist/cli.js rent --id 12345 --image "pytorch/pytorch" - •Connect:
node dist/cli.js connect --id 12345 - •Balance:
node dist/cli.js balance