Yotta Labs
  • COMPANY
    • About
    • Mission
    • FAQs
  • PRODUCTS
    • Quickstart
    • GPU Instances
    • AI Explorer
      • Text Generation
      • Image Generation
      • Audio Generation
      • Pricing
    • Inference
      • Introduction
      • User Interface
      • Broker Node
      • GPU Worker
        • Quickstart
        • Core Concept
        • Troubleshoot
        • Supported Devices
        • FAQs
      • Pricing
    • Fine-Tune
    • Billing
  • Technology
    • Parallelism Strategies
    • Decentralized Scheduling
    • Memory Optimization
    • Proactive Communication
    • Fault Tolerance
    • Computation Validation
    • White Paper
  • TOKENOMICS
    • Overview
    • Payment & Fee
    • Staking
    • GPU Incentive
    • Community
    • Governance
Powered by GitBook
On this page
  • Install the CLI
  • Authentication
  • Uploading Data
  • Start Fine-Tuning Job
  • Monitor Jobs
  • Other Useful CLI Commands
  • Pricing

Was this helpful?

  1. PRODUCTS

Fine-Tune

In the following guide, we'll learn how to use the Yotta AI fine-tuning CLI tool to fine-tune a Llama 3 7B model on a testing dataset.

Install the CLI

To get started, install the Yotta Python CLI:

pip install --upgrade yotta

Authentication

The API Key can be configured via setting the YOTTA_API_KEY environment variable by running the following command:

export YOTTA_API_KEY=xxxxx

Uploading Data

To upload your data, run the following command. Remember to replace PATH_TO_DATA_FILE with the path to your dataset.

yotta files upload {PATH_TO_DATA_FILE}

Start Fine-Tuning Job

You now can start the fine-tuning job based on your training file and model. The command line is:

yotta fine-tuning start --training-file {FILE_ID} --model {MODEL_NAME} --wandb-api-key {WANDB_API_KEY}

Monitor Jobs

You can use the following command line to get the progress of a job:

yotta fine-tuning list-events {FINE-TUNING_ID}

Other Useful CLI Commands

# list all available commands
yotta --help

# check which models are available.
yotta models list

# check your jsonl file
yotta files check test.jsonl

# upload your jsonl file
yotta files upload test.jsonl

# list your uploaded files
yotta files list

# retrieve progress updates about the finetune job
yotta fine-tuning retrieve ft-01b7df2b-122a-4b84-9838-4d84200dc7ac

# download your fine-tuned model using the uuid of your fine-tuning job
yotta fine-tuning download ft-01b7df2b-122a-4b84-9838-4d84200dc7ac 

Pricing

PreviousPricingNextBilling

Last updated 2 months ago

Was this helpful?