> ## Documentation Index
> Fetch the complete documentation index at: https://docs.chatref.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Training with Websites

> Paste a URL and let Chatref crawl your site to train your bot on its content.

If the answers are already on your website, this is the fastest way to train
your bot. Paste a URL and Chatref crawls every page on that domain and learns
the text. Want just one page? Paste that specific page's URL instead.

<Note>
  Your website is already crawled once for you during signup, when you enter it on
  the **"What's your website?"** screen. You only need to add a site here if you
  want to train on another one – or crawl the same site again after big changes.
</Note>

## How to crawl a website

<Steps>
  <Step title="Open the Sources tab">
    Open your agent and go to the **Sources** tab.
  </Step>

  <Step title="Choose Crawl Website">
    From the add menu, pick **Crawl Website**.
  </Step>

  <Step title="Paste your URL">
    Enter the address you want to learn from. It must start with `http://` or
    `https://` – for example, `https://example.com`. A homepage URL crawls the
    whole domain; a deep link like `https://example.com/pricing` crawls just
    that page.
  </Step>

  <Step title="Queue and train">
    Submit it. The source is queued and a background worker reads each page.
    Watch the status until it shows **Trained**.
  </Step>
</Steps>

## When to use it

Website training is best when your site already has the answers:

* **A SaaS app** – crawl your docs, pricing, and feature pages so the bot can
  explain how the product works.
* **A dental clinic** – crawl your services and hours pages so visitors get
  details without calling.
* **A travel agency** – crawl your destination and FAQ pages in one go.

<Tip>
  Start with your homepage URL to capture the whole site at once. If you only want
  the bot to learn one thing – say, a single policy page – paste that page's exact
  URL instead.
</Tip>

## Next steps

<CardGroup cols={2}>
  <Card title="Add files" icon="file" href="/knowledge-base/training-with-files">
    Upload documents your website doesn't cover.
  </Card>

  <Card title="Add text" icon="text" href="/knowledge-base/training-with-text">
    Paste an answer that isn't on your site yet.
  </Card>

  <Card title="Track training" icon="bolt" href="/knowledge-base/training-status">
    See when the crawl finishes and retry if it fails.
  </Card>

  <Card title="Test your bot" icon="robot" href="/agents/playground">
    Ask your bot a question in the Playground.
  </Card>
</CardGroup>
