> ## Documentation Index
> Fetch the complete documentation index at: https://docs.hadoseo.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Domain Settings

> Configure robots.txt, sitemap.xml, locale, and other domain settings

## Accessing Domain Settings

1. Go to your [Dashboard](https://hadoseo.com/dashboard)
2. Select the domain you want to configure
3. Click **Domain Settings** in the header menu

## Default Rendering Language

Configure the default language for prerendering. This affects how your content is rendered when bots don't specify a language preference.

### Why Set a Default Language?

Search engine bots don't always send language headers. If your app detects language from browser settings, bots may see:

* The wrong language version
* A language selection page instead of content
* Inconsistent content across crawls

### Configuration

1. Go to Domain Settings
2. Find **Default Rendering Language**
3. Select from 25+ supported locales

**Supported locales include:**

| Region          | Languages                                                                               |
| --------------- | --------------------------------------------------------------------------------------- |
| **Americas**    | English (US), Spanish, Portuguese (Brazil), French (Canada)                             |
| **Europe**      | English (UK), German, French, Spanish, Italian, Dutch, Polish, Swedish, Russian         |
| **Asia**        | Japanese, Chinese (Simplified/Traditional), Korean, Hindi, Thai, Vietnamese, Indonesian |
| **Middle East** | Arabic, Turkish, Hebrew                                                                 |

<Tip>
  If your app has URL-based language routing (e.g., `/en/`, `/ja/`), you may not need this setting. See the [troubleshooting guide](/guides/troubleshooting/wrong-language) for more details.
</Tip>

## Custom robots.txt

The `robots.txt` file tells search engines which pages to crawl and which to ignore.

<Info>
  Custom robots.txt configuration is available for **Base44** apps and other platforms that don't serve this file natively. A warning banner appears in your dashboard if configuration is needed.
</Info>

### Configuration

In Domain Settings, you can set a custom robots.txt:

```txt theme={null}
User-agent: *
Allow: /

# Block admin pages
Disallow: /admin/
Disallow: /api/

# Reference your sitemap
Sitemap: https://yourdomain.com/sitemap.xml
```

### Common Directives

| Directive          | Meaning                         |
| ------------------ | ------------------------------- |
| `User-agent: *`    | Rules apply to all bots         |
| `Allow: /`         | Allow crawling of all pages     |
| `Disallow: /path/` | Block crawling of specific path |
| `Sitemap: URL`     | Location of your sitemap        |

### Example: Basic robots.txt

```txt theme={null}
User-agent: *
Allow: /

Sitemap: https://yourdomain.com/sitemap.xml
```

### Example: With Restrictions

```txt theme={null}
User-agent: *
Allow: /
Disallow: /dashboard/
Disallow: /api/
Disallow: /admin/
Disallow: /private/

Sitemap: https://yourdomain.com/sitemap.xml
```

## Custom sitemap.xml

A sitemap helps search engines discover all your pages.

<Info>
  Custom sitemap.xml configuration is available for **Base44** apps. Real-time XML validation ensures your sitemap is properly formatted before saving.
</Info>

### Why Configure a Sitemap?

* **Discovery** - Ensures all pages are found
* **Priority** - Indicate important pages
* **Freshness** - Show when pages were updated
* **Faster indexing** - Search engines crawl more efficiently

### Configuration

In Domain Settings, paste your sitemap XML:

```xml theme={null}
<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
  <url>
    <loc>https://yourdomain.com/</loc>
    <lastmod>2024-01-15</lastmod>
    <changefreq>weekly</changefreq>
    <priority>1.0</priority>
  </url>
  <url>
    <loc>https://yourdomain.com/about</loc>
    <lastmod>2024-01-10</lastmod>
    <changefreq>monthly</changefreq>
    <priority>0.8</priority>
  </url>
</urlset>
```

The editor validates your XML in real-time and shows errors before you save.

### Sitemap Fields

| Field        | Required | Description                                     |
| ------------ | -------- | ----------------------------------------------- |
| `loc`        | Yes      | Full URL of the page                            |
| `lastmod`    | No       | Last modification date (YYYY-MM-DD)             |
| `changefreq` | No       | How often page changes (daily, weekly, monthly) |
| `priority`   | No       | Importance relative to other pages (0.0 to 1.0) |

### Priority Guidelines

| Priority | Use For                    |
| -------- | -------------------------- |
| 1.0      | Homepage                   |
| 0.8-0.9  | Key landing pages, pricing |
| 0.6-0.7  | Blog, about, contact       |
| 0.4-0.5  | Individual blog posts      |
| 0.1-0.3  | Legal pages, archives      |

<Card title="Dynamic Sitemaps" icon="sitemap" href="/guides/dynamic-sitemap-supabase">
  For dynamic content, generate sitemaps programmatically
</Card>

## Full Site Recrawl

Trigger a complete recrawl of all pages in your sitemap.

### When to Use

* Major site redesign
* Domain migration
* Widespread content updates
* After fixing site-wide SEO issues

### Limitations

* **Once per 30 days** - To prevent abuse and ensure system stability
* A cooldown timer shows when the next recrawl is available
* Requires active subscription and configured DNS

<Warning>
  For smaller updates, use **Batch Recrawl** in the Pages tab instead. This lets you recrawl specific pages without using your monthly full recrawl.
</Warning>

### How to Trigger

1. Go to Domain Settings
2. Find **Full Site Recrawl**
3. Click **Recrawl All Pages**
4. Confirm the action

The recrawl runs in the background. Check the Pages tab to monitor progress.

## Saving Changes

1. Edit the robots.txt, sitemap.xml, or locale settings
2. Click **Save Changes**
3. Changes take effect immediately
4. For robots.txt/sitemap changes, trigger a **Recrawl** to ensure bots see updated versions

## Verification

After configuring:

1. Visit `https://yourdomain.com/robots.txt` to verify
2. Visit `https://yourdomain.com/sitemap.xml` to verify
3. Submit sitemap to Google Search Console
4. Check for crawl errors in Search Console

## Domain Deletion

To remove a domain from Hado SEO:

1. Go to Domain Settings
2. Scroll to the **Danger Zone**
3. Click **Delete Domain**
4. Type the domain name to confirm
5. Click **Delete**

<Warning>
  Deleting a domain will:

  * Stop prerendering immediately
  * Remove all analytics data permanently
  * Require full reconfiguration to restore

  Make sure to update your DNS records to point elsewhere after deletion.
</Warning>

<CardGroup cols={2}>
  <Card title="Dashboard Overview" icon="gauge" href="/dashboard/overview">
    Return to dashboard overview
  </Card>

  <Card title="Routing Rules" icon="route" href="/dashboard/routing-rules">
    Set up redirects and proxies
  </Card>

  <Card title="SEO Optimization" icon="chart-line" href="/guides/seo-optimization">
    Learn SEO best practices
  </Card>

  <Card title="Troubleshooting" icon="wrench" href="/guides/troubleshooting/not-getting-indexed">
    Fix common SEO issues
  </Card>
</CardGroup>