---
title: "meta-externalagent: block or allow this AI crawler · DotsAgent"
description: "meta-externalagent is run by Meta and listed under training. Its robots.txt token, whether it follows the rules, its IP list and how to control it."
url: https://dotsagent.io/agent-ready/bots/meta-externalagent
---

Meta · Training

# What is meta-externalagent?

Meta's crawler for training AI models and for indexing. It follows robots.txt.

- **robots.txt token**: `meta-externalagent`
- **Operator**: Meta
- **Purpose**: Training
- **Obeys robots.txt**: The operator says it follows robots.txt.
- **Documented by operator**: Yes, on the operator's own pages.
- **Documentation**: [developers.facebook.com](https://developers.facebook.com/docs/sharing/webmasters/web-crawlers/)

One token covers both uses, so blocking it for training also stops the indexing, and Meta publishes no IP ranges.

## Block meta-externalagent from your whole site

`robots.txt`

```
User-agent: meta-externalagent
Disallow: /
```

## Allow it, but keep private paths out

`robots.txt`

```
User-agent: meta-externalagent
Allow: /
Disallow: /admin/
```

## Other bots from Meta

[meta-webindexer](https://dotsagent.io/agent-ready/bots/meta-webindexer)

[meta-externalfetcher](https://dotsagent.io/agent-ready/bots/meta-externalfetcher)

[meta-externalads](https://dotsagent.io/agent-ready/bots/meta-externalads)

[facebookexternalhit](https://dotsagent.io/agent-ready/bots/facebookexternalhit)

[Muse](https://dotsagent.io/agent-ready/bots/muse)

[Add it to a robots.txt in the generator →](https://dotsagent.io/agent-ready/robots-txt)

## Sources

1. [developers.facebook.com](https://developers.facebook.com/docs/sharing/webmasters/web-crawlers/)/docs/sharing/webmasters/web-crawlers/

Independent reference for people who build AI agents. Not affiliated with any vendor named here.

© 2026 DotsAgent · Facts checked October 1, 2026