---
title: "facebookexternalhit: block or allow this AI crawler · DotsAgent"
description: "facebookexternalhit is run by Meta and listed under user fetches. Its robots.txt token, whether it follows the rules, its IP list and how to control it."
url: https://dotsagent.io/agent-ready/bots/facebookexternalhit
---

Meta · User fetches

# What is facebookexternalhit?

Fetches pages to build link previews when someone shares a URL in Meta's apps.

- **robots.txt token**: `facebookexternalhit`
- **Operator**: Meta
- **Purpose**: User fetches
- **Obeys robots.txt**: The operator says robots.txt may not apply, or community reports say it ignores it.
- **Documented by operator**: Yes, on the operator's own pages.
- **Documentation**: [developers.facebook.com](https://developers.facebook.com/docs/sharing/webmasters/web-crawlers/)

Meta says it may bypass robots.txt for integrity and security checks.

## Block facebookexternalhit from your whole site

`robots.txt`

```
User-agent: facebookexternalhit
Disallow: /
```

## Allow it, but keep private paths out

`robots.txt`

```
User-agent: facebookexternalhit
Allow: /
Disallow: /admin/
```

This bot fetches pages for a person, or for an agent acting on one's behalf. Several operators say robots.txt may not apply to such requests, so check the line above and enforce at your firewall if it matters.

## Other bots from Meta

[meta-externalagent](https://dotsagent.io/agent-ready/bots/meta-externalagent)

[meta-webindexer](https://dotsagent.io/agent-ready/bots/meta-webindexer)

[meta-externalfetcher](https://dotsagent.io/agent-ready/bots/meta-externalfetcher)

[meta-externalads](https://dotsagent.io/agent-ready/bots/meta-externalads)

[Muse](https://dotsagent.io/agent-ready/bots/muse)

[Add it to a robots.txt in the generator →](https://dotsagent.io/agent-ready/robots-txt)

## Sources

1. [developers.facebook.com](https://developers.facebook.com/docs/sharing/webmasters/web-crawlers/)/docs/sharing/webmasters/web-crawlers/

Independent reference for people who build AI agents. Not affiliated with any vendor named here.

© 2026 DotsAgent · Facts checked October 1, 2026