ByteDance · Training
What is Bytespider?
ByteDance's crawler, listed for training in community registries. ByteDance has no official page for it.
- robots.txt token
Bytespider- Operator
- ByteDance
- Purpose
- Training
- Obeys robots.txt
- No The operator says robots.txt may not apply, or community reports say it ignores it.
- Documented by operator
- No. The token is known only from community lists such as ai.robots.txt.
Community reports say it does not respect robots.txt.
Block Bytespider from your whole site
User-agent: Bytespider
Disallow: /
Allow it, but keep private paths out
User-agent: Bytespider
Allow: /
Disallow: /admin/
Add it to a robots.txt in the generator →