Hall

Resources

AI agent directory

A continously updated directory of all the known AI agents currently active on the internet.

2ip bot

Developer tool

360Spider

Search index crawler

adbeat_bot

Data collector

AdsBot-Google

Search index crawler

AhrefsBot

SEO crawler

AhrefsSiteAudit

SEO crawler

AI2Bot

Data collector

aiHitBot

Data collector

AlexandriaOrgBot

Search index crawler

Amazonbot

Search index crawler

AndersPinkBot

Data collector

Applebot

Search index crawler

Applebot-Extended

Data collector

Arquivo-web-crawler

Content archiver

Atom Feed Robot

Data fetcher

AwarioBot

Data collector

Baiduspider

Search index crawler

Barkrowler bot

SEO crawler

BazQux bot

Data fetcher

bingbot

Search index crawler

BingPreview

Data fetcher

bitlybot

Data fetcher

BitSightBot

Data collector

Bytespider

Search index crawler

CCBot

Data collector

ChatGPT-User

AI assistant

Claude-SearchBot

AI search retriever

Claude-User

AI assistant

ClaudeBot

Data collector

cohere-training-data-crawlera

Data collector

Daum bot

Search index crawler

dcrawl bot

Data fetcher

deadlinkchecker bot

SEO crawler

Diffbot

Data collector

Discordbot

Data fetcher

DomainStatsBot

Data collector

dotbot

SEO crawler

DuckAssistBot

AI assistant

DuckDuckBot

Search index crawler

Embedly

Data fetcher

EtaoSpider

Data fetcher

ev-crawler

Data collector

facebookexternalhit

Data fetcher

Feedfetcher-Google

Data fetcher

Feedly bot

Data fetcher

FlipboardProxy

Data fetcher

FreshRSS bot

Data fetcher

Friendica bot

Data fetcher

Google Web Preview

Data fetcher

Google-Extended

Data collector

Google-InspectionTool

Developer tool

Google-Read-Aloud

Data fetcher

Google-Safety bot

Security crawler

Googlebot

Search index crawler

Googlebot-Image

Search index crawler

Googlebot-Mobile

Search index crawler

Googlebot-News

Search index crawler

Googlebot-Video

Search index crawler

GoogleOther

Data fetcher

GPTBot

Data collector

HaoSouSpider

Search index crawler

Hatena bot

Content archiver

HeadlessChrome

Developer tool

heritrix

Content archiver

HTTrack bot

Content archiver

hypestat bot

SEO crawler

ia_archiver

Content archiver

Iframely bot

Data fetcher

ImagesiftBot

Data fetcher

inoreader bot

Data fetcher

IonCrawl

Data collector

Jugendschutzprogramm-Crawler

Data collector

Kangaroo Bot

Data collector

KStandBot

Data collector

LightspeedSystemsCrawler

Security crawler

linkdexbot

SEO crawler

LinkedInBot

SEO crawler

linkfluence bot

Data collector

magpie-crawler

Data collector

Mail.RU_Bot

Search index crawler

Mastodon bot

Data fetcher

Mediapartners-Google

Data fetcher

Mediatoolkitbot

Data collector

Meta-ExternalAgent

Data collector

Meta-ExternalFetcher

AI search retriever

MetaInspector bot

Data fetcher

Miniflux bot

Data fetcher

MJ12bot

SEO crawler

MojeekBot

Search index crawler

MuckRack bot

Data collector

NetcraftSurveyAgent

Data collector

Netvibes bot

Data fetcher

news-please bot

Data collector

NewsBlur bot

Data fetcher

NewsNow bot

Data fetcher

newspaper bot

Data fetcher

Nextcloud bot

Developer tool

Nicecrawler

Data collector

NovaAct bot

Data fetcher

Nutch bot

Search index crawler

OAI-SearchBot

AI search retriever

Offline Explorer bot

Content archiver

omgili bot

Data collector

online-webceo-bot

SEO crawler

OpenindexSpider

SEO crawler

Pandalytics bot

Data collector

PanguBot

Data collector

panscient.com bot

Data collector

peer39_crawler

Data collector

Perplexity-User

AI assistant

PerplexityBot

Data collector

PetalBot

Search index crawler

Pingdom.com bot

Data fetcher

Pinterestbot

Data fetcher

PocketParser

Data fetcher

proximic

Data collector

Quora-Bot

Search index crawler

Qwantbot

Search index crawler

redditbot

Data fetcher

rogerbot

SEO crawler

scoop.it bot

Content archiver

Scrapy bot

Developer tool

Screaming Frog SEO Spider

SEO crawler

SeekportBot

Search index crawler

SemanticScholarBot

Data fetcher

SemrushBot

SEO crawler

SemrushBot-BA

SEO crawler

SemrushBot-CT

SEO crawler

SemrushBot-SI

SEO crawler

SemrushBot-SWA

SEO crawler

SenutoBot

SEO crawler

SeobilityBot

SEO crawler

SEOkicks-Robot

SEO crawler

SEOlizer bot

SEO crawler

SerendeputyBot

Data fetcher

serpstatbot

SEO crawler

SeznamBot

Search index crawler

SimplePie bot

Data fetcher

SiteAuditBot

SEO crawler

SiteCheckerBotCrawler

SEO crawler

Slack-ImgProxy

Data fetcher

Slackbot

Data fetcher

Slackbot-LinkExpanding

Data fetcher

SMTBot

Data collector

Snap URL Preview Service

Data fetcher

Sogou web spider

Search index crawler

startmebot

Data fetcher

Superfeedr bot

Data fetcher

SurdotlyBot

Security crawler

Synapse bot

Data fetcher

t3versionsBot

Developer tool

TelegramBot

Data fetcher

teoma bot

Search index crawler

Timpibot

Data collector

TinEye-bot

Data fetcher

Tiny Tiny RSS bot

Data fetcher

trendictionbot

Data collector

TrendsmapResolver

Data collector

TurnitinBot

Data collector

TweetmemeBot

Data fetcher

Twingly Recon

Data collector

Twitterbot

Data fetcher

um-LN

Data collector

VelenPublicWebCrawler

Data collector

Viber bot

AI assistant

virustotal bot

Security crawler

vkShare

Data fetcher

W3C_CSS_Validator

Developer tool

W3C_Validator

Developer tool

Webzio bot

Data collector

WhatsApp bot

Data fetcher

yacybot

Search index crawler

YaDirectFetcher

Data fetcher

Yahoo Link Preview

Data fetcher

Yahoo! Slurp

Search index crawler

YandexAccessibilityBot

SEO crawler

YandexAdditional

Search index crawler

YandexAdditionalBot

Search index crawler

YandexAdNet bot

Data collector

YandexBlogs bot

Search index crawler

YandexBot

Search index crawler

YandexBot MirrorDetector

Data collector

YandexCalendar bot

Data fetcher

YandexComBot

Search index crawler

YandexDirect bot

Data fetcher

YandexDirectDyn bot

Data collector

YandexFavicons bot

Data fetcher

YandexForDomain bot

Data fetcher

YandexImageResizer

Data fetcher

YandexImages

Search index crawler

YandexMarket bot

Data fetcher

YandexMedia bot

Search index crawler

YandexMetrika bot

Data collector

YandexMobileBot

Search index crawler

YandexMobileScreenShotBot

Data fetcher

YandexNews bot

Search index crawler

YandexOntoDB bot

Data collector

YandexOntoDBAPI

Data fetcher

YandexPagechecker

SEO crawler

YandexPartner bot

Data fetcher

YandexRCA bot

Search index crawler

YandexRenderResourcesBot

Data fetcher

YandexScreenshotBot

Search index crawler

YandexSearchShop bot

Search index crawler

YandexSitelinks bot

Search index crawler

YandexSpravBot

SEO crawler

YandexTracker

Developer tool

YandexUserproxy

Data fetcher

YandexVerticals bot

Search index crawler

YandexVertis bot

Search index crawler

YandexVideo bot

Search index crawler

YandexVideoParser

Data fetcher

YandexWebmaster bot

Developer tool

Yeti bot

Search index crawler

YisouSpider

Search index crawler

YouBot

AI search retriever

ZoominfoBot

Data collector

ZumBot

Search index crawler