Naver is a South Korean online platform that offers a wide range of services supported by its own web crawlers, including a search engine. Naver provides information about these crawlers in its help documentation, which explains how and why they visit websites.
Naver’s crawlers follow the standard robots.txt directives. We consult Naver’s documentation alongside other research sources when cataloging each crawler’s product token and usages.
Exploring crawlers’ usage
Yeti
Yeti is the primary web crawler of Naver. It fetches web content to support Naver search results while following the robots.txt rules. Blocking Yeti can reduce a site’s visibility in Naver search.
Additionally, Naver uses AI-based search technology to extract and generate summarized information that enhances its searching capabilities and improves relevance to search queries. Hence, it has been identified that this crawler is used for “Search” and “Input” purposes.
The product token is Yeti, and the full User-Agent is:
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; Yeti/1.1; +https://naver.me/spd) Chrome/W.X.Y.Z Safari/537.36
Naver documents the Chrome version as W.X.Y.Z, a placeholder that changes as the crawler’s browser engine updates.
This crawler supports AI-assisted search features and therefore, the IsArtificialIntelligence property is set to “True”.
Ads-Naver
Ads-Naver is a dedicated crawler that analyzes advertisers’ pages to support brand image, measure quality, and help deliver relevant ads. Blocking this crawler may reduce ad visibility and limit the opportunities for ad exposure. Hence, it has been identified that this crawler is used for “Analytics” purposes.
The product token is Ads-Naver, and the full User-Agent is:
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; Ads-Naver/1.1; +https://naver.me/adsn) Chrome/130.0.0.0 Safari/537.36
This crawler is not associated with AI and therefore, the IsArtificialIntelligence property is set to “False”.
Blueno
Blueno is another crawler, used for generating link previews. When links or web content are attached or shared across Naver services, Blueno fetches the relevant metadata, where the description and image create useful previews that make shared content easily and visually accessible. It is triggered by user actions and operates differently from typical crawlers. Hence, it has been identified that this crawler is used for “Preview” purposes.
The product token is Blueno, and the full User-Agent is:
facebookexternalhit/1.1 (compatible; Blueno/1.0; +http://naver.me/scrap)
This crawler is not associated with AI and therefore, the IsArtificialIntelligence property is set to “False”.
AI training
ADVoost is an AI-powered automated optimization technology used in Naver Ads. However, there is no indication that it is associated with any crawler activities or used by Naver’s crawlers to train AI. We have therefore identified that Naver’s crawlers are not used for AI training purposes.
Robots.txt Generator
Use 51Degrees to work with crawler usages rather than tracking individual crawlers and AIs. Check out the free Robots.txt Generator today.
Try our Robots.txt GeneratorAI Treatment
Want to know more about how to handle AIs including options that go beyond robots.txt? Check out our guide to the good, the bad, and the ugly.
AI Solutions