Crawling company sites for a richer Commercial Profile

Console learns what a company sells, who it serves, and how it sounds from the pages you crawl. Brand Assets (logos, images, colors) can look complete while Commercial Profile stays thin if the crawl never reached product, pricing, about, or audience pages.

The seed list on Company → Crawl sites decides what is read. Console follows one hop from each seed and reads about 10 pages in total. It does not walk the whole site or the sitemap. Extra seeds matter more than hoping the homepage will lead everywhere.

Why a homepage-only crawl is often thin

A homepage is often news, campaigns, or a JavaScript-heavy hero. Those pages fill the page budget. About, product, pricing, and “who we sell to” pages never get read, so products, customers, USPs, and sales process stay generic or empty.

This happens on both B2B and B2C sites. A news-heavy media homepage, a SaaS marketing homepage, and a retailer homepage all starve the crawl in the same way.

Which URLs to add

Keep the company URL, then add standing offer pages—not a list of articles:

• About or company story
• Products or services
• Pricing, packages, or how to buy
• Who it is for (solutions, industries, audiences)
• Customers, case studies, or partners when those describe the offer
• FAQ or help that describes the offer

Skip news, blogs, and one-off campaign URLs unless they describe the standing offer. Each news URL you add crowds out a commercial page.

You can mix domains when the shop, app, or docs site is separate. Add that URL the same way.

Examples

B2B software or services (typical). Homepage, about, product or platform, pricing or packages, solutions or industries, customers or case studies, and a demo or contact page.

B2B with a consumer brand (B2B/B2C). Homepage, about, the B2B offer (partners, wholesale, commercial, or enterprise), the consumer offer (shop, membership, or product), pricing, and FAQ.

Consumer, club, or media. Homepage, about, the offer (shop, tickets, or membership), commercial or partners if you also sell to businesses, and FAQ. Skip news, match reports, and campaign landings.

How to crawl

1. Open Company in Console.
2. Open the Crawl sites tab.
3. Confirm the company URL is listed (it is included by default).
4. Add the about / product / commercial URLs, then Add URL for each.
5. Click Crawl site(s) and wait until crawling and page reading finish.
6. If Console says results are not applied yet, use Update Profile and data from latest crawl.
7. Open Commercial Profile and Brand Assets. Edit any thin fields by hand; the crawl is a starting point, not the last word.

Sales Launch’s first scan uses the company homepage only (a handful of pages). After that first agent exists, recrawl from Crawl sites with the fuller seed list so later drafts and targeting match the real offer.

After the crawl

Commercial Profile should cover products or services, who you sell to, motivations, audiences to skip, unique selling points, and how sales works today. Brand Assets should cover logos, reusable images, and style.

Recrawl when the site or offers change. Change the seed list first if the last crawl still looked like news instead of the offer.

Related

• Sales Launch end-to-end
• Credits, fuel, and going live