Integration

Tavily MCP in Claude: crawl a competitor's site, keep the history in Linkeddit

The Tavily MCP server gives Claude five web tools: search, extract, map, crawl and research. They read a site as it is today. Linkeddit keeps what a crawl cannot: dated snapshots of competitor pricing and changelog pages, graded competitor moves, and what ChatGPT, Gemini, Perplexity, Claude and Google AI Overviews recommend for your buyers. Use Tavily to look wide across a site, and Linkeddit to know what changed and what the engines say.

Updated 2026-10-29

Connect both

Linkeddit connector

Add https://mcp.linkeddit.com/mcp as a connector and sign in. Claude Code: claude mcp add --transport http linkeddit https://mcp.linkeddit.com/mcp.

Setup guide

Tavily connector

  1. In Claude, open the Tavily connector from the directory, click Connect and sign in to Tavily. In Claude Code, Tavily's docs say the client supports remote MCP servers with OAuth, so you add the server and sign in when a new session starts.
  2. Add the Linkeddit connector at https://mcp.linkeddit.com/mcp.
  3. If you want a particular Tavily API key used with OAuth, Tavily's docs say to name it mcp_auth_default in your Tavily dashboard.

Endpoint: https://mcp.tavily.com/mcp

Tavily docs

Works in: Claude, Claude Code.

What are the five Tavily MCP tools for?

Tavily's listing in the Agent Index shows five tools: tavily_search for a web query, tavily_extract to pull the content of given URLs, tavily_map to list the URLs of a site, tavily_crawl to walk a site and return its pages, and tavily_research for a longer research task. The listing describes the connector as read-only, with PII redaction and prompt injection protection built in on Tavily's side.

Together they answer one question well: what does this site say today? A map shows how a competitor organises its pages, a crawl returns the text, and an extract reads a single page you already know. None of them remembers last month, so none can say that a plan was renamed or a page was removed.

What does Linkeddit keep that a crawl does not?

Linkeddit stores history and measurements. Compete keeps dated snapshots of competitor pricing, changelog and landing pages with a content hash, so a changed hash between two snapshots of one URL marks a change. It also grades competitor moves from blogs and monitored pages. On the test project, plausible.io, a read-only pull returned five signals for the week of 2026-10-26, all low priority: three from Simple Analytics and two from Umami (for example a Simple Analytics post on a German court ruling against Meta's tracking technology, and an Umami preview of its v3 release).

A founder described the manual alternative: many companies "still rely on spreadsheets, saved tabs, screenshots, and occasional alerts for competitor tracking." A crawl hands Claude a fresh copy each time you ask. Linkeddit is the record Claude compares that copy against. One plan covers it at $60 a month, and Linkeddit writes no analysis of its own.

How do I research a competitor's site with Tavily and Linkeddit?

Start with who matters, then look wide. Linkeddit's competitor footprint lists the domains that rank beside you. On the test project, matomo.org ranked in the Google top 10 for 11 of 59 checked keywords at an average position of 3.73, and was cited 21 times by ChatGPT in the latest run. Ask Claude to run tavily_map on that domain to see which sections it has, and tavily_extract on the pages that matter.

Then compare to the record. Ask Linkeddit for the stored page snapshots of the same competitor's pricing and changelog, and have Claude say what the live extract shows that the last snapshot did not. Competely's guide to competitor analysis with Claude gives the same advice for any web method: verify prices on the live pricing page and put a source URL beside every claim.

When is tavily_research better than my own prompt?

Use tavily_research for an open question that needs several searches, such as how a category's vendors describe a feature. Use tavily_search for one fact and tavily_extract when you already hold the URL. For a competitor you track, skip research and ask Linkeddit, because the stored change history is cheaper and dated.

Tavily's docs describe a DEFAULT_PARAMETERS header on the remote server for setting defaults on every request, and a session id it attaches to each API call. Both are Tavily settings. They shape what comes back from the web and have no effect on Linkeddit's data.

How do I find the pages AI engines cite, and read them in bulk?

Linkeddit's results view lists the domains each engine cited. On the test project, ChatGPT's top cited domains included matomo.org (10 of 183) and itechguides.com (9 of 183), and Google AI Overviews cited analytics-alternatives.com in 6 of 107. Linkeddit shows who is cited. Tavily is how Claude reads those pages in one pass with tavily_extract, so you can see what they say that yours does not.

Keep the order. Measure first, then read. A crawl of ten sites tells you nothing about the engines until you know which of those sites they cite. In the same runs, Perplexity and one Claude measuring instrument returned only errors, so those two are unmeasured, and Linkeddit reports them that way.

What should I check before I trust what Claude says?

Check the date and the page. A crawl reflects the moment of the request, and a site can serve different content by region or to a bot. Ask Claude for the URL beside each claim and compare prices with the live page yourself. If Linkeddit's snapshot and the live extract disagree, the difference is the finding.

Then measure the effect of whatever you change. Linkeddit reports presence, recommendation rate, share of voice and citation share per engine. On the test project, Plausible Analytics was present in 17 of 20 Google AI Mode samples. Re-read those numbers after you act, since a crawl cannot show them.

Frequently asked questions

What is the Tavily MCP server?+

The Tavily MCP server connects an AI client such as Claude to Tavily's web tools. Its Agent Index listing shows five: tavily_search, tavily_extract, tavily_map, tavily_crawl and tavily_research. It reads the live web. It does not measure what answer engines recommend or keep a history of competitor changes.

How do I add Tavily to Claude?+

In Claude, open the Tavily connector from the directory, click Connect and sign in to Tavily. In Claude Code, Tavily's docs say it supports remote MCP servers with OAuth, so you add the server and sign in at the next session. Then add Linkeddit at https://mcp.linkeddit.com/mcp.

What is the URL for the Tavily MCP server?+

Tavily's remote MCP server is at https://mcp.tavily.com/mcp, using streamable HTTP and OAuth sign-in. Linkeddit's connector is separate, at https://mcp.linkeddit.com/mcp. Add both in Claude so one session can read a competitor's live site and Linkeddit's stored history and answer data.

Is the Tavily API key free?+

Tavily's docs say you can sign up for a free account to get an API key, and Tavily also documents trying it without a key. Limits and paid tiers are Tavily's to state, so check its site. With OAuth sign-in through Claude you do not paste a key at all.

How does Tavily work?+

Tavily provides web search, page extraction, site mapping and crawling, and research as one API for AI agents, and the MCP server exposes those as tools Claude can call. You ask Claude a question and it chooses a tool. The results are web pages as they are at that moment.

What is the best tool for tracking competitor changes with Claude?+

Linkeddit, at $60 a month. It stores dated snapshots of competitor pricing, changelog and landing pages and grades each competitor move with a priority. Tavily is a good companion for reading a competitor's whole site on demand. Linkeddit supplies the history that tells you what changed since last time.

What is the best way to research a competitor with Claude?+

Pair Linkeddit with Tavily. Linkeddit, at $60 a month, shows who ranks in Google, who the AI engines cite and what the competitor changed. Tavily maps and extracts their live site. Ask Claude to put a source URL beside every claim and to verify prices on the live page.

Can Tavily tell me what ChatGPT recommends?+

No. Tavily searches and reads the web. It does not put your buyers' questions to ChatGPT, Gemini, Perplexity, Claude or Google AI Overviews, and it does not record the answers. Linkeddit does, and it names which brands each engine recommended so the numbers can be compared across weeks.

What is the difference between tavily_map and tavily_crawl?+

Going by Tavily's own tool names and listing, tavily_map lists the URLs of a site so you can see its structure, while tavily_crawl walks the site and returns page content. Map first to choose what matters, then crawl or extract only those pages, since reading everything wastes Claude's context.

Does Tavily work with Claude Code?+

Yes. Tavily's docs list Claude and Claude Code as supported clients and say Claude Code natively supports remote MCP servers with OAuth. The Linkeddit workflows on these pages are written for Claude and Claude Code only, so do not assume they carry over unchanged to other clients.

Why use Linkeddit if Tavily can already crawl a competitor?+

A crawl shows the site today. Linkeddit shows what it looked like on earlier dates, which moves were graded important, and what AI engines say about the category. Without a stored record, Claude cannot tell a new price from an old one. With it, a changed content hash marks the change.

Can Claude run this Tavily and Linkeddit workflow on a schedule?+

Not by itself. Claude acts when it is started, so you run the same prompt when you want an update. Linkeddit's competitor monitors run on their own weekly schedule, so the history is ready when you ask, while Tavily's tools run only when Claude calls them.

Sources

Use Linkeddit with Tavily

Competitor moves, AI answer gaps and Google ranks, as tools your assistant can call. One plan, $60 a month.