EN

    
    
Talk to our experts

Blog

IA

Prompt Tracking: A Reliable Way to Measure Your AI Visibility or Not?

Does your brand appear in the responses from ChatGPT, Gemini, or Perplexity when potential customers ask questions about your industry? To find out, more and more marketing teams are adopting prompt tracking, or AI prompt monitoring. The principle: regularly submit a series of predefined questions to the AI platforms, then note who is mentioned, cited, or recommended.

Our position is clear. Prompt tracking is an excellent observation tool, but a poor thermometer when read on its own. It reveals trends and competitive gaps, without measuring your actual visibility on its own. In our article on the SEO vs. GEO debate, we already discussed the limitations of AI visibility measurement tools. Let’s go further.

What is prompt tracking in SEO and GEO?

Traditional SEO ranking tracking checks where a page ranks for a keyword in search engine results. Prompt tracking, however, observes how an AI builds its response to a conversational question. It makes it possible to track four signals: AI mentions of your brand, AI citations of your pages as sources, competitors proposed for the same intent, and the context of the recommendation, whether it is a preferred option, a reference, or a simple mention.

Be careful, however, not to confuse the two concepts. An AI can recommend your company without a link to your site, or cite your page without ever naming your brand. These two signals tell different stories and deserve separate tracking.

Prompt tracking and traditional SEO tracking: what are the differences?

Suivi SEO traditionnel
Unité observée Requêtes et pages identifiables
Signaux suivis Impressions, clics, positions
Sources de données Google Search Console, outils d’analyse
Lien avec le trafic Direct et mesurable
Prompt tracking
Unité observée Questions conversationnelles et intentions
Signaux suivis Mentions, citations, recommandations
Sources de données Tests répétés sur les plateformes IA
Lien avec le trafic Partiel, souvent sans clic

The two approaches complement each other: by cross-referencing their data, we gain a better understanding of the user search journey.

Why should prompt tracking results be interpreted with caution?

The exact same question almost never yields the exact same answer twice

Ask ChatGPT the same question three times: the proposed brands, the cited sources, and their order may change. Rand Fishkin, co-founder of SparkToro, demonstrated this in early 2026. Around 600 volunteers ran 12 identical prompts nearly 3,000 times on ChatGPT, Claude, and Google’s AI, and the probability of getting the same list of brands twice was less than 1 in 100. His conclusion is blunt: “Accurately measuring your brand’s presence in AI responses is a mission impossible” 

Fishkin does qualify this, however: a visibility percentage calculated on tens or hundreds of prompts, run multiple times, remains a reasonable indicator. This is precisely our reading. Forget the “position in ChatGPT” and instead track the frequency of appearance.

Research published by Profound points in the same direction. Out of 883,000 pages tracked over 12 months across 7 AI engines, the median page loses half of its share of citations 11 days after its peak.
In other words, even when a page gains visibility in an engine, this signal can erode quickly – and without replicating itself in the same way across other platforms.

Infographic showing AI citation volatility: a 50% decline after 11 days, based on Profound’s study of 883,000 pages across 7 AI engines.

Personalization changes what each user sees

Memory, conversation history, language, location, and the sources consulted at the time of the search influence each response. OpenAI specifies this in its documentation on ChatGPT memory: past exchanges can be used to personalize responses. An automated tool therefore reproduces test conditions, not the experience of each of your customers.

The choice of prompts can bias the entire analysis

In our opinion, this is the most underestimated limitation. A company that only tracks questions tailored to its products will obtain a flattering score, with no guarantee that it reflects the questions its customers are actually asking. And unlike SEO, we do not have reliable search volumes for every conversational phrasing. Prompt tracking therefore measures your visibility on a sample of questions, never on all conversations.

Speak to our SEO/GEO experts

How to build a relevant prompt tracking strategy?

The quality of the method matters more than the number of prompts tracked.

Start from your customers’ actual intents

Your SEO data, keyword research, and the questions your sales teams receive are the best starting points. Then combine informational, comparative, and commercial questions. A company specializing in printers will thus track “Which printer to choose for a small business?” just as much as “Laser or inkjet printer: which one to choose?” or “Which brands offer printers suitable for SMEs?”. Each phrasing sheds light on a different stage of the decision-making journey.

Diversify platforms and document test conditions

Being present on ChatGPT guarantees nothing on Gemini, Claude, or Perplexity. Compare platforms and systematically note the language, market, date, and search mode used. To limit the effect of history, launch your tests in new conversations, with reduced personalization.

Repeat tests and read trends

An isolated result is an observation, not a trend. Repeat your prompts at different times and maintain a stable set over time, because constantly changing questions makes any evolution unreadable. As for the number of repetitions, the profession has no consensus. The right number depends on your objective, the level of confidence sought, and your resources, and your methodology must state this clearly.

Cross-reference AI signals with your SEO and business data

Prompt tracking takes on its full value when compared with other sources. Tools like Semrush and Ahrefs make it possible to track mentions, citations, and competitive visibility in AI responses. However, their results are based on prompt samples and estimation methodologies, not on all actual user interactions.

This data is useful for identifying trends and guiding a GEO strategy, but it must be interpreted with caution. AI responses vary according to the phrasing of questions, context, personalization, and location. An AI visibility score therefore remains an estimate, and not an exact measurement of a brand’s actual exposure.

Conversely, Google and Bing have data from their own search and AI systems:

  • Google Search Console: its generative AI performance reports, rolled out to all sites at the end of August 2026, make it possible to analyze impressions and pages displayed in Google’s AI features, among other things.
  • Bing Webmaster Tools: its AI Performance report presents page citations in Microsoft Copilot, Bing, and certain partner integrations. It allows you to examine grounding queries, associated intents, and the share of citations. The new Topics Portfolio (beta) feature also groups these queries by theme to identify content opportunities.

This first-hand data provides a complementary perspective, without offering an exhaustive view of user interactions. In particular, Bing’s grounding queries are sampled, while certain thematic estimates remain approximate.

GA4 completes this analysis by making it possible to identify some of the traffic coming from AI platforms, while conversion metrics make it possible to align these observations with business objectives.

The challenge is therefore to distinguish visibility estimates from observed performance metrics, and then cross-reference these signals to make informed decisions.

Our approach at Dialekta: turning observations into decisions

At Dialekta, we view prompt tracking as a source of observations complementary to a broader SEO and GEO strategy, and not as a reliable and exhaustive measurement of AI visibility.

Despite its limitations, it can be interesting to observe a brand’s mentions, citations, and absences across a set of targeted questions. These results must nevertheless be interpreted with caution, as they depend in particular on the selected prompts, test conditions, and the variability of responses.

Our approach therefore consists of treating these observations as avenues to explore, putting them into context, and comparing them with other SEO and marketing data before drawing conclusions.

Infographic showing the key metrics to track when measuring AI visibility through prompt tracking.

Take the example of a brand rarely mentioned in AI responses to comparative questions, while its competitors appear regularly. This finding does not necessarily mean that its overall visibility is low or that its content has shortcomings. It can nevertheless raise relevant questions about how its products are presented, compared, and accessible.

The goal is not to optimize content to artificially improve an AI visibility score, but to integrate these observations into a broader analysis, without giving them disproportionate importance.

Is prompt tracking a reliable indicator of GEO performance?

Yes, as an observation indicator. No, as an exhaustive measurement of visibility or return on investment. A mention rate calculated on a selection of prompts does not represent the actual probability that a customer will encounter your brand in an AI conversation.

The right question is therefore no longer “Are we visible in ChatGPT?”, but “What does our presence in AI responses reveal about our ability to meet our customers’ needs?”. To build a GEO measurement useful for your decisions, discover our GEO support.

How Dialekta can help you turn these observations into actions

Prompt tracking can reveal opportunities, but you still need to know how to interpret them and which ones to act on.

At Dialekta, our GEO support goes beyond monitoring AI mentions and citations. We identify the questions relevant to your customers, analyze your presence compared to that of your competitors, and cross-reference these observations with your SEO data and business goals.

This approach allows us to prioritize concrete actions on your content, your site, and your digital visibility, without limiting ourselves to a simple AI visibility score.

Move from observations to decisions with our SEO/GEO team.

Request a GEO audit

Frequently asked questions about prompt tracking

Can you precisely measure your position in ChatGPT?

No, not like an SEO position. Responses vary from one run to the next. It is better to analyze the frequency and context of mentions across a set of documented tests.

How many prompts should be tracked?

There is no universal number. Everything depends on your categories, your markets, the targeted intents, and the precision sought. A balanced and representative sample is worth more than a long list of irrelevant questions.

Can GEO ROI be measured with prompt tracking?

Not directly. Prompt tracking provides indicators of presence and citability. To evaluate business results, they must be cross-referenced with your traffic and conversion data, keeping the limits of attribution in mind.

AI Agents and CRM: What to Consider Before Automating Your Actions

Agentic AI and CRM: How to Transform Your Relationship Marketing and Automate Your Actions

CRMs like Salesforce, Klaviyo, HubSpot, or  Microsoft Dynamics 365, now integrate agents capable of going beyond analysis or content generation. They can also trigger actions, sometimes autonomously: qualifying a lead, re-engaging a client, recommending an offer, or handling a service request.

This evolution changes the very nature of CRM and marketing automation. We are no longer talking just about a tool that centralizes information, but about a system that starts to take action.

But what is an AI agent in a CRM? What can we actually entrust to it? And under what conditions?

What is an AI Agent in a CRM?

An AI agent in a CRM is a system that understands a customer context, chooses an action among several options, and can execute it within connected tools.

We can entrust it with simple, repetitive, or reversible tasks. On the other hand, as soon as a decision has a significant financial, legal, or relational impact, human supervision remains necessary.

What does an AI agent in a CRM actually do?

An AI agent doesn’t just answer a request. It acts based on a goal.

It can analyze a situation, consult data, decide on a sequence of actions, and execute them in the CRM or connected tools.

Depending on its access level, it can, for example:

  • consult a customer’s history
  • estimate their level of interest
  • draft a message
  • choose the right time or channel for a follow-up
  • update a customer profile
  • trigger a workflow
  • or transfer a file to a human team.

Its operation relies on a few simple elements: a goal, available data, authorized actions, and rules that frame what it can or cannot do.

In a marketing context, for example, it can analyze a visitor’s behavior on a site, identify their level of interest, and then decide on the best action: offer them a personalized offer, trigger an email sequence, adjust the content displayed on a landing page, or pass the lead to the sales team at the right time.

Example of AI agents – Hubspot

What is the difference between an AI agent and marketing automation?

Marketing automation relies on pre-defined scenarios. A condition triggers a specific action.

An AI agent works differently. It starts from a goal and adapts to the context to decide on the best sequence of actions.

Marketing automation executes a planned scenario. The agent chooses what it does based on the situation.

Dimension

Marketing automation

AI agent

Starting point

Rule or trigger

Goal and context

Journey

Programmed sequence

Adapted sequence

Decision

Preprogrammed with business rules

Dynamic: choice between multiple actions

Control

Testing before deployment

Continuous testing and monitoring

Risk

Limited to the rule

Variable depending on context

This does not mean that the agent “understands” like a human. It selects actions based on models, data, and rules defined by the company.

Example of AI agents – Klaviyo

Predictive, generative, or agentic AI?

We often mix several types of AI in CRMs.

  • Predictive AI estimates a probability (purchase, churn, conversion).
  • Generative AI produces content (text, summary, response).
  • Assistance AI suggests an action but leaves the human to decide.
  • Agentic AI goes further: it chooses and executes actions to achieve a goal.

The term “agent” is therefore not enough. We must look at what the system actually does: does it recommend, prepare, or act?

Are CRM platforms becoming systems of action?

Publishers are all moving in this direction.

Salesforce, with Agentforce, highlights agents capable of qualifying prospects, answering customers, or managing certain order steps. Klaviyo claims its K:AI agents can detect opportunities, build campaigns, and handle certain service requests. HubSpot allows its prospecting agent to research accounts, prepare approaches, and in some cases, send emails automatically.

Adobe, Microsoft, Braze, Bloomreach, Oracle, Zendesk, and Intercom are also developing agents for marketing, commerce, or support. We are progressively moving from a CRM that records to a CRM that acts, but the level of autonomy varies greatly from one platform to another: some are limited to recommendations, while others already allow direct execution.

What are the main use cases and their risks?

Lead Qualification

An agent can analyze available data, a prospect’s behavior, and past interactions. It can enrich the record, suggest a score, or transfer the contact to sales.

The main risk is misinterpreting a signal or reproducing biases present in historical data.

Follow-up Orchestration

The agent can decide when to follow up, through which channel, and with what message. It can also adjust the pace based on the customer’s reactions.

Risks include over-solicitation, using an unauthorized channel, and inconsistencies between communications.

Customer Service

An agent can answer simple questions, check an order, or initiate a return.

Things become more sensitive as soon as it can modify a contract, grant a commercial gesture, or financially commit the company.

Next Best Action

Some agents directly suggest the next action to take: an offer, content, or a channel.

This is useful for personalization, but it can also become intrusive or hard to explain if the logic is not clear.

What levels of autonomy can be granted?

Autonomy is not binary. It can evolve progressively.

  1. Observe: the agent analyzes without acting
  2. Recommend: it proposes an action to a human
  3. Prepare: it builds the action to be approved.
  4. Execute under conditions: it acts within predefined limits.
  5. Execute and document: it acts, logs its decisions, and escalates exceptions.

The higher you go in these levels, the more important the need for control remains, even if humans intervene less often.

Is your CRM ready to hand over the reins to an agent?

An agent depends entirely on data quality and the framework in which it operates.

In particular, you need:

  • a consistent customer identity
  • reliable and up-to-date data
  • clear consents
  • usable history
  • a validated knowledge base
  • well-defined permissions.

A qualification agent does not need access to all financial data. A service agent should not be able to grant compensation without an explicit threshold.

An agent does not improve a poorly structured CRM. It simply accelerates its flaws.

How to decide what can be delegated?

Five simple questions can help you decide:

  1. Can the action be easily cancelled?
  2. Does it have a financial or legal impact?
  3. Is the data reliable?
  4. Is the error quickly detectable?
  5. Can a human take back control?

The riskier or harder a decision is to correct, the less it should be automated.

What safeguards should be put in place?

An agent must be framed from its design:

  • clear role and objective
  • limited data access
  • defined authorized actions;
  • financial thresholds
  • human validation on sensitive cases
  • action log
  • regular testing
  • possibility of rapid deactivation

Traceability is essential: you must be able to understand what the agent did and why.

What does Law 25 provide?

In Quebec, Law 25 governs decisions made based on automated processing of personal data.

When a decision is entirely automated, the concerned individual must be informed. The law may require explanations, access to the data used, and a human review.

The use of AI does not systematically lead to a decision in the legal sense: everything rests on the context and the actual scope of its impact.

*This general information does not constitute legal advice.

Where to start?

The simplest approach is to start small. The first pilot should target a frequent, well-documented, measurable task based on accessible data and associated with limited risk.

The agent can start in observation mode. Its recommendations are then compared to human decisions. The company can then allow it to prepare certain actions, and then execute a few within a restricted perimeter.

Autonomy must be earned through results, not granted by default.

Conclusion

Agentic AI could cause the CRM to evolve from a system that stores data and executes scenarios into a system capable of selecting and accomplishing actions.

But the true transformation will not depend on the number of deployed agents. It will depend on companies’ ability to provide them with reliable context, limit their permissions, track their decisions, and measure their results.

The competitive advantage will go to organizations capable of progressively delegating the right decisions within an explainable, measurable, and reversible framework.

 

Written by Marie Broudic, Data Director at Dialekta