Indonesia Singapore ไทย Pilipinas Việt Nam Malaysia မြန်မာ ລາວ
← Back to Blog

Perfect AI Output, Wrong Answer: The Data Trust Gap

Structural correctness in AI outputs is not data integrity — only a consent-grounded first-party data programme gives you outputs you can actually act on.

By Lavender Grizzly →
An editorial illustration of a figure receiving a perfectly wrapped gift box that contains only fog
Illustrated by Mikael Venne

When AI returns flawless structure but flawed conclusions, your first-party data strategy is what separates signal from confident noise.

Your AI just returned a perfectly structured output. Clean JSON, valid schema, every field populated. Your stakeholders are nodding. Here is the problem: the data feeding that model was incomplete, inferred, or collected without genuine consent — and no amount of formatting fixes that.

When Structure Becomes a Confidence Trick

Benjamin Nweke’s analysis in Towards Data Science makes an uncomfortable point that most martech teams are not ready to sit with: a large language model can return syntactically perfect outputs that are semantically, factually wrong. The structure validates itself. The schema passes. The dashboard looks clean. But if the underlying data is patchy — missing fields, ambiguous signals, inferred attributes from third-party sources — the model’s confidence is essentially aesthetic.

This is not a fringe edge case. It is the default state for most brands in Southeast Asia still relying on aggregated behavioural data, cookie-inferred segments, or data purchased from platform intermediaries. When a Thai retail brand feeds its personalisation model with Shopee browse data it does not fully own or understand, the model will still return a recommendation. It just might be confidently, structurally, expensively wrong.

The fix is not better prompting. It is better data provenance — knowing exactly where each data point came from, under what consent context, and what it actually represents.

Polish Is No Longer Proof of Anything

The same structural illusion is playing out in vendor selection. CustomerThink’s Ramy Ayoub observes that AI has made polished, confident-sounding proposals cheap to produce at scale — effectively breaking the historical link between presentation quality and actual competence. A vendor deck that once took two weeks to produce now takes two hours, and it shows the same level of finish either way.

For marketing directors evaluating CDP vendors, agentic AI platforms, or data clean room partners across SEA, this matters enormously. The glossy platform demo with real-time dashboards and natural language querying tells you very little about whether the underlying architecture respects data residency requirements in Indonesia, handles Thai-script segmentation correctly, or can actually ingest consent signals from LINE’s ecosystem.

The evaluative signal has shifted. Stop scoring vendors on the polish of their outputs. Start scoring them on the rigour of their inputs: How do they handle incomplete consent records? What happens to a user profile when consent is withdrawn mid-campaign? Can they show you a live example of data lineage from collection point to activation?


Agentic Martech Needs Data It Can Actually Trust

Tealium’s Zack Wenthe frames the emerging agentic martech landscape as a question of choice versus lock-in — and he is right to frame it that way. As natural language becomes the dominant interface for marketing platforms, brands across Southeast Asia face a structural decision: consolidate into one vendor’s agent ecosystem, or maintain composable data infrastructure that any agent can access.

But there is a prerequisite that sits upstream of that choice, and it is the one most brands are skipping: the data the agents act on has to be trustworthy at the point of collection. An agentic system that can autonomously adjust campaign bids, trigger CRM workflows, and personalise landing pages in real time is extraordinarily powerful. It is also extraordinarily good at scaling errors. If your first-party data programme has consent gaps — users who opted into email but not retargeting, or whose preferences were captured pre-PDPA enforcement in Thailand — an autonomous agent will act on those profiles anyway, because the schema says they are valid.

The brands that will build durable competitive advantage from agentic martech are the ones building consent-architecture now, before agents have full autonomy. That means preference centres with genuine granularity, not checkbox consent walls. It means data collection touchpoints that explain value exchange clearly — in Bahasa, in Thai, in Tagalog — because a consent signal collected in a language a user did not fully understand is not a consent signal. And it means data pipelines where provenance is a first-class attribute, not an afterthought.

The Competitive Advantage Hidden in Constraint

Here is the counterintuitive read on all of this: the brands that treat data quality and consent as compliance burdens are building on sand. The brands that treat them as product decisions — as part of what makes their data asset genuinely valuable — are building something competitors cannot easily replicate.

A first-party data programme built on genuine consent, clear value exchange, and transparent data use does something a third-party data purchase cannot: it creates a relationship. Shoppers who trust a brand with their preferences give better signals. Better signals mean models with less noise. Models with less noise return outputs that are not just structurally correct — they are actually right.

Grab’s loyalty ecosystem and Sea Group’s cross-platform data strategy both demonstrate this principle at scale: when users understand what they are sharing and why, engagement quality improves, not just engagement volume. That is the dataset your agents should be learning from.

The question worth sitting with as agentic martech matures: if your AI agents became fully autonomous tomorrow, would you trust the data they are acting on — or just the confidence with which they present their outputs?

Lavender Grizzly

Written by

Lavender Grizzly

Turning privacy constraints into competitive advantage. Builds first-party data programmes that are compliant by design, valuable by intent, and trusted by the people whose data they hold.

Enjoyed this?
Let's talk.

Start a conversation