Categories
DTQ

Trust at Risk: Governing the Digital Future

Categories
DTQ

Trust at Risk: Governing the Digital Future

The Shift from Asset to Liability

Data breaches have a quantifiable, substantial, and expanding financial and operational impact that is no longer abstract. Businesses in all sectors and geographical areas are increasingly suffering multimillion-dollar losses as a result of breaches. Furthermore, the percentage of companies that encounter serious events is increasing year. These are systemic flaws that impact businesses regardless of their size, location, or level of cybersecurity program maturity. They are not isolated instances of carelessness.

Even if the financial impact is significant, it is only one aspect of the situation. Data breaches put businesses at risk of serious churn, a decline in consumer trust, and harm to their brand. Reports confirms that consumers no longer accept vague assurances about data protection — they want transparent, verifiable proof. When organisations fail to provide it, users disengage. The trust gap has become as much a commercial threat as a security one, and closing it demands executive-level ownership, not delegation to the IT department.

The Threat Landscape Has Fundamentally Changed

The risks that organizations face have changed significantly over time. According to PwC’s 2025 Global Digital Trust Insights report, cloud threats are now the top cyber risk for business and IT leaders. Interconnection, not antiquated technology, is the culprit: misconfigured cloud storage, SaaS connections, and stolen OAuth credentials offer attack surfaces that perimeter-based security was never intended to address. Attackers are now taking advantage of the trust connections that organizations have covertly built over years of digital transformation across systems, providers, and apps rather than breaking through the front door.

Exposure to other parties and the supply chain exacerbates the issue. According to some reports, supply chain risk is now the biggest obstacle to cyber resilience for most of large firms, and third-party involvement in breaches quadrupled year over year. Hack-and-leak operations, which involve the exfiltration and public publication of data instead of just holding it for ransom, are becoming more common; leaders have identified them as a top-tier danger. The repercussions include short-term financial loss, long-term harm to one’s image, and growing governmental action.

In the future, autonomous AI is changing the danger environment. According to the 2026 Security Predictions study by cybersecurity firm Trend Micro, agentic AI will soon be able to perform whole attack chain tasks without human guidance, including ransom negotiation, vulnerability detection, and reconnaissance. According to the World Economic Forum, a majority of world executives believe AI will have the biggest impact on cybersecurity in the upcoming year. According to defenders, organizations that just make reactive investments are already falling behind in this fight against automation.

The AI Paradox Leaders Cannot Ignore

Artificial intelligence confronts business leaders with a paradox: it is both the most powerful tool for strengthening cyber defence and one of the greatest sources of new risk. Investment in AI capabilities is accelerating, but so too is recognition that these technologies expand the attack surface more than any other recent innovation. The organisations that succeed are those that establish strong governance frameworks before deploying AI at scale.

The governance gap remains significant. Many breaches stem from AI systems lacking basic safeguards such as access controls or clear usage policies, and the rise of “shadow AI” — employees using tools without oversight — compounds the risk. At the same time, well‑governed AI deployments demonstrate clear benefits, from faster breach detection to dramatically reduced costs. The lesson is not to slow adoption, but to embed governance rigorously from the outset.

Zero‑trust architecture is emerging as the structural answer to both AI risk and broader cybersecurity challenges. By assuming no user, device, or system can be trusted until verified, zero‑trust eliminates the implicit trust that attackers exploit. Its pillars — identity and access management, data classification, encryption, and continuous monitoring — provide a resilient foundation. Yet despite the evidence, only a small fraction of organisations have achieved true cyber resilience, underscoring the urgency for boards and leaders to act decisively.

A Leadership Framework for Digital Trust

Building digital trust is not a technology project — it is a governance transformation. Leaders must begin by defining a trust formula that aligns with their organisation’s strategic objectives, supported by clear metrics that reflect the experience of stakeholders rather than generic security scores. They must then establish accountability structures, such as dedicated trust leadership roles and cross‑functional committees that bring together expertise in ethics, governance, and risk.

Trust must be integrated into enterprise risk management, ensuring that it is treated as a core dimension of resilience rather than a compliance checkbox. Investment should shift toward proactive defence, embedding prevention into daily operations instead of relying on reactive crisis response. Finally, trust is earned not through policy alone but through consistent, demonstrable action — communicated in the language of respect and reinforced by transparency.

Conclusion

Cybersecurity is no longer a technical footnote. Digital trust is the new competitive currency, and data is the new risk. In a world where customers and regulators are growing impatient, companies that invest in governance, AI supervision, zero-trust architecture, and open data practices will stand out. Failure to do so will result in breaches measured not just in millions of dollars but also in the irreversible loss of the relationships that support them. The message to executives is clear: safeguarding digital trust is the business, not an expense.

DTQ serves as a platform dedicated to mapping global industry shifts and providing “information capital” before it reaches the mainstream. in cybersecurity space. Please write us at open-innovator@quotients.com for more information.

Categories
Enterprise Innovation

The Silent Rebellion: Why Your Employees Are Using AI Behind Your Back – and What It’s Really Costing You

Categories
Enterprise Innovation

The Silent Rebellion: Why Your Employees Are Using AI Behind Your Back – and What It’s Really Costing You

Every day, a silent uprising takes place on computers and in offices all across the world. A worker is in a hurry to fulfill a deadline. The company-approved tools are either locked behind a ticketing system, sluggish, or cumbersome. Thus, they launch a tab on their browser, enter some private information, and let an unapproved AI program do the rest. For now, the issue has been resolved. Shadow AI is changing the workplace in ways that most businesses have hardly had a chance to consider.

Shadow AI is not an isolated phenomena. It is the business equivalent of sending work files via a personal email account or utilizing a side spreadsheet when the official system is too complicated. Without the knowledge, consent, or supervision of IT or security teams, employees utilize internal or external AI technologies for job activities, such as chatbots, writing assistance, and code generators. Confidential strategy papers, proprietary code, customer information, and sensitive material are copied onto platforms that the business does not control, monitor, or regulate. What began as a productivity shortcut turns into an unseen parallel layer of AI use operating behind the formal architecture of the company.

Why it occurs?

The first step to dealing with Shadow AI honestly is to comprehend why it occurs. Malice is rarely the answer. Unsanctioned tools are used by employees because they are more effective and efficient than the alternatives. People make practical decisions when there are tight deadlines and authorized methods seem like barriers. A copywriter won’t wait three days for IT to whitelist a tool if they require a draft in thirty minutes. When troubleshooting production code at midnight, a developer will use whatever works. Most of the time, shadow AI is a sign of a malfunctioning internal system rather than a malfunctioning employee.

The Error Epidemic Nobody Is Talking About

However, this workaround culture has a higher human cost than it may seem. According to IBM research, 57% of workers say that AI has caused them to make mistakes, while 58% admit to accepting AI results without checking them. These are not isolated incidents; rather, they are common behavioral patterns that arise when individuals use technologies they do not fully comprehend in situations without supervision, direction, or responsibility. Workers are taking on personal danger in addition to organizational risk as they operate in a gray area where everyday pressure to meet deadlines collides with rules they are aware they are breaking.

Caught Between Productivity and Policy: The Stress Nobody Accounts For

In business discussions concerning AI governance, the stress factor is frequently disregarded. For employees dealing with unmanageable workloads, shadow AI often turns into a coping strategy or a pressure valve. However, the respite is fleeting. The underlying anxiousness worsens rather than goes away. Employees must balance two conflicting demands: being productive enough to maintain their position and remaining cooperative enough to avoid being dismissed for breaking a policy. When errors do ultimately come to light, and they do, people are held accountable rather than the instruments. One of the most damaging long-term consequences of unchecked AI deployment is this culture of dread and silent disengagement.

Serious regulatory repercussions:

The dangers increase quickly at the organizational level. Employees may be putting private information into systems regulated by completely different privacy conditions when they paste internal data into uncontrolled AI settings. There may be serious regulatory repercussions; GDPR, HIPAA, and industry-specific compliance standards are in place specifically to safeguard the type of data that frequently passes through Shadow AI networks. Beyond data exposure, AI-generated code poses other subtle risks, such as concealed licensing conflicts, security flaws, and technical debt that only shows up months later and is costly to resolve. And all of this is taking place while businesses pay for the problem twice: first for the dispersed, redundant AI tools that staff members are obtaining on their own, and again for incident cleanup.

Cultural effects may be the most detrimental long-term effect. Shadow AI increases the discrepancy between an organization’s stated values and reality on the ground. Governance loses credibility when practice and policy vary on a large scale. Because they can clearly see that the rules are habitually broken in order to complete tasks, employees cease taking compliance seriously. The leadership is no longer able to see how the task is being done. Employers and employees, businesses and their clients, and workers and the AI tools they use without supervision or training all see a decline in trust.

Blocking not the solution:

Blocking tools are not the solution, or at least they are insufficient. Instead of completely eradicating Shadow AI, organizations that just use prohibition tend to drive the practice more underground. Asking “why are employees reaching for unauthorized AI, and what would make the sanctioned alternative genuinely better?” rather than “how do we stop employees from using unauthorized AI,” is the most effective way to respond. A more effective set of treatments is made possible by that reframing. Compared to the shadow alternatives, approved AI solutions must be quicker, more powerful, and simpler to use. Employees will continue to circumvent the official choice if it takes three approval processes and yields subpar outcomes.

When guardrails and enablement are used in tandem, it truly works. Red lines, which are categories of data that must never leave sanctioned settings, such as customer records, source code, and confidential strategy, must be explicitly defined by organizations and communicated in plain language rather than policy-document verbiage. For higher-risk use cases, they require lightweight review procedures so that workers may complete tasks safely rather than covertly. Training is important, but only if it is useful. Employees must be aware of the dangers they are incurring as well as the safe options at their disposal. Culture matters most of all. AI governance works when employees see it as protection rather than punishment — when the organization’s position is “we want you to use AI well” rather than “we are watching for violations.”

Conclusion:

In the end, shadow AI is more of a trust issue than a technological one. Using the greatest resources at their disposal, employees are attempting to thrive inside their businesses rather than undermine them. Organizations that invest in making safe AI truly useful—fast enough to compete with shadow tools, governed enough to manage real risk, and human enough to account for the pressures workers actually face—will be the ones that successfully navigate the AI era rather than those with the strictest prohibition policies. It’s important to pay attention to the silent rebellion. The question is whether corporations will react with control or with something more intelligent: intentional trust-building, one controlled tool at a time.


Quotients is a platform for industry, innovators, and investors to build a competetive edge in this age of disruption. We work with our partners to meet this challenge of metamorphic shift that is taking place in the world of technology and businesses by focusing on key organisational quotients. Reach out to us at open-innovator@quotients.com.

Categories
Events

Report: Who Owns AI Accountability? Security, Legal, Compliance, or the Boardroom?

Categories
Events

Report: Who Owns AI Accountability? Security, Legal, Compliance, or the Boardroom?

Open Innovator, on May 21, 2026, hosted a virtual session that brought together four senior leaders across cybersecurity, technology, finance, and compliance to answer one of the defining questions of the AI era: When AI fails inside an enterprise, who picks up the phone? The discussion was moderated by Agrima Sharma and co-hosted by Ananya Gulati.

As it is known, Open Innovator is a thought leadership platform that convenes cross-functional leaders from technology, security, legal, compliance, and the C-suite to tackle the most pressing challenges at the intersection of innovation and accountability. Through live panel discussions, recorded sessions, and community-driven conversations, OI creates a space where practitioners speak plainly about what governance, risk, and responsible deployment really look like on the ground.

Speaker Profiles

Josh Scarpino — Cybersecurity & AI Governance Leader

Josh Scarpino brought a cybersecurity-first lens to AI accountability. He referenced the ARISE framework, which advocates unifying governance across ethics, legal, security, and AI oversight functions into a single operational model. He drew parallels between AI governance failures and longstanding cybersecurity lapses, arguing that organisations are measuring the wrong things — treating governance as a documentation exercise when it must be a demonstrable, measurable practice.

Will Lassalle — CTO & CISO

Will Lassalle spoke from the dual perspective of a technology and security executive, arguing that poorly engineered AI solutions — not just poor governance — are at the root of failures like the Rite Aid case. He emphasised the importance of AI operating committees, controlled deployment, and accountability at the C-suite level. He pushed back firmly against placing sole responsibility on the CISO, calling it both unfair and structurally flawed.

Olivia Phillips — Cybersecurity & Compliance Leader

Olivia Phillips brought the lens of structured, military-grade accountability to the discussion. Drawing on her government background, she advocated for explicit ownership at every layer of the enterprise — from the code level to the board — with clear structures that eliminate ambiguity when something goes wrong. She raised an important point about AI as an insider threat once deployed, requiring ongoing monitoring, re-evaluation, and access governance.

JC Spierer — Finance, Investment & AI Strategy Advisor

JC Spierer introduced the often-overlooked role of finance and investment committees in AI governance, coining the term “prosumer paradox” to describe how business users across organisations — including board members — are adopting AI tools informally, outside of IT oversight. He used BlackRock as an example of an organisation that successfully aligns risk with reward at scale, and raised thought-provoking questions about how accountability for agentic AI systems can be enforced.

Key Insights from the Discussion

1. The Rite Aid Case: A Leadership Failure, Not a Technology Failure

The session opened with the story of Rite Aid Pharmacy — a Fortune 200 company that installed facial recognition cameras in hundreds of stores, built the system using tens of thousands of low-quality images, and deployed it without rigorous testing. The result: innocent customers were flagged as shoplifters, followed through stores, searched, and in some cases had police called on them.

The key insight from the panel: this happened not because the technology was exotic or the company was reckless, but because no one in the leadership pipeline asked who owned the decision. Engineers assumed legal reviewed it. Legal assumed security had audited it. Security assumed compliance signed off. Compliance assumed the board had authorised it. No one had.

2. Accountability Is a Board-Level Obligation — But Responsibility Is Shared

All four speakers converged on a nuanced view: ultimate accountability must sit at the board or CEO level, but every function — engineering, security, legal, compliance, product — carries responsibility for its part of the pipeline.

The cybersecurity governance leader made the analogy to cybersecurity: just as “security is everybody’s responsibility” is the accepted norm for protecting against phishing and human error, so too must AI risk be owned across functions. But when it comes to technology deployed at organisational scale, there must be a distinct, senior-level accountability holder — not a committee that diffuses blame.

3. The CISO Is Being Unfairly Scapegoated

A recurring theme was the industry’s troubling tendency to land all AI accountability on the CISO. Speakers agreed this is both structurally wrong and operationally dangerous.

The cybersecurity and compliance leader noted that the CISO has historically been the “scapegoat” in security failures, and AI is following the same pattern. The CTO & CISO referenced peers who now joke that CISO stands for “Career Is Soon Over” — a reflection of unrealistic expectations placed on a single executive.

The panel’s consensus: the CISO is well-positioned to manage security risk and compliance best practices, but should not be the sole owner of AI governance. A cross-functional AI Operating Committee or AI Governance Committee, with representation from all business units and accountability at the C-suite level, is the right structure.

4. Governance Must Be Operational, Not Just Documented

The cybersecurity governance leader challenged the common enterprise approach of treating AI governance as a documentation problem — policies, frameworks, audit checklists. His argument: documentation governs human behaviour, but autonomous systems behave differently.

When an AI model drifts from its original parameters, or when a deployment decision was made based on policies that have since become outdated, point-in-time audits will not catch the issue. Governance must be continuous, measurable, and tied to demonstrable system behaviour.

A recent statistic cited during the session: 78% of organisations cannot confidently submit an independent AI governance audit within 90 days. That means roughly 4 out of 5 companies do not fully know what they have built and deployed.

5. The Prosumer Paradox: AI Is Already Inside the Boardroom

The finance and AI strategy advisor introduced one of the session’s most distinctive concepts: the prosumer paradox. Half the people in any boardroom are likely already using AI tools — on their laptops, on their phones — without formal IT oversight. These prosumers are not doing anything malicious; they are simply trying to be productive. But they are taking on risk the organisation has not accounted for on its balance sheet.

His point: the finance and investment committee is often the first to know about AI adoption at scale, because at some point, money must be allocated or approved. Bringing this committee into AI governance structures earlier is an underutilised lever.

6. Speed vs. Safety: The Hot Take Debate

The panel debated a pointed hot take: “Companies that move fast on AI and skip governance will win by 2028. The cautious ones will be acquired or irrelevant.”

The responses reflected the complexity of the real landscape:

  • Finance & AI Strategy Advisor (nuanced yes/no): If you move fast and move right, you will win. But velocity without direction leads to crashes, not victories.
  • Cybersecurity & AI Governance Leader (disagrees): Recent legal precedents — including a judge ruling that a venture capital firm could be held liable for advising a portfolio company to cut cybersecurity budgets — signal a coming shift. Organisations that ignore foundational governance will become uninvestable.
  • CTO & CISO (it depends): The jury is out. If everyone rushes in without governance, the most cautious organisations may end up being the only ones still standing.
  • Cybersecurity & Compliance Leader (history repeats itself): The COVID-era remote work rush created BYOD governance failures that took years to resolve. AI is following the same arc. Governance cannot chase deployment; it must run alongside it.

The panel’s collective conclusion: you can build boldly and govern well at the same time. The two are not in opposition.

7. Agentic AI Raises Accountability Questions No One Has Answered Yet

The finance and AI strategy advisor raised the session’s most forward-looking concern: agentic AI — systems that not only execute tasks but train themselves and exercise a degree of independent agency — creates accountability structures that existing governance models are not equipped to handle.

If an agentic AI goes awry, with good intention but bad outcomes, how do you hold it accountable in any meaningful sense? How do you assign consequences? The panel acknowledged there are theoretical answers — including proxy accountability assigned to the human responsible for the system — but noted that no enterprise governance framework has operationalised this yet.

The cybersecurity governance leader added a technical concern: a shared knowledge layer across agentic systems — often proposed as a governance solution — also creates a single, high-value attack vector. If compromised, it could bias an entire agentic workflow.

Conclusion

The session closed with the moderator drawing together the central thread: AI does not fail because technology is broken. It fails because no one in the room raises their hand and says, “That’s my responsibility.”

The Rite Aid case was not an outlier. It was a preview. Across industries, organisations are deploying AI systems with unclear ownership, untested assumptions, and governance frameworks that exist on paper but not in practice.

The panel’s unified message to every leader in attendance: go back to your organisation tomorrow and find the person who is supposed to raise that hand. If you cannot name them, that is not a technology problem. That is your problem. A Part 2 of this conversation is planned, given the depth of interest and the volume of questions that could not be addressed in the session.


This report is based on the recorded panel discussion hosted by Open Innovator on May 21, 2026. All insights are attributed to the respective speakers.

Categories
DTQ

Report: From AI Execution to AI Ownership – Building Teams That Delivers Value

Categories
DTQ

Report: From AI Execution to AI Ownership – Building Teams That Delivers Value

BEYOND THE COGNITIVE COPILOT: TECH LEADERS WARN OF AN ‘ILLUSION OF PROGRESS’ IN ENTERPRISE AI ADOPTION

DTQ convened a high‑impact masterclass to interrogate the state of enterprise AI adoption. The session, led by Abhishek Kulkarni (technology risk and InfoTech leader), challenged prevailing narratives of “success” in corporate AI programs. The purpose was to expose systemic blind spots and equip leaders with a governance‑driven roadmap for 2026.

As corporate investments in artificial intelligence accelerate, a critical systemic flaw is emerging within the enterprise landscape: organizations are mastering the art of AI execution, but completely failing at AI ownership.

During the virtual masterclass addressing the path to future-ready enterprise leadership, Abhishek Kulkarni, a prominent technology risk and InfoTech leader, challenged the current corporate obsession with rapid tool deployment. The central argument? While enterprises have successfully moved past basic capability doubts, they are stalling out at the Minimum Viable Product (MVP) stage because no one is taking structural accountability for the final business outcomes.

The Strategic Shift: From Running Engines to Steering Vessels

The tech risk expert highlighted that the era of treating AI as a mere sandbox experiment is officially over. Today’s boardrooms are no longer asking if a workflow can be automated—they are demanding to know who stands accountable when an automated workflow goes rogue.

The industry evolution is captured by a stark division between past execution milestones and current ownership obligations:

Technical Execution Focus (The Engine)Enterprise Ownership Mandate (The Steering Wheel)
Can AI automate this workflow?Who are the definitive human end-users?
How fast can we launch an MVP?What measurable business value is being created?
Which platform or copilot should we buy?Who signs off on data decisions and model ethics?
How do we maximize productivity metrics?How do we secure long-term enterprise equity?

“Execution is the fuel, the speed, and the engine,” the speaker noted during the session. “But without defined accountability and outcome measurement, execution is just an aggressive, directionless expenditure of effort.”

Case Study: The Ghost in the Onboarding Machine

To anchor this problem in real-world stakes, a case study involving a recently deployed generative AI onboarding system was presented. On paper, the project was a resounding success—it significantly cut down customer transaction processing times and optimized data ingestion pipelines.

However, a structural compliance audit revealed an organizational vacuum:

  • The Infrastructure: The technology development team claimed complete ownership of the underlying code and models.
  • The Perimeter: The risk and cyber security teams took ownership of the deployment guardrails.
  • The Consequences: When asked who structurally owned the actual business outputs and operational decisions made by the AI, the room went entirely silent.

This siloed approach exposes a dangerous corporate reality: technical teams are managing the tools, but no business entity is managing the outcomes.

Exposing the “Illusion of Progress”

The core takeaway of the briefing was the concept of the Illusion of Progress. High corporate activity, constant pilot program announcements, and widespread copilot usage often create a false sense of security. In reality, this technical velocity represents only the visible tip of an operational iceberg, concealing deep structural liabilities beneath the surface.

The Three Critical Fault Lines:

  • The IT Ticket Fallacy: When an enterprise model behaves erratically, organizations treat it as a technical glitch by default, routing it to IT support. True ownership must belong to the functional business leader (e.g., the Head of Customer Onboarding) who relies on that system.
  • The “Build vs. Buy” Escalation Void: Modern enterprises rarely build models from scratch; they fine-tune pre-existing third-party architectures. When a fine-tuned model exhibits unpredictable biases, corporations frequently lack any pre-defined legal or operational escalation framework to resolve the breakdown.
  • Fragmented Corporate Silos: Responsibility is currently fractured. Tech teams own the deployment, product teams own the features, and support teams manage the fallout. Without a unified framework, holistic management of business value remains impossible.

The 2026 Action Plan for Leadership

To successfully convert AI execution into sustainable enterprise asset value, the briefing concluded with three mandatory directives for technology and operational leaders:

  1. Mandate Business-Side Product Owners: Stop assigning AI tools exclusively to IT. Every tool in production must have a designated business champion who is legally and operationally accountable for its outputs.
  2. Shift KPIs to Value Pools: Evaluate AI teams based on structural business outcomes (such as risk mitigation, customer retention, or cost reduction) rather than tool adoption metrics or engineering speed.
  3. Establish Cross-Functional Governance: Replace fragmented team silos with a unified decision governance framework that spans tech, security, legal, and operational leadership across the entire life cycle of the automated asset.

Conclusion

DTQ’s masterclass reframed AI adoption as a governance and accountability challenge. The warning was clear: without ownership, enterprises risk mistaking motion for progress. The path forward demands structural accountability, outcome‑driven KPIs, and unified governance to transform AI from a technical experiment into a sustainable enterprise asset.

Data Trust Quotients (DTQ) as a strategic ecosystem architect, bridges gaps between industry, startups, and investors. DTQ blends data privacy, governance, and cutting-edge AI to accelerate transformative breakthroughs in different domains.

Categories
DTQ Data Trust Quotients

Report: The Last Mile of AI- Why Governance and Trust Are the New ROI in 2026

Categories
DTQ Data Trust Quotients

Report: The Last Mile of AI- Why Governance and Trust Are the New ROI in 2026

The Evolution of the AI Narrative

In the initial gold rush of Generative AI, the global conversation was dominated by three pillars: speed, experimentation, and raw capability. Organizations raced to integrate Large Language Models (LLMs) into their workflows, driven by a “fear of missing out” and the allure of unprecedented productivity gains. However, as we move through 2026, the narrative has fundamentally shifted. The industry has reached a critical inflection point where the novelty of AI has worn off, replaced by a sobering realization of the complexities involved in actual production.

Ashwini Giri, a renowned Architect of Data Trust and Responsible AI, recently led a masterclass titled at DTQ “The Last Mile of AI.” The core question he posed to a room of executives and engineers was simple yet profound: How do we build and deploy AI systems that people can actually trust?

The “last mile” of AI deployment—the transition from a successful laboratory prototype to a reliable, live enterprise system—is where most real-world challenges surface. It is the bridge between a conceptual “cool tool” and a mission-critical business asset. In this virtual masterclass, Giri explored why the path to production is paved with governance, why trust has become the ultimate market differentiator, and how organizations must pivot to survive the transition from AI hype to AI responsibility.

Why Trust Matters: The New Corporate Frontier

We are currently operating under intense AI adoption pressure. Boardrooms, executive committees, and venture capitalists are no longer asking if AI should be integrated, but how fast it can happen. This pressure is driven by the hunt for Return on Investment (ROI). Yet, beneath the surface of this enthusiasm lies a deep-seated fear: the erosion of customer trust.

In the digital economy, trust is not an abstract virtue; it is a tangible asset. It is the differentiator that separates ordinary firms from “blue-chip” organizations. A blue-chip company isn’t defined just by its revenue, but by its reliability and the degree to which it safeguards customer data.

Data integrity serves as the bedrock of this trust. If an AI system hallucinates, leaks sensitive information, or makes biased decisions, the damage to the brand is often irreparable. As Giri notes, organizations are beginning to realize that while models are replaceable, the trust of a customer base, once lost, is nearly impossible to regain.

The Production Paradox: Why AI Projects Fail

To illustrate the gap between expectation and reality, Giri conducted an icebreaker poll asking: “Why do AI projects fail in production?” While many participants initially pointed toward technical hurdles like lack of compute power or poor model accuracy, the definitive answer was weak data quality and governance.

This is the production paradox: we spend millions on sophisticated algorithms, yet the systems fail because of the data they consume. Models are essentially mirrors; they reflect the quality of the input data. Without governance, there is no traceability, no accountability, and no ethical guardrail. Technical limitations are rarely the deal-breaker in 2026; rather, it is the lack of robust processes and oversight that causes projects to collapse at the finish line.

The Current Reality: A Landscape of Jittery Leaders

Despite the billions invested, the statistics regarding AI success remain startling. According to recent McKinsey reports, approximately 80% of AI programs fail to deliver their intended results.

These failures are not just academic; they carry a massive financial burden. Abandoned projects result in losses totaling millions of dollars, leaving ROI expectations unmet and shareholders frustrated. This has created what Giri describes as a “Trust Deficit.” Currently, only 30–35% of business leaders fully trust their data lineage. They lack clarity on:

  • Data Origin: Where did this information come from?
  • Data Flow: How has this data been transformed as it moved through our systems?
  • Integrity: Can we rely on this output to make a multi-million dollar decision?

This uncertainty has left leadership feeling tentative and “jittery.” When a leader cannot explain why an AI arrived at a specific conclusion, they are understandably hesitant to deploy it in high-stakes environments.

The Organizational Response: New Guardians of the Machine

To combat this deficit, a new corporate structure is emerging. We are seeing the rise of specialized leadership roles: the Chief AI Officer (CAIO) and the Chief Trust Officer (CTrO).

These roles are not merely bureaucratic additions; they are the guardians of the “last mile.” Their purpose is to:

  1. Establish Governance Frameworks: Implementing the “rules of the road” for how AI is developed and deployed.
  2. Safeguard Datasets: Ensuring that the fuel for the AI engine is clean, ethical, and legally compliant.
  3. Provide Board-Level Assurance: Translating technical AI metrics into business confidence.
  4. Enable Traceability: Creating systems where every AI-driven decision can be traced back to its source system.

Transparency is becoming a standard feature rather than an afterthought. For example, modern iterations of tools like Microsoft Copilot now prioritize showing the sources for generated responses. This “show your work” approach is essential for building confidence. When a user can see the citation, the AI moves from being a “black box” to a transparent partner.

Key Takeaways: Mastering the Last Mile

The masterclass concluded with several foundational insights that every modern organization must internalize:

  • Trust is the Differentiator: In a world where everyone has access to the same LLMs, the company that can prove its AI is safe and reliable will win the market.
  • The Bottleneck is Human, Not Technical: Data quality and governance are the real hurdles. Solving the math is easy; solving the data lineage is hard.
  • Failure is Visible: Unlike back-office software failures of the past, AI failure is often public and reputationally devastating.
  • Traceability is Mandatory: Board assurance cannot be based on “vibes” or general optimism; it must be based on a documented trail of data.

The “last mile” challenge is ultimately a shift in focus. It is not about how fast you can launch, but about how well you can govern.

Strategic Implications: A Roadmap for the Future

For organizations looking to bridge the gap between experimentation and safe deployment, Giri outlines a strategic roadmap focused on four key pillars:

1. Invest Heavily in Governance

Organizations must build frameworks that prioritize lineage and accountability. This means investing in tools that catalog data, track model versions, and monitor for bias in real-time. Governance should not be viewed as a “brake” on innovation, but as the seatbelt that allows the car to go faster safely.

2. Elevate the Roles of Trust

The Chief AI and Chief Trust Officers must have a seat at the table. They should be empowered to veto projects that do not meet ethical or data-quality standards. Their success should be measured by the organization’s resilience against AI-related risks.

3. Prioritize Data Integrity over Model Complexity

A simple model trained on pristine, high-quality data will almost always outperform a complex model trained on “garbage” data. The focus must shift from chasing the latest parameter counts to perfecting the internal data supply chain.

4. Cultivate a Cultural Shift

The organization must move from “AI Hype”—where the goal is simply to use AI—to “AI Responsibility.” This involves training employees not just on how to use prompts, but on how to critically evaluate AI outputs and understand the ethical implications of the technology.

5. Redefine Success Metrics

ROI remains important, but it is no longer the only metric. Organizations must include Trust Metrics and Governance Compliance in their KPIs. Success should be defined by how many stakeholders feel confident in the system, how transparent the decision-making process is, and how well the organization adheres to emerging global AI regulations.

Conclusion: Doing AI Right

The “last mile” of AI is arguably the most difficult part of the journey. It requires a transition from the creative, “break things” energy of a startup to the disciplined, “protect the asset” mindset of a mature enterprise. As Ashwini Giri emphasized, the goal isn’t just to do AI—it’s to do AI right. By prioritizing governance and trust today, organizations aren’t just protecting themselves from failure; they are building the foundation for the next decade of digital leadership. In 2026 and beyond, the fastest way to the finish line is a safe, governed, and transparent path.

Data Trust Quotients (DTQ) as a strategic ecosystem architect, bridges gaps between industry, startups, and investors. DTQ blends data privacy, governance, and cutting-edge AI to accelerate transformative breakthroughs in different domains.

Categories
DTQ Events

Report: From Accuracy to Accountability- What Should We Really Measure in AI Systems

Categories
DTQ Events

Report: From Accuracy to Accountability- What Should We Really Measure in AI Systems

The rapid acceleration of artificial intelligence adoption has brought with it a fundamental shift in how we evaluate technological success. Traditionally, AI systems have been judged primarily on performance metrics such as accuracy, precision, and speed. However, as these systems move from controlled environments into real-world applications—impacting healthcare, governance, finance, and everyday decision-making—the limitations of these metrics have become increasingly evident.

The Data Trust Quotients (DTQ) recently convened a thought‑provoking discussion titled “From Accuracy to Accountability: What Should We Really Measure in AI Systems?” The dialogue tackled a critical shift in how we evaluate AI: is accuracy alone sufficient, or should accountability, trust, and human impact take precedence. The virtual session explored the growing realization that high-performing models can still fail in practice if they lack proper governance, transparency, and ethical grounding. As organizations race toward rapid deployment, the need to redefine evaluation frameworks for AI systems has never been more urgent.

Speakers

  • Naman Kothari – NASSCOM COE (Moderator)
  • Anniliza Crasta – Director, Information Security, Juniper Networks
  • Sneha Pillai – Data Protection Lawyer, Bosch Middle East
  • Abhishek Tripathi – Head of Cybersecurity & IT Operations
  • Himanshu Parmar – Senior Manager, AI, NASSCOM COE

Key Insights from the Discussion

1. The AI Adoption Paradox

The session opened by highlighting a striking imbalance in the current AI ecosystem. On one hand, there is unprecedented enthusiasm and investment, with billions of dollars flowing into AI development and a majority of enterprises actively integrating generative AI into their operations. On the other hand, there is a significant lack of preparedness when it comes to managing the risks associated with these systems. Organizations are under immense pressure to deploy AI quickly in order to remain competitive, yet only a small fraction feel confident in their ability to implement proper safeguards. This creates a paradox where speed is prioritized over safety, leading to fragile systems that may not withstand real-world complexities.

2. Accuracy as a Misleading Benchmark

A key theme throughout the discussion was the idea that accuracy, while important, can often be a misleading indicator of success. Examples were shared where models achieved near-perfect accuracy in testing environments but failed dramatically once deployed. These failures were not due to flaws in the mathematical models themselves but rather due to unaddressed external factors such as biased data, changing environments, and lack of human oversight. This highlights a critical gap between theoretical performance and practical reliability. In real-world scenarios, systems must operate under uncertainty, adapt to new conditions, and interact with human users—factors that accuracy metrics alone cannot capture.

3. The Shift from Accuracy to Trust

As AI systems take on more complex and sensitive roles, there is a growing recognition that trust is becoming the ultimate measure of success. Trust encompasses multiple dimensions, including fairness, transparency, reliability, and security. Organizations are beginning to move away from purely technical metrics toward a more holistic evaluation framework that considers how systems behave over time and how they are perceived by users. This shift reflects a broader understanding that AI systems must not only perform well but also inspire confidence among stakeholders.

4. Hidden Risks Across the AI Lifecycle

One of the most significant insights from the discussion was the identification of risks that are often overlooked during the development and deployment of AI systems. These risks are not confined to a single stage but span the entire lifecycle:

  • Data-related risks: Biases embedded in datasets, errors in labeling, and poor data quality can significantly impact outcomes.
  • Design assumptions: Many systems are built on implicit assumptions that are neither documented nor tested, leading to unexpected behavior.
  • Context drift: The environment in which a model operates can change over time, reducing its effectiveness.
  • Post-deployment gaps: Once a system is deployed, accountability often becomes unclear, and continuous monitoring is neglected.

These blind spots can lead to failures even when initial performance metrics appear satisfactory.

5. The Complexity of Global Regulations

The discussion also highlighted the challenges posed by the lack of a unified global standard for AI governance and data privacy. Different regions have developed their own regulatory frameworks, each with unique requirements and expectations. This creates a complex landscape for organizations operating across multiple jurisdictions. Systems that are compliant in one region may not meet the standards of another, requiring constant adaptation. The evolving nature of these regulations further complicates the situation, making compliance an ongoing process rather than a one-time achievement.

6. Security as an Integral Design Element

Another important takeaway was the need to rethink how security is approached in AI systems. Instead of treating security as a final checkpoint before deployment, it must be integrated into every stage of development. This involves designing systems with security considerations from the outset, ensuring that vulnerabilities are addressed early rather than patched later. Such an approach not only reduces risks but also aligns with the fast-paced nature of AI development, where late-stage changes can be costly and disruptive.

7. Real-World Deployment Challenges

When AI systems are deployed in real-world environments, a range of operational challenges emerges. These include over-permissioned systems that have access to more data than necessary, lack of domain-specific constraints, and insufficient control mechanisms. In some cases, AI agents may perform tasks beyond their intended scope, leading to unintended consequences. These issues underscore the importance of clearly defining the boundaries within which AI systems operate and ensuring that they are aligned with their intended purpose.

8. The Emergence of Shadow AI

The increasing accessibility of AI tools has led to the rise of “shadow AI,” where individuals within organizations use AI systems independently without proper oversight. While often driven by a desire to innovate or improve efficiency, this practice introduces significant risks. Sensitive data may be exposed, and untested systems may be integrated into workflows without adequate safeguards. Addressing this challenge requires both technical solutions and a cultural shift toward responsible AI usage.

9. The Challenge of AI Hallucinations

AI hallucinations—instances where systems generate incorrect or fabricated information—remain a persistent issue. Despite advancements in model design, these errors cannot be entirely eliminated. Instead, organizations must focus on mitigating their impact through validation mechanisms and oversight processes. This reinforces the need for layered accountability, where multiple checks are in place to ensure reliability.

10. Data as Both an Asset and a Challenge

While data is often described as the fuel of AI, the discussion revealed that managing data effectively is one of the most challenging aspects of AI development. Collecting high-quality data requires significant effort and resources, and legal restrictions can complicate cross-border data transfers. Even after data is collected and processed, it may not always meet the requirements for training effective models. This highlights the need for careful planning and validation at every stage of the data lifecycle.

11. The Importance of a Structured Data Strategy

A recurring theme was the lack of a comprehensive data strategy in many organizations. Without a clear framework for managing data, organizations risk inefficiencies and vulnerabilities. A robust data strategy should include classification, access control, and lifecycle management, ensuring that data is treated as a critical asset. Such an approach not only enhances security but also supports the development of more reliable AI systems.

12. Governance as the Backbone of AI System

Governance plays a crucial role in ensuring that AI systems operate within defined boundaries. It involves establishing policies, setting standards, and monitoring compliance throughout the lifecycle. Unlike operational management, governance focuses on creating the structures that guide decision-making. Effective governance ensures consistency, reduces risks, and supports the responsible use of AI.

13. Measuring Human Impact

One of the most important yet often overlooked aspects of AI evaluation is its impact on users. AI systems can influence behavior, decision-making, and societal outcomes in ways that are not immediately apparent. Evaluating these effects requires a long-term perspective and continuous monitoring. By considering human impact, organizations can ensure that their systems contribute positively to society.

14. Building Trust Through Design

Moving from compliance to trust requires a proactive approach to system design. Features such as transparency, user control, and data minimization can enhance trust and improve user experience. Trust is not built through policies alone but through consistent and predictable system behavior. By prioritizing user-centric design, organizations can create systems that are both effective and trustworthy.

15. The Need for Interdisciplinary Collaboration

The discussion emphasized the importance of collaboration between technical, legal, and business teams. As AI systems become more complex, no single discipline can address all the challenges involved. Bridging the gap between these domains is essential for developing systems that are both innovative and responsible.

Conclusion

The session underscores a critical shift in how AI systems should be evaluated. While accuracy remains an important metric, it is no longer sufficient on its own. The future of AI lies in building systems that are accountable, transparent, and aligned with human values. This requires a comprehensive approach that considers the entire lifecycle of AI systems, from data collection and model design to deployment and long-term impact. By expanding the scope of measurement to include trust, governance, and human impact, organizations can move toward a more responsible and sustainable AI ecosystem.

Categories
DTQ Events

Report: Transitioning to Agentic Cyber Defense

Categories
DTQ Events

Report: Transitioning to Agentic Cyber Defense

Introduction

DTQ recently convened a specialized session, “Transitioning to Agentic Cyber Defense to Counter Autonomous Threats,” to explore the evolution of defensive strategies in an era of self-evolving adversarial tactics. The online discussion framed “agentic defense” not merely as an upgrade in tooling, but as a strategic pivot from reactive, signature-based controls toward autonomous systems capable of reasoning and adapting within defined risk parameters.

The Speakers

The panel featured a cross-disciplinary group of leaders representing the financial, industrial, and consulting sectors:

  • Anindya Chatterjee — Assistant Director, EY Global Consulting Services
  • Pulkit Vohra — Senior Data Privacy Manager, Top UAE Financial Institution
  • Mohamed A. S. — AI Governance Architect
  • Sandeep Bansal — CIO, Aone Steel India Ltd
  • Sandeep Singh — Senior Manager, Genpact

Key Insights

The Changing Threat Landscape

  • Lowered Barriers to Entry: AI and automation allow low-skill actors to execute high-sophistication attacks. Phishing and credential harvesting are becoming indistinguishable from human activity.
  • Compressed Response Windows: The primary vulnerability is no longer just the “bad decision,” but the “unquestioned execution” of rapid, automated attacks.
  • Cognitive Overload: Traditional SOC workflows are structurally incapable of managing the current volume of alerts; governed automation is now a survival requirement.

Principles of Agentic Defense

  • Bounded Autonomy: Systems must operate within “guardrails.” High-confidence, low-risk actions can be fully automated, while high-impact shifts require human-in-the-loop (HITL) authorization.
  • Radical Transparency: Every autonomous action must be explainable and auditable, detailing the rationale and data inputs for regulatory and forensic purposes.
  • Collateral-Aware Logic: Systems must calculate the potential business impact (e.g., service downtime) before executing a defensive maneuver, with built-in “safe rollback” capabilities.

Governance and Accountability

  • Human-Centric Liability: Regardless of the level of autonomy, accountability remains with human stakeholders. Responsibilities must be clearly mapped across model owners and business leaders.
  • Policy-as-Code: Governance should be machine-readable, allowing agentic systems to enforce legal and internal constraints at the same speed as the threats they counter.
  • Cross-Functional Oversight: Alignment between Security, Legal, and Privacy teams is essential to define the boundaries of “acceptable” autonomous behavior.

Privacy and Data Strategy

  • Privacy-Preserving Telemetry: Implementation of data minimization and pseudonymization ensures that detection needs do not compromise privacy obligations.
  • Engineering-Led Privacy: Privacy cannot be a checkbox; it must be baked into the architecture and model training phases to prevent data “scope creep.”

Operationalization Strategy

  • Phased Deployment: Start with “low-hanging fruit,” such as quarantining known malware or blocking confirmed fraud, before scaling to complex decision-making.
  • Continuous Simulation: Use red-teaming and “chaos experiments” to test how autonomous playbooks behave under extreme or unpredictable stress.
  • Legacy Integration: Agentic capabilities should augment—not replace—existing SIEM, EDR, and IAM investments to ensure telemetry continuity.

Technical & Sector Considerations

Technical Design

  • Model Lifecycle Management: Rigorous versioning and drift detection are required to prevent adversarial manipulation of the defense models themselves.
  • Fail-Safe Defaults: When confidence scores are low, systems must default to “Alert Only” modes rather than taking disruptive actions.

Sector-Specific Applications

  • Financial Services: Focus on real-time fraud prevention and identity risk scoring while maintaining high explainability for regulators.
  • Industrial/OT: Priority is placed on Operator-Assist recommendations. Given the risk of physical damage, direct autonomous actuation must be approached with extreme caution.
  • Managed Services (MSSPs): Providers can act as a force multiplier by centralizing model management and threat intelligence for multiple clients.

Practical Recommendations for Leaders

  1. Tier Your Automation: Classify defensive actions by risk level. Automate the “obvious” and assist the “complex.”
  2. Codify Your Rules: Move from written PDFs to machine-executable Policy-as-Code.
  3. Enrich Your Context: Invest in high-quality telemetry (Identity, Asset, and Business process mapping) to improve the “reasoning” of agentic tools.
  4. Monitor the Models: Treat your security AI as a high-value asset; implement drift monitoring and adversarial testing.
  5. Foster Collaboration: Establish a cross-functional forum where Legal and IT define the rules of engagement together.

Conclusion

Agentic cyber defense is no longer a futuristic concept—it is an operational necessity. To successfully transition, organizations must balance the speed of AI with the wisdom of human oversight. By adopting a phased, risk-aware approach grounded in Policy-as-Code and explainable AI, security leaders can build a resilient posture that scales with the threat while remaining firmly under human control.

DTQ serves as a platform dedicated to mapping global industry shifts and providing “information capital” before it reaches the mainstream. in cybersecurity space. Please write us at open-innovator@quotients.com for more information.

Categories
Data Trust Quotients Events

Report: The AI vs. AI Digital Arms Race

Categories
Data Trust Quotients Events

Report: The AI vs. AI Digital Arms Race

March 6, 2026

The global technological landscape has reached a pivotal tipping point where the narrative of Artificial Intelligence has shifted from “assistance” to “autonomy.” We have officially entered an era of a digital arms race—a state where AI systems are simultaneously being engineered to compromise global infrastructure and to defend it.

In a landmark knowledge session organized by DTQ, a panel of elite practitioners from the banking, telecommunications, and aviation sectors convened to dissect this “AI vs. AI” phenomenon. The consensus was clear: the battlefield has moved beyond human reaction times. The security of our future now depends on how we architect the machines that fight on our behalf.

The session brought together three leading practitioners in AI-driven cybersecurity across banking, telecom, and aviation:

  • Dr. Sudin Baraokar – AI and quantum scientist, former Head of Innovation at SBI, architect of the Yono app (100M+ users), and builder of AI-native banking systems.
  • Daxesh Parikh – EVP at DoveLoft Limited, specializing in telecom-based authentication for government, banking, and fintech, working with major Indian banks on next-gen security beyond OTPs.
  • Sabarikumar KB – Group Manager & CSO at Airbus, with frontline SOC experience countering AI-generated attacks and expertise in aviation security architecture.

Moderator: Dr. Akvile, founder of System Akvile and CEO, participant in G20 AI governance discussions, with extensive work on AI in health and youth sectors

The Opening Salvo: From Tools to Combatants

The discussion opened with a provocative observation: technology is advancing at a velocity that has outpaced traditional oversight. Only a few years ago, AI was seen as a helpful tool for automation; today, it has become a primary combatant. Some systems are designed to create problems, while others are built to stop them, turning the digital landscape into a battle where one AI generates threats and another AI counters them—leaving humans as spectators to the unfolding drama.

This drama plays out through a sophisticated cycle: attackers deploy Large Language Models to craft flawless phishing campaigns, generate hyper-realistic deepfakes for social engineering, and automate brute-force hacking that can probe millions of vulnerabilities in seconds. In response, defensive AI is being woven into the fabric of networks, detecting anomalies and neutralizing threats at machine speed

Banking Infrastructure: Resiliency at 24,000 TPS

The primary concern for any digital economy is the stability of its financial heart. Dr. Sudin Baraokar, an AI and Quantum Scientist with a storied career at SBI, IBM, and GE, provided a masterclass on how banking infrastructure is evolving to survive an AI-native world.

The Scale of the Challenge

Dr. Sudin shared staggering benchmarks from his tenure as Head of Innovation at the State Bank of India (SBI). These figures provide the context for why traditional security is no longer sufficient:

  • Transaction Speed: Core banking systems are benchmarked at 24,000 transactions per second (TPS).
  • Daily Volume: Handling approximately 1.5 billion transactions daily.
  • Customer Reach: Protecting the data of 500 million customers across 700 million accounts.
  • The Yono Factor: The Yono digital lending app has now crossed 100 million users, representing a massive surface area for potential attacks.

The Shift to Artificial Superintelligence (ASI)

Dr. Sudin emphasized that the advent of AI and Gen AI allows banks to “talk to their data” in ways previously unimagined. The shift is moving away from static rules and manual libraries toward Security Model Management.

“Previously, we used to have a whole lot of templates and rules, but now it’s all model-driven,” he explained. This allows for a three-level approach to security:

  1. Level 1 (Business Rules & Intent): Establishing the foundational logic of what a transaction should look like.
  2. Level 2 (Reasoning): Using AI to analyze the context and intent behind system behavior.
  3. Level 3 (Decisioning): Enabling the system to take autonomous action to block a threat.

The Human Factor: The Persistent Weakest Link

Moderator Dr. Akvile, Founder and CEO of System Akvile, brought a grounding perspective to the high-tech discussion. Despite the billions of dollars invested in AI shields, she pointed out that the most frequent point of failure is still the human being sitting at the keyboard.

The “Grandmother” Scam and Deepfakes

Dr. Akvile highlighted a growing trend in European banking: the largest investments are no longer just in software, but in human education. She shared anecdotes of “grandmothers” in Germany giving away banking details to AI-generated voices claiming to be their granddaughters.

“Banks are doing a lot to protect from cyberattacks, but the biggest issue is still the person handling the account,” she remarked. Whether it is using “Password123” or sharing sensitive data on fraudulent web pages, human fallibility provides a backdoor that even the most advanced AI struggles to close.

The Value of Information

Working with young people in the health sector, Dr. Akvile expressed concern over the “value of information.” In an age of deepfakes and AI influencers, the public’s ability to distinguish reality from manipulation is eroding. This creates a secondary security risk: the manipulation of public opinion to trigger bank runs or healthcare panics.

The Telecom Backbone: Beyond the OTP

Daxesh Parikh, Executive Vice President at Dovelofts Limited, pivoted the conversation toward the “nervous system” of the digital world: Telecommunications. He argued that data theft is synonymous with “business paralysis.”

The RBI Mandate of 2026

In a significant update for the Indian BFSI sector, Parikh discussed the April 1, 2026, RBI mandate. The regulator is demanding a robust alternative to the One-Time Password (OTP) to prevent fraud and reduce friction.

“Fraudsters can weaponize SS7 and SIP protocols to intercept OTPs,” Parikh warned. The industry is moving toward Predictive Real-Time Authentication using the “crypto engine” already present in every SIM card.

The “Crypto Engine” Solution

By leveraging the unique cryptographic identity held by telecom operators, banks can verify a user’s identity without ever sending a text message. This “silent” authentication is already being used by Barclays Bank in Europe and is expected to become the global standard by 2030.

Frontline Defense: The Struggling SOC

Saba, Group Manager and CSO at Airbus, provided a reality check from the Security Operations Center (SOC). She confirmed that traditional detection tools are “struggling” because they were built to recognize historical patterns.

The Experimentation Advantage

Attackers now have the “experimentation advantage.” Instead of sending one phishing email, they can use AI to generate 100,000 variations, testing each one against common filters until they find a “perfect” version that looks like a genuine internal HR update.

The SOC Shift

To counter this, Saba outlined a necessary evolution for security teams:

  • Behavior Over Signatures: Stop looking for what a file “is” and start looking at what it “does.”
  • Correlation Over Isolated Events: Using AI to connect a harmless-looking login with an unusual data export.
  • Analytical Thinking: Analysts must move from being “tool operators” to “investigators.”

Security by Design in an AI-Native World

The panel agreed that “Security by Design” has fundamentally changed. It is no longer enough to secure the infrastructure (the “car”); you must secure the intelligence (the “driver”).

The Three Pillars of Model Security

Dr. Sudin and Saba identified three critical areas where AI-native systems must be protected:

  1. Training Data Security: Preventing “data poisoning” where an attacker injects malicious data into the AI’s learning set.
  2. Model Behavior: Implementing filters to prevent “prompt injection,” where a user tricks an AI into bypassing its own safety rules.
  3. Lifecycle Monitoring: AI systems “drift” over time. Continuous monitoring is required to ensure the AI doesn’t develop harmful biases or vulnerabilities as it learns from new data.

Compliance: The Floor, Not the Ceiling

A common mistake made by organizations is treating compliance (GDPR, ISO, India’s DPDP) as the goal. Saba argued that compliance is merely the floor—the absolute minimum baseline.

“Compliance moves at the speed of governance, but threats move at the speed of code,” she noted. An organization can be 100% compliant and still be 100% vulnerable. The goal must shift from “being compliant” to “being resilient.”

The 2036 Vision: Agentic and Autonomic Security

Looking toward the next decade, Dr. Sudin outlined a future of Agentic Security. In this world, security fabrics will function like a neural network—automated, autonomic (self-managing), and self-audited.

He compared this transformation to the current $5 trillion investment in AI hardware, such as NVIDIA’s Blackwell chips, which feature 200 billion transistors. “We need to accelerate our journeys across business, data, and technology just as fast as the hardware is accelerating,” he urged.

Conclusion: Fortune Favors the Prepared

The DTQ session concluded with a final round of advice for the next generation of entrepreneurs and leaders:

  • Dr. Sudin: “Don’t depend on particular LLMs. Build your own organizational Small Language Models (SLMs) to own your IP and security.”
  • Daxesh Parikh: “Fortune favors the brave. Take calculated risks, align with AI-routing platforms early, and don’t wait indefinitely for the ‘perfect’ time.”
  • Saba: “Do the basics first. HTTPS, MFA, and API security are the foundations. AI is the roof. You cannot build the roof before the foundation.”
  • Dr. Akvile: “Preserve humanity. As we use more AI, we must ensure we don’t lose our empathy and authenticity.”

Final Takeaways

  1. AI vs. AI is Reality: Organizations must fight automation with intelligence.
  2. The OTP is Dying: Prepare for hardware-based, cryptographic identity.
  3. Model-Driven GRC: Governance must be integrated into the AI’s reasoning layer from Day Zero.
  4. Education is Essential: The human link must be strengthened through constant awareness.

The “AI vs. AI” digital arms race is not a drama we can afford to watch from the sidelines. It is a fundamental shift in the human-machine relationship, and the winners will be those who build their defenses as intelligently as their offenses.

This DTQ Session provided essential insights on the AI vs. AI battleground in cybersecurity. Expert panel: Dr. Sudin Baraokar (AI/Quantum Scientist, former SBI Head of Innovation), Daxesh Parikh (DoveLoft Limited), and Saba (Airbus CSO). Moderated by Dr. Akvile. Write to us at open-innovator@quotients.com for participating and more information about our upcoming sessions.

Categories
Events Data Trust Quotients

From Data Privacy to Data Trust: The Evolution of Data Governance

Categories
Events Data Trust Quotients

From Data Privacy to Data Trust: The Evolution of Data Governance

Data Trust Quotient (DTQ) organized a critical knowledge session on February 20, 2026, addressing the fundamental shift from data privacy to data trust as AI systems scale across industries. The session explored a new category of risk: not just data theft, but quiet data manipulation that can make even the smartest AI make dangerously wrong decisions.

Expert Panel

The session convened four practitioners from highly regulated industries where data integrity is mission-critical:

Melwyn Rebeiro – CISO at Julius Baer, bringing extensive experience in security, risk, and compliance from ultra-regulated financial services environments, wearing both the Chief Information Security Officer and Data Protection Officer hats.

Rohit Ponnapalli – Internal CISO at Cloud4C Services, specializing in cloud security, enterprise protection, and cybersecurity for government smart city projects where real-time data integrity directly influences public infrastructure operations.

Ashwani Giri – Head of Data Standards and Governance at Zurich, working with enterprise privacy frameworks and regulators.

Mukul Agarwal – Head of IT with deep experience in IT strategy, systems, and digital transformation in the banking and financial services sector, bringing the skepticism and traceability mindset essential to financial industry operations.

Moderated by Betania Allo, international technology lawyer and AI policy expert based in Riyadh, working at the intersection of AI governance, cybersecurity, and cross-border regulatory strategy. Hosted by Data Trust (DTQ), a global platform bringing professionals together to share practices, address challenges, and co-create solutions for building stronger trust across industries.

The Shift: From Confidentiality to Verifiable Integrity

Regulators Are Changing Their Expectations

Ashwani opened by confirming the shift is happening at ground level as AI adoption increases. Organizations are preparing security documentation, having internal discussions, trying to understand what changes are required. Confidentiality was the past—now much more mature with clear understanding. The present focus: initiating discussions around veracity and verifiable data.

The Medical Prescription Analogy: Earlier, the idea was ensuring only the right people (patient and doctor) had access. Now the expectation is that nobody is altering the prescription in the background. With AI, the expectation is that data is not poisoned or drifting, that hallucinations and poisoning are prevented.

Regulators as Trust Enablers: Regulators enable trust in the social ecosystem. As AI adoption drives changes, they’re moving from simply asking access-related questions (IAM) to expecting cryptographic proof of truth, verifiable audit trails, immutable integrity checks, and mechanisms providing confidence that claimed data is actually true.

The Verification Challenge: Organizations are framing that they have bases covered, but when regulators try to verify, many cannot demonstrate it. Except for the most mature organizations with proper budgets and resourcing, most face this challenge—trying to understand changes before implementing them.

The Timeline: Similar to information security 15 years ago when organizations struggled with their own approaches, AI security faces similar challenges now. But this evolution will be much faster—5-10 years to reach maturity rather than decades.

AI Readiness Without Data Provenance Is Flying Without a Black Box

When asked if organizations can truly claim AI readiness without tracking who changed data and when, Ashwani was direct: AI readiness is definitely not there in many organizations. Provenance is absolutely essential.

The Right Thing, No Matter How Hard: Organizations should do the right thing regardless of difficulty. Provenance work is already happening in bits and pieces but not in structured format. Requirements include policies in place, dedicated teams (not stopgap arrangements), and full commitment—not pulling people just to support tasks.

The Stark Reality: AI readiness without rigorous data governance is like flying a commercial plane without a black box, without proof of provenance or source of truth. It will land nowhere.

Automation Requirements: Regulators expect automated readiness testing and red teaming (validation testing of processes) to ensure controls are designed properly and working without glitches. If automation is less than 80%, it’s a problem.

The Non-Negotiable Future: Regulators are signaling this now but will become more aggressive. Provenance will be non-negotiable. Without it, enterprises are building highly efficient black boxes.

Industry Readiness: Varied Responses to the Challenge

BFSI Leads, Others Follow at Their Own Pace

Different sectors respond differently. Banking, Financial Services, Insurance (BFSI) and healthcare—highly critical sectors—are early adopters responding well. Other industries respond at their own pace, some lagging behind, but everyone understands the importance.

The Leadership Ladder: Understanding and awareness exist. Behaviors are being introduced. Once understanding, awareness, behaviors, and ownership align, leadership emerges. AI leadership is still far away, but early adopters (especially BFSI) are doing well and having internal discussions to create right synergies.

No Choice But to Comply: Organizations understand this requirement is coming. They have no choice but to comply eventually.

The Vault Problem: Securing Contents, Not Just Containers

Mukul brought the financial services perspective with a critical observation: Skepticism is the word in BFSI. The industry doesn’t trust anything at face value unless traceability exists.

What Security Has Done Wrong: Traditional IT security secured the vault—fortifying infrastructure, ensuring nothing comes in, checking what goes out, logging and mitigating. But they haven’t verified what’s inside the vault.

The Critical Gap: Did someone with the absolute right key enter the vault and modify contents? Could be malicious intent or oversight. This is where data corruption matters.

Real-World Financial Risk: What if someone changed the interest rate for a customer’s loan for a specified period, reducing their outgo, causing damage of X amount to the financial institution, then reset it later? The change happened, reverted, damage was done, nobody noticed. This problem area lacks fair mitigation.

Insider Risk: The Blind Spot in Mature Security

Rohit emphasized this isn’t just about regulatory requirements—it’s about trust. Organizations have controls in place, but are they using those controls to monitor behavior changes or data changes?

The Maturity Imbalance: Security has organized as a fortress to prevent intrusion. Organizations are mature enough to prevent hackers from getting in. But there are fewer controls to tackle insider risk management—where data changes, data integrity, data accuracy, and data theft issues originate.

The Spending Gap: Leaving BFSI aside, other industries don’t spend much on tools. Organizations should start looking at insider threat and gaining trust from operations adapted to day-to-day life.

Zero Trust for Data: Beyond Access Control

Trust Nobody, Verify Everybody

Melwyn brought the perspective from Julius Baer’s highly regulated environment. Regulators are adopting zero trust—not trusting anybody, just verifying everybody. Whether insider or outsider, the boundary has completely changed.

The Regulatory Focus: Most regulators in India are focusing on having organizations adopt zero trust technology—trust nobody but always verify so legitimate users are the only ones accessing data.

The Evidence Requirement: If someone tries to tamper with data, at least you have logs or verifiable evidence that data has been tampered with and appropriate action can be taken.

From Access Zero Trust to Data Zero Trust

The zero trust mindset must extend directly to the data layer itself—continuously validating that information has not been altered.

The Shift Beyond Access: It’s not only about access control in zero trust, but also about the data itself. Always verify rather than trust the data. The source of data, integrity of data, and provenance of data must be verified in an irrefutable manner without tampering or malicious intent.

Why Data Is Everything: If there’s no data, there are no jobs for anyone in the room. Data is the critical aspect of decision-making and must be protected at all times.

The AI Attack Surface: Traditional cybersecurity techniques exist—encryption, hashing, salting. But with AI advent, various attacks are happening against data: injection, poisoning, and others.

The Survival Requirement: Focus must shift from zero trust access to zero trust data. Without it, organizations cannot make critical and crucial decisions and will not survive in a competitive, AI and ML-driven world.

Multi-Dimensional Accountability

Who Owns Risk When Data Is Quietly Manipulated?

In India, the trend shows most organizations still have CISOs taking care of data because they’re considered best positioned to understand both security and privacy requirements that the DPO job demands.

Different Layers of Ownership:

  • Data Owner: The reference point for data
  • CISO: Provides guardrails to guard data safety against malicious attacks
  • DPO: Concerned only with data privacy, ensuring it’s not impacted or hampered
  • Governance: Legal and compliance teams ensuring every control is covered

Shared Responsibility: Each member has their own job in the organizational chart and must do their part in protecting data. But ultimately, the board has overall responsibility and accountability to ensure whatever guardrails or safety measures allocated to data protection are in place and nothing is missing.

When Data Alteration Creates Public Safety Risks

Rohit brought critical perspective from smart city and government projects where personally identifiable information (PII) and sensitive personal data are paramount—not just for cybersecurity but for counterterrorism.

The Bio-Weapon Example: If data about blood group distribution leaked—showing a city has the highest number of O-positive blood groups—a bio-weapon could be created targeting only that blood group, causing mass casualties and impacting national reputation.

Real-Time Utility Monitoring: Smart cities don’t just hold privacy data; they monitor real-time use of public services by citizens. Traffic analysis, water management during seasonal changes, public Wi-Fi usage—all create critical data that, if tampered with, could cause chaos in city operations.

The Efficiency Question: Models exist to monitor data alteration and access, but are they efficient? Considering the scale of operations, monitoring capabilities, budget limitations, and whether they treat public safety with the same seriousness as corporate security—efficiency remains a question mark.

The Tool Gap: Industry-Specific Maturity

When it comes to infrastructure security or user security, good controls exist across industries with mature maintenance. But data access management is a question mark depending on industry.

BFSI Advantage: The Reserve Bank of India mandates database access management tools. They have controls because they have solutions. They can develop use cases, rules, and alerts for abnormalities, modifications, deletions, additions, direct database access.

The Budget Challenge: Outside BFSI, getting board approval for database access management tools requires a very strong use case or customer escalation. Without these tools, organizations rely on DB soft logs requiring manual review—cumbersome for humans to identify abnormalities and more like postmortem analysis.

Real-Time vs. Postmortem: Manual review might take six days to discover data modification. By then, damage is done. With DAM tools in place, organizations can get alerts and act in real-time with preventive and corrective controls.

Industry-Specific Reality: Controls are there but depend on how important security, integrity, and trust are to the board—determining what tools can be secured for data integrity monitoring.

Traditional Security Models Are Insufficient

Rohit identified a critical trend: Traditional data access had a system and a user or user-developed application. Controls were simple. Now there’s a third element: AI—self-adaptive, self-learning, and capable of directly accessing data.

Going Back to the Drawing Board: Everyone is returning to proper boards where they can define and design controls. The whole industry—technical people, operations teams—are validating whether traditional security controls are sufficient to handle AI operations.

The Use Case Problem: Concerns arise because controls must change for every use case. One AI tool might have eight use cases, each requiring different controls, different monitoring, different security on who’s accessing, what output is given, what data is accessed, privilege levels, potential injection attacks, and command exploitation.

Output Modification Threat: It’s not just about data modification. What if output is modified? Hackers don’t need to get into databases to modify data if they can modify output directly. This concern is getting significant attention.

The Level Question: Organizations must determine at what level they’re discussing data integrity—making it a complex, layered challenge.

Key Questions Defining Data Trust

Is Data Trust Just Rebranding Privacy?

Ashwani’s answer: Data trust is the next level of data privacy. Privacy focused on keeping data safe. The question now: Is the data you’ve kept trustable? Is somebody altering or changing it? Is it the right data collected in the first place?

End-to-End Protection: Ensuring you’re collecting data that’s right and fit for purpose, protecting it with all possible controls until consumption, and having the right pipeline protecting from end to end with proper lineage.

Traceability Requirement: You should be able to identify where trust is broken. If somebody altered data, you must be able to trace it.

The Future Parameter: Data trust is next-step beyond traditional data privacy controls—paramount for successful AI-driven organizations in the fully AI-driven era ahead.

The DPO Triad: As Rohit suggested to a DPO colleague—information security has three attributes (confidentiality, integrity, availability). For DPOs, it should be privacy, security, and trust defining overall governance.

Three Years Forward: Trusted vs. Just Compliant

Melwyn’s perspective: Trust is extremely important—going one level ahead of compliance. Compliance and trust are interchanging based on time differences.

Why Both Matter: Everyone wants to be compliant because penalties are high and heavy. Everyone wants to be trusted because without being a trusted brand or company, you’re out of business—competitors are already ahead.

The Reversal: Compliance is not driving trust. Trust is driving compliance. It’s a non-negotiable, hand-in-glove situation.

The Drinkable Water Example: Mukul provided a perfect analogy: Someone asks for water. Giving a glass of water is compliance. But was that water drinkable? That’s trust. Would you trust the person who gave drinkable water, or just take water from someone who was merely compliant?

No Shortcut to Trust: Ashwani emphasized trust cannot be bought with budget instantly. It takes time, requiring continuous good work to earn it. Trust is a real differentiator earned only by fixing things at ground level. There’s no shortcut to trust.

Compliance as Checkbox vs. Backbone

Rohit highlighted that compliance is a satisfaction factor for customers. When you want to prove you have good security controls, compliance comes into picture.

The Dangerous Trend: Compliance is becoming a checkbox, which should not be taken lightly. Compliance should be the backbone on which you build more security controls. Some organizations treat it as a checkbox saying they’re compliant, but effectiveness and efficiency remain questionable.

Priority Actions for the Next 24 Months

People, Process, Technology—In That Order

Ashwani’s Framework: Organizations must ensure right standards, policies, procedures, and mandates are in place. Identify the right people for the work and agree on RACI matrix (who’s responsible, accountable, consulted, informed) defining roles clearly.

Ground framework first. Other things are technology-related. Fixing the people part—the human factor—is always most important. Once you fix the human vector, everything else comes with much more ease.

Mindset and Culture Change

Melwyn’s Priority: The mindset must change when discussing privacy, data security, and integrity. Culture has to be there. Without the right mindset, culture, ethos, and ethics to govern, even the best controls, equipment, or security will not work.

The right mindset is the key to success.

Access Monitoring and Traceability

Rohit’s Focus: Culture is a never-ending job through awareness sessions and phishing simulations—always 10-20% violating despite efforts. But purely for trust, organizations have enough controls knowing who has access to systems.

Three Critical Questions: Focus on controls understanding who has access to systems or data, who is modifying data, and what is being modified. Answer these three questions and trust can be easily built.

Explainable AI with Human in the Loop

Mukul’s Guidance: Many organizations live in the hype of deploying AI and trusting their data with AI. There must be a human in the loop, and AI must be explainable.

Explainable AI with human in the loop is the keyword when trusting data with AI models. At least jobs are safe with this explanation—people are still needed to validate.

Conclusion: Trust Cannot Be Bought, Only Earned

The session revealed unanimous agreement: The future belongs to organizations with the most trusted data, not just the most data or the most advanced AI.

Trust is the cornerstone of AI-driven ecosystems. Provenance is non-negotiable. Zero trust must extend from access control to the data layer itself. Accountability is multi-dimensional across boards, executive leadership, technology teams, and legal compliance.

As India accelerates its AI ambitions (hosting the AI Summit during this session), embedding verifiable integrity at scale becomes essential—not only for foundational institutional credibility across sectors but for defining long-term leadership.

Key principles emerged: Do the right thing no matter how hard. Fix the human factor first. Treat compliance as backbone, not checkbox. Remember there’s no shortcut to trust—it must be earned through continuous good work fixing things at ground level.

The shift from data privacy to data trust represents the next evolution in data governance—moving from protecting data from unauthorized access to ensuring data remains true, accurate, and verifiable throughout its lifecycle in AI-driven systems.


This Data Trust Knowledge Session provided essential frameworks for organizations navigating the evolution from data privacy to data trust. Expert panel: Melwyn Rebeiro (Julius Baer), Rohit Ponnapalli (Cloud4C Services), Ashwani Giri (Zurich), and Mukul Agarwal (BFSI sector). Moderated by Betania Allo.

Categories
Data Trust Quotients DTQ Visibility Quotient

The AI Trust Fall: Building Confidence in an Era of Hallucination

Categories
Data Trust Quotients DTQ Visibility Quotient

The AI Trust Fall: Building Confidence in an Era of Hallucination

Data Trust Knowledge Session | February 9, 2026

Open Innovator organized a critical knowledge session on AI trust as systems transition from experimental tools to enterprise infrastructure. With tech giants leading trillion-dollar-plus investments in AI, the focus has shifted from model performance to governance, real-world decision-making, and managing a new category of risk: internal intelligence that can hallucinate facts, bypass traditional logic, and sound completely convincing. The session explored how to design systems, governance, and human oversight so that trust is earned, verified, and continuously managed across cybersecurity, telecom infrastructure, healthcare, and enterprise platforms.

Expert Panel

Vijay Banda – Chief Strategy Officer pioneering cognitive security, where monitors must monitor other monitors and validation layers become essential for AI-generated outputs.

Rajat Singh – Executive Vice President bringing telecommunications and 5G expertise where microsecond precision is non-negotiable and errors cascade globally.

Rahul Venkat – Senior Staff Scientist in AI and healthcare, architecting safety nets that leverage AI intelligence without compromising clinical accuracy.

Varij Saurabh – VP and Director of Products for Enterprise Search, with 15-20 years building platforms where probabilistic systems must deliver reliable business foundations.

Moderated by Rudy Shoushany, AI governance expert and founder of BCCM Management and TxDoc. Hosted by Data Trust, a community focused on data privacy, protection, and responsible AI governance.

Cognitive Security: The New Paradigm

Vijay declared that traditional security from 2020 is dead. The era of cognitive security has arrived like having a copilot monitor the pilot’s behavior, not just the plane’s systems. Security used to be deterministic with known anomalies; now it’s probabilistic and unpredictable. You can’t patch a hallucination like you patch a server.

Critical Requirements:

  • Validation layers for all AI-generated content, cross-checked by another agent using golden sources of truth
  • Human oversight checking if outputs are garbage in/garbage out, or worse-confidential data leakage
  • Zero trust of data-never assume AI outputs are correct without verification
  • Training AI systems on correct parameters, acceptable outputs, and inherent biases

The shift: These aren’t insider threats anymore, but probabilistic scenarios where data from AI engines gets used by employees without proper validation.

Telecom Precision: Layered Architecture for Zero Error

Rajat explained why the AI trust question has become urgent. Early social media was a separate dimension from real life. Now AI-generated content directly affects real lives-deepfakes, synthesized datasets submitted to governments, and critical infrastructure decisions.

The Telecom Solution: Upstream vs. Downstream

Systems are divided into two zones:

Upstream (Safe Zone): AI can freely find correlations, test hypotheses, and experiment without affecting live networks.

Downstream (Guarded Zone): Where changes affect physical networks. Only deterministic systems allowed-rule engines, policy makers, closed-loop automation, and mandatory human-in-the-loop.

Core Principle: Observation ≠ Decision ≠ Action. This separation embedded in architecture creates the first step toward near-zero error.

Additional safeguards include digital twins, policy engines, and keeping cognitive systems separate from deterministic ones. The key insight: zero error means zero learning. Managed errors within boundaries drive innovation.

Why Telecom Networks Rarely Crash: Layered architecture with what seems like too many layers but is actually the right amount, preventing cascading failures.

Healthcare: Knowledge Graphs and Moving Goalposts

Rahul acknowledged hallucination exists but noted we’re not yet at a stage of extreme worry. The issue: as AI answers more questions correctly, doctors will eventually start trusting it blindly like they trust traditional software. That’s when problems will emerge.

Healthcare Is Different from Code

You can’t test AI solutions on your body to see if they work. The costs of errors are catastrophically higher than software bugs. Doctors haven’t started extensively using AI for patient care because they don’t have 100% trust—yet.

The Knowledge Graph Moat

The competitive advantage isn’t ChatGPT or the AI model itself—it’s the curated knowledge graph that companies and institutions build as their foundation for accurate answers.

Technical Safeguards:

  • Validation layers
  • LLM-as-judge (another LLM checking if the first is lying)
  • Multiple generation testing (hallucinations produce different explanations each time)
  • Self-consistency checks
  • Mechanistic interpretability (examining network layers)

The Continuous Challenge: The moment you publish a defense technique, AI finds a way to beat it. Like cybersecurity, this is a continuous process, not a one-time solution.

AI Beyond Human Capabilities

Rahul challenged the assumption that all ground truth must come from humans. DeepMind can invent drugs at speeds impossible for humans. AI-guided ultrasounds performed by untrained midwives in rural areas can provide gestational age assessments as accurately as trained professionals, bringing healthcare to underserved communities.

The pragmatic question for clinical-grade AI: Do benefits outweigh risks? Evaluation must go beyond gross statistics to ensure systems work on every subgroup, especially the most marginalized communities.

Enterprise Platforms: Living with Probabilistic Systems

Varij’s philosophy after 15-20 years building AI systems: You have to learn to live with the weakness. Accept that AI is probabilistic, not deterministic. Once you accept this reality, you automatically start thinking about problems where AI can still outperform humans.

The Accuracy Argument

When customers complained about system accuracy, the response was simple: If humans are 80% accurate and the AI system is 95% accurate, you’re still better off with AI.

Look for Scale Opportunities

Choose use cases where scale matters. If you can do 10 cases daily and AI enables 1,000 cases daily with better accuracy, the business value is transformative.

Reframe Problems to Create New Value

Example: Competitors used ethnographers with clipboards spending a week analyzing 6 hours of video for $100,000 reports. The AI solution used thousands of cameras processing video in real-time, integrated with transaction systems, showing complete shopping funnels for physical stores—value impossible with previous systems.

The Product Manager’s Transformed Role

Traditional PM workflow–write user stories, define expectations, create acceptance criteria, hand to testers–is breaking down.

The New Reality:

Model evaluations (evals) have moved from testers to product managers. PMs must now write 50-100 test cases as evaluations, knowing exactly what deserves 100% marks, before testing can begin.

Three Critical Pillars for Reliable Foundations:

1. Data Quality Pipelines – Monitor how data moves into systems, through embeddings, and retrieval processes. Without quality data in a timely manner, AI cannot provide reliable insights.

2. Prompt Engineering – Simply asking systems to use only verified links, not hallucinate, and depend on high-quality sources increases performance 10-15%. Grounding responses in provided data and requiring traceability are essential.

3. Observability and Traceability – If mistakes happen, you must trace where they started and how they reached endpoints. Companies are building LLM observation platforms that score outputs in real-time on completeness, accuracy, precision, and recall.

The shift from deterministic to probabilistic means defining what’s good enough for customers while balancing accuracy, timeliness, cost, and performance parameters.

Non-Negotiable Guardrails

Single Source of Truth – Enterprises must maintain authentic sources of truth with verification mechanisms before AI-generated data reaches employees. Critical elements include verification layers, single source of truth, and data lineage tracking to differentiate artificiality from fact.

NIST AI RMF + ISO 42001 – Start with NIST AI Risk Management Framework to tactically map risks and identify which need prioritizing. Then implement governance using ISO 42001 as the compliance backbone.

Architecture First, Not Model First – Success depends on layered architectures with clear trust boundaries, not on having the smartest AI model.

Success Factors for the Next 3-5 Years

The next decade won’t be won by making AI perfectly truthful. Success belongs to organizations with better system engineers who understand failure, leaders who design trust boundaries, and teams who treat AI as a junior genius rather than an oracle.

What Telecom Deploys: Not intelligence, but responsibility. AI’s role is to amplify human judgment, not replace it. Understanding this prevents operational chaos and enables practical implementation.

AI Will Always Generalize: It will always overfit narratives. Everyone uses ChatGPT or similar tools for context before important sessions—this will continue. Success depends on knowing exactly where AI must not be trusted and making wrong answers as harmless as possible.

The AGI Question and Investment Reality

Panel perspectives on AGI varied from already here in certain forms, to not caring because AI is just a tool, to being far from achieving Nobel Prize-winning scientist level intelligence despite handling mediocre middle-level tasks.

From an investment perspective, AGI timing matters critically for companies like OpenAI. With trillions in commitments to data centers and infrastructure, if AGI isn’t claimed by 2026-2027, a significant market correction is likely when demand fails to match massive supply buildout.

Key Takeaways

1. Cognitive Security Has Replaced Traditional Security – Validation layers, zero trust of AI data, and semantic telemetry are mandatory.

2. Separate Observation from Decision from Action – Layered architecture prevents errors from cascading into mission-critical systems.

3. Knowledge Graphs Are the Real Moat – In healthcare and critical domains, competitive advantage comes from curated knowledge, not the LLM.

4. Accept Probabilistic Reality – Design around AI being 95% accurate vs. humans at 80%, choosing use cases where AI’s scale advantages transform value.

5. PMs Now Own Evaluations – The testing function has moved to product managers who must define what’s good enough in a probabilistic world.

6. Human-in-the-Loop Is Non-Negotiable – Structured intervention at critical decision points, not just oversight.

7. Single Source of Truth – Authentic data sources with verification mechanisms before AI outputs reach employees.

8. Continuous Process, Not One-Time Fix – Like cybersecurity, AI trust requires ongoing vigilance as defenses and attacks evolve.

9. Responsibility Over Intelligence – Deploy systems designed for responsibility and amplifying human judgment, not autonomous decision-making.

10. Better System Engineers Win – Success belongs to those who understand where AI must not be trusted and design boundaries accordingly.

Conclusion

The session revealed a unified perspective: The question isn’t whether AI can be trusted absolutely, but how we architect systems where trust is earned through verification, maintained through continuous monitoring, and bounded by clear human authority.

From cognitive security frameworks to layered telecom architectures, from healthcare knowledge graphs to PM evaluation ownership, the message is consistent: Design for the reality that AI will make mistakes, then ensure those mistakes are caught before they cascade into catastrophic failures.

The AI trust fall isn’t about blindly falling backward hoping AI catches you. It’s about building safety nets first—validation layers, zero trust of data, single sources of truth, human-in-the-loop checkpoints, and organizational structures where responsibility always rests with humans who understand both the power and limitations of their AI tools.

Organizations that thrive won’t have the most advanced AI—they’ll have mastered responsible deployment, treating AI as the junior genius it is, not the oracle we might wish it to be.


This Data Trust Knowledge Session provided essential frameworks for building AI trust in mission-critical environments. Expert panel: Vijay Banda, Rajat Singh, Rahul Venkat, and Varij Saurabh. Moderated by Rudy Shoushany.