Tag: #artificialintelligence

  • Harness Engineering, Orchestration, and Compound Agents: The Enterprise AI Vocabulary You  Need To Know

    Harness Engineering, Orchestration, and Compound Agents: The Enterprise AI Vocabulary You Need To Know

    Most enterprise AI practitioners are running multiple AI models. The question was never how many models or whether they were open models.  The question that’s harder to answer — and the one that determines whether your AI investments compound or fragment — is which system those models are part of, and what you are actually evaluating when a vendor puts a platform in front of you.

    At NVIDIA‘s GTC, Jensen Huang convened a session with the CEOs of Cursor, Perplexity, LangChain, Reflection AI, Thinking Machines Lab, and several others building at the edges of the AI ecosystem. What they described isn’t a debate about models. It’s a map of how AI systems are being assembled — orchestration layers, agent harnesses, multi-component architectures, and specialized vertical systems that combine foundation models with proprietary data and domain logic. Vendors are no longer selling model access. They’re selling systems. Understanding the components of those systems is what makes the difference between a well-matched procurement decision and an expensive one.

    Here’s the updated map.

    The Model Is a Component. The System Is the Product.

    Jensen Huang opened the session with a distinction worth internalizing: a model can be a technology or not a product. He said that ChatGPT is a product. The model underneath it is a technology that someone assembled into that product.

    This reframe is useful for enterprise buyers evaluating vendor offerings. When a vendor presents an AI platform — whether that’s Perplexity Computer, an agentic desktop assistant designed to function as an autonomous coworker, or a vertical industry system built on top of foundation models — you’re not evaluating the model. You’re evaluating everything assembled around it: how the system connects to your data, what tools it can invoke, how it manages memory and context across tasks, what guardrails constrain its actions, and how it handles the handoff between automated steps and human oversight.

    The model is the engine. The system is the car. And you’re buying the car.

    Michael Truell, CEO of Cursor, added a structural observation that clarifies why vendor evaluation has gotten more complex. For years, he said, there were two groups. There were foundation-model companies that built large general-purpose models and sold API access.  Or application companies that built models into their products or on top of them. Truell argues a third category is now well established — companies that combine the best foundation models available through APIs with their own purpose-built models and proprietary domain knowledge, assembled into a specialized vertical system. It’s not a foundation model or application layer. It’s both, plus the integration work that makes them useful together.

    When you evaluate a vendor in this third category, the question isn’t just which model it runs on. It’s whether the vertical specialization, the data architecture, and the system design match the use cases you’re actually trying to solve.

    What Harness Engineering Is, and Why It’s Now a Discipline

    Harrison Chase, CEO of LangChain, introduced a term that’s worth adding to your vocabulary: harness engineering.

    Harness engineering is the discipline of building reliable, structured environments around AI agents. The agent itself — the model running in a loop, calling tools, taking action — is only part of the system. The harness is everything surrounding it: the workflows, the tool interfaces, the validation loops, the context management strategies, and the memory architecture. It’s what makes the difference between an agent that works in a demo and one that operates reliably in production.

    NOTE: This is one definition of the term. The market is still debating this term, and I will write another specific piece on harness engineering.

    Chase made the point directly: even the closed model labs practice harness engineering constantly. He gave the example of Anthropic’s Claude and Claude Code. A model may be exceptional, but the harness around it — how it connects to file systems, how it manages long tasks, what guardrails constrain its actions — is equally responsible for the results. When enterprise teams underinvest in the harness and focus only on the model, they end up running expensive experiments that don’t scale.

    For technology leaders, this has a direct implication. Technical evaluations that benchmark models against each other without assessing the harness — the orchestration framework, the tooling, the integration architecture — are incomplete. The model is one variable. The harness is where most of the enterprise-specific work lives, and where most of the deployment risk concentrates.

    Multi-Component (Multi-Agent) AI Systems: What the Term Actually Means, and What to Ask

    You will hear vendors use terms like “compound agents,” “multi-agent systems,” and “agentic platforms” to describe their offerings. These terms are not interchangeable, and the market has not settled on consistent definitions. That ambiguity is worth understanding before you evaluate vendor claims.

    The most rigorous current framing comes from UC Berkeley’s Sky Lab, which defines a compound AI system as one that combines multiple AI components — models, retrievers, tools, databases, external APIs — to complete a task, rather than relying on a single model call. The system’s behavior emerges from how those components interact, not from any one of them individually. This framing has practical logic behind it: composing specialized components often outperforms a single frontier model on both capability and cost, particularly for complex multi-step tasks.

    Where it gets murkier is in how vendors apply the label. “Compound agent” in active use can mean three different things: a compound AI system that takes actions rather than just generating output; multiple discrete agents collaborating, each with its own reasoning loop; or an orchestrator-and-subagent architecture in which a controlling agent decomposes tasks and delegates them to specialized agents. These have meaningfully different architecture, cost, and governance implications. A vendor calling their product a “compound agent platform” may mean any of the three. The label alone tells you nothing about the actual design.

    The governance implication is the one most enterprise buyers miss. Multi-component systems diffuse accountability. When a consequential decision emerges from the interaction of a retriever, a reasoning model, and a tool execution layer, which component is responsible for the output? Traditional audit trails track the system’s final action. They often don’t track which component drove the decision that led to it. Before deploying any multi-component AI system in a business-critical workflow, buyers should require component-level architecture disclosure and confirm that audit logging covers component interactions, not just system outputs.

    The practical posture: treat “compound,” “agentic,” and “multi-agent” as marketing descriptors until a vendor discloses their specific component architecture. Ask what components the system includes, how they interact, how failures in individual components surface, and where in the stack governance and audit trails are enforced. Those answers will tell you far more than the product label.

    Orchestration Is the New Core Infrastructure

    Arvind Srinivas, CEO of Perplexity, described what his company calls Perplexity Computer: a multi-model, multi-cloud orchestration system where the models themselves become tools, and the orchestration layer determines which tool to apply to which task. The goal is that an enterprise can delegate a goal without specifying which model handles each step — the system manages that routing. Here is another take he gave on the topic in February.

    The analogy he offered is useful for enterprise framing: sub-agents are musicians, models are instruments, and the orchestration system is what produces the symphony. The quality of the output depends on all three, not just the instruments.

    The practical translation: the orchestration layer is where the strategic architecture decisions live. It determines which models get used for which tasks, how context is managed across long-running workflows, where governance and guardrails are enforced, and how exposed you are to vendor dependency. If your orchestration layer is tightly coupled to a single model provider, every future model decision becomes a migration project. If it’s designed to be model-agnostic, you preserve optionality as the model market continues to evolve rapidly.

    Mira Murati, CEO of Thinking Machines Lab, added a related dimension. Her firm has focused on making post-training — the layer of model development that adapts a foundation model to specific domains and tasks — accessible to enterprises and researchers. Most enterprise AI value doesn’t come from a raw pre-trained model. It comes from a model tailored to your domain, data, and task requirements. Accessible post-training means more organizations can build the specialized models that multi-component architectures require, without depending entirely on what general-purpose foundation models provide out of the box.

    What to Do Before Your Next AI System Decision

    The architecture described in this conversation isn’t on a roadmap. Cursor, LangChain, Perplexity, Mistral, and Thinking Machines Lab are all in production with enterprise customers today. The market has already moved.

    Three things worth doing before your next AI procurement decision:

    Evaluate the system, not just the model. Ask vendors to show you the harness — the orchestration framework, the tool interfaces, the memory architecture, the governance layer — not just model benchmark scores. You’re buying the system. Evaluate it as one.

    Require component-level architecture disclosure. When a vendor describes their offering as a compound agent, an agentic platform, or a multi-agent system, ask them to specify the components the system includes and how they interact. The label is not a specification. The architecture is.

    Treat orchestration as strategic infrastructure. The orchestration layer is where vendor dependencies are created or avoided, where governance is enforced or bypassed, and where the long-term flexibility of your AI architecture resides. It deserves the same scrutiny as your data infrastructure decisions. Evaluate orchestration before you’re locked into a system that makes changing it painful.

    The model was never the moat, but perhaps the system is. Knowing how to evaluate the totality of an AI system is what separates a well-matched AI investment from an expensive lesson.

  • Microsoft Build 2025: Bridging the Gap Between AI POCs and Agentic AI Success

    Microsoft Build 2025: Bridging the Gap Between AI POCs and Agentic AI Success

    The AI Acceleration Challenge

    The AI market has rapidly evolved from early chatbot failures to a landscape of simplified access to information driven by generative AI, with agentic AI coming soon. Yet, most organizations are still struggling to move beyond proof-of-concept projects to production deployments that deliver measurable business value. Over 80% of firms interviewed by Lopez Research report significant technical skills shortages and challenges with change management when deploying AI systems. The landscape has also become increasingly complex, with thousands of AI models and multiple approaches to designing, deploying, and managing AI solutions.

    Before enterprises had even fully embraced conversational interfaces within various SaaS solutions, the technology industry rapidly moved toward creating agentic AI products. Instead of AI that assists people, the industry has pushed toward systems that can operate autonomously, reason through complex problems, and take action without always requiring human guidance. While agentic systems represent the future of AI, the inherent risks in autonomous systems terrify all but the most fearless companies.

    Amplified Risks in an Autonomous Agentic AI World

    AI systems face significant reliability challenges, including unpredictable outputs, “hallucinations” where they generate false information, and brittleness when encountering unfamiliar scenarios. These systems can also experience model drift as underlying data patterns change over time, leading to degraded performance without obvious warning signs. From a security perspective, AI systems remain vulnerable to sophisticated attacks, including adversarial inputs designed to manipulate outputs, data poisoning that corrupts training datasets, and inference attacks that can extract sensitive information from trained models.

    These challenges become exponentially more serious with agentic AI. Reliability issues that may cause minor inconveniences when a human is in the loop will become critical safety concerns when agents can act autonomously. An agentic AI experiencing model drift or brittleness could make consequential decisions affecting business operations, financial transactions, or even physical systems without human oversight. Security vulnerabilities become particularly dangerous, as adversarial attacks can manipulate agents into taking harmful actions, while data poisoning can corrupt not only outputs but entire chains of autonomous decision-making.

    Companies Flock To Strategic Vendors For AI Platforms

    The AI sprawl of startup vendors and highly specialized solutions only creates increased anxiety. Today, most business leaders are looking to a handful of strategic technology vendors to offer more comprehensive systems for designing, securing, maintaining, and governing AI that supports many but not all of the AI functions. It’s crucial that these strategic vendors also provide ecosystem-friendly platforms that can connect with other third-party technology vendors when necessary.

    Microsoft Responds with Advances in Agentic AI 

    At Microsoft’s Build 2025 conference, CEO Satya Nadella advanced the company’s vision for an “open, agentic web.” Microsoft’s announcements encompass over 50 new AI tools and platforms, focusing on agentic AI capabilities that promise to transform how organizations develop software, conduct research, and manage business processes. 

    Microsoft calls its Microsoft 365 Copilot “the UI for AI,” providing a place where people and teams interact with agents in the flow of work. However, since last year’s Build conference, the company has moved well beyond Microsoft Copilot as a conversational interface to also offering a more comprehensive platform for designing and using agents. This is in addition to providing its own AI models and special-purpose AI hardware. The latest Microsoft Build announcements showcase several key updates that demonstrate Microsoft’s commitment to addressing enterprise concerns about the deployment of autonomous AI while maximizing its transformative potential.

    1. Evolving Software Development

    Microsoft Build has always focused on tools for software development. The evolution of GitHub Copilot from code suggestion to an autonomous coding agent represents a significant shift in software development lifecycle management. The new agent handles end-to-end programming tasks, including bug fixes, feature implementation, and code refactoring. Embedded directly into GitHub, the agent activates when developers assign a GitHub issue to Copilot or prompt it in VS Code, spinning up secure and fully customizable development environments powered by GitHub Actions.

    The autonomous handling of routine coding tasks allows development teams to focus on architecture and innovation, effectively multiplying the strategic impact of existing technical staff. Beyond productivity gains, the system ensures consistent application of best practices across entire codebases, reducing quality variations that often plague large development organizations. Perhaps most significantly for enterprise operations, the platform reduces dependency on individual developer expertise, creating more resilient and maintainable systems where institutional knowledge embedded in the AI agent ensures continuity when personnel changes occur.

    The advances in GitHub Copilot address one of the most persistent challenges facing technical leaders: the growing gap between the demands of software development and the available talent. At Build, Microsoft shared that Ramp, a spend management platform, saves approximately 30,000 hours of manual work per month by utilizing GitHub Copilot. Cathay Pacific, Hong Kong’s largest airline, similarly leveraged GitHub Copilot to save developer time and increase productivity across their development teams.

    2. Delivering Choice and Interoperability

    Microsoft’s Azure AI Foundry Agent Service represents the cornerstone of enterprise agentic AI deployment. Now generally available, the platform provides enterprise-grade infrastructure for production AI agent deployments, integrating Semantic Kernel and AutoGen into a unified SDK while supporting Agent-to-Agent (A2) communication and the Model Context Protocol (MCP). The support for A2A and MCP means it will be easier for companies to create Agentic AI systems where agents can connect and collaborate across various applications and data sources. 

    Microsoft’s commitment to the Model Context Protocol across its entire platform stack addresses a critical enterprise concern: avoiding AI vendor lock-in while enabling sophisticated integrations. MCP integration with Windows will provide a standardized framework for AI agents to connect with native Windows applications, allowing seamless agent-based interactions. The support for the A2A protocol, an open standard, also enables Microsoft to integrate with other major technology companies, including Google (the originator of the protocol), Atlassian, Box, Cohere, Intuit, LangChain, MongoDB, PayPal, Salesforce, SAP, ServiceNow, UKG, and many others.

    Organizations will also gain model flexibility with access to over 11,000 models through a Hugging Face integration in addition to the existing 1,900 models in the Microsoft catalog. These capabilities enable organizations to integrate best-of-breed AI models regardless of vendor and optimize costs by selecting the right model for the right workload. 

    3. Advanced Workflow Automation

    The introduction of multi-agent systems enables sophisticated workflow automation where specialized agents collaborate to handle complex business processes within the Microsoft ecosystem and across applications. This multi-agent orchestration transforms organizational thinking about business process automation, shifting from rigid, predetermined workflows to intelligent systems that adapt and collaborate in real time.

    Cross-platform integrations demonstrate the versatility of this capability. Adobe’s marketing agent, integrated with Microsoft 365 Copilot, enables marketers to access audience analysis without needing to switch applications. ServiceNow AI agents work with Microsoft 365 Copilot for service management. SAP integration through SAP Joule enables the creation of custom AI agents for SAP workloads using Azure AI services while also allowing SAP users to access data within Microsoft 365 applications.

    Financial operations benefit similarly, with compliance agents working alongside analysis agents to produce automated reporting that maintains accuracy while reducing manual oversight requirements. Supply chain management becomes more responsive as demand forecasting agents coordinate directly with inventory management agents, creating dynamic, self-optimizing systems that respond to market changes in real time.

    4. Observability for Agentic Systems

    For technology leaders grappling with the complexities of AI deployment, this platform addresses several fundamental concerns that have historically hindered the success of AI initiatives. In addition to supporting open protocols for agent communication and governed access to multiple types of AI, it also offers built-in observability. Observability provides real-time metrics for performance, quality, cost, and safety, giving executives the visibility needed to manage AI operations with confidence. 

    Rather than deploying AI as a black box, organizations can now monitor and optimize their AI investments with the same rigor applied to traditional enterprise systems. The platform’s integrated compliance controls help prevent “agent sprawl,” which many organizations fear as AI adoption accelerates, enabling centralized oversight while increasing accessibility through a centralized agent store.

    AI Can Deliver Impact

    Real-world implementations demonstrate measurable impact. Accenture has leveraged Azure AI Foundry for AI and agent-led business process transformations, achieving a 30% increase in efficiency and a 50% reduction in AI application development time. Carvana developed an agent that analyzes customer interactions, resulting in a 40% reduction in inbound sales calls. The Indiana Pacers created an in-arena real-time captioning system with error rates reduced to just 1 percent. 

    Early implementations highlight the potential of agentic AI in mission-critical environments. Stanford Medicine’s Healthcare Agent Orchestrator, built on Azure AI Foundry, transforms cancer care delivery across approximately 4,000 tumor board meetings per year. The system consolidates fragmented information from multiple sources, integrates patient history with radiology data, medical literature, and clinical trials, and generates comprehensive reports for clinicians, thereby reducing the time spent on manual information gathering. Deployed into Microsoft Teams with a foundation in specific clinical notes, the solution enhances patient decision-making by making it more efficient, faster, and potentially more accurate while enabling the sharing of advanced medical AI capabilities with community hospitals to democratize these capabilities. 

    The NFL’s implementation demonstrates the impact of agentic AI on data-driven decision-making. Azure AI Foundry revolutionized scouting operations by combining previously scattered data systems, enabling teams to ask specific player questions and receive immediate comparative analysis, complete data filtering in seconds rather than hours, access detailed player information in real-time during evaluations, and perform instant queries like “give me the fastest 40 times of a defensive lineman.” This transformation gave NFL teams significant competitive advantages in player evaluation by fundamentally changing how they process and analyze scouting data.

    Build Your Foundation Wisely

    For technology leaders, the strategic imperative is clear: organizations that successfully implement agentic AI will gain substantial competitive advantages in efficiency, innovation speed, and operational capability. The key to success lies not in the technology itself but in thoughtful implementation that addresses governance, security, and change management challenges while maximizing the transformative potential of autonomous AI systems. While organizations should proceed with caution, the latest offerings announced by Microsoft and others signal that the technology market is providing more mature offerings to mitigate risks, suggesting that the foundation for safe, effective agentic AI deployment is rapidly solidifying.

  • 42: How Cloud Computing Provides Flexible Options to Design Your AI Strategy

    Episode Summary:
    In this episode, Maribel Lopez speaks with Google Cloud Product Manager Bobby Allen about the current benefits and future possibilities of artificial intelligence in the context of Google’s AI services. They explore the flexibility of Googles services that sets them apart, the environmental impacts of LLMs in comparison with their predecessor NLMs, and how companies can take a human approach to AI to make peoples lives better.

    Key Themes:
    Maribel and Bobby begin by discussing Google’s AI services. Allen explains the wide variety of AI services offered by Google, which fall into three main categories: building AI, building with AI, and using AI. Most organizations are currently interested in using AI, and they have seen tangible benefits from doing so.

    Bobby refers to these benefits as the “four I’s”: insight, increase, improvement, and innovation. Companies that adopt AI can see increases in productivity, gain insights into large documents through AI summarization, and more. Ai also has growing applications in compliance and query creation to analyze large datasets.

    Last, Maribel and Bobby discuss the future of AI. Bobby points to a human-first future with a focus on the impacts of AI applications, including sustainability and marginalization. He believes that AI should solve real problems and male peoples lives better.

    Follow Bobby Allen: https://www.linkedin.com/in/ballen-clt/

    Learn more about AWS: http://aws.amazon.com/

    Visit Maribel Lopez’s Website: https://www.lopezresearch.com/

    Follow Maribel Lopez on X/Twitter: https://x.com/maribellopez

    Subscribe to Maribel Lopez on YouTube: https://www.youtube.com/c/MaribelLopezResearch

    Follow Maribel Lopez on LinkedIn: https://linkedin.com/in/maribellopez/ 

  • 41: Using AI to Improve Healthcare Operations

    Episode Summary:
    In this episode, Maribel Lopez speaks with Qventus co-founder and CEO Mudit Garg. Mudit explains how automation can help patients receive efficient care and hospitals maximize their performance. Learn how Qventus is helping hospital systems cut down their “excess days,” why efficiency is essential to care, and Mudit’s predictions for the future of AI in healthcare.

    Key Themes:
    Maribel begins the episode by speaking with Mudit about how Qventus is changing the hospital system for the better. Mudit explains that AI can be extremely helpful for hospital coordination. There are many cases in healthcare where the patient and the hospital system are aligned in their goals, like booking a surgery for a patient, but administrative complexities make those goals difficult to accomplish. 

    Qventus bases its system on two crucial components – behavioral science and machine learning. Machine learning is a great tool for determining patterns for coordination and scheduling, but factoring human behavior is crucial to create a model that actually works. Mudit credits the success of Qventus to the combination of these factors. 

    Maribel and Mudit also discuss the future of artificial intelligence in hospitals. Many industries are adopting AI in a wide range of applications, but Mudit suggests that healthcare systems should focus in on perfecting technology that benefits both patients and hospitals. He also notes his interest in Ai’s potential for data siloing, which would cut down administrative work. 
     
    Follow Mudit Garg on LinkedIn: https://www.linkedin.com/in/gargmudit/ 

    Learn more about Qventus: https://qventus.com/ 

    Visit the 3Blue1Brown YouTube Channel: https://www.youtube.com/@3blue1brown 

    Visit Maribel Lopez’s Website: https://www.lopezresearch.com/ 

    Follow Maribel Lopez on X/Twitter: https://x.com/maribellopez 

    Subscribe to Maribel Lopez on YouTube: https://www.youtube.com/c/MaribelLopezResearch 

    Follow Maribel Lopez on LinkedIn: https://linkedin.com/in/maribellopez/ 

  • 39: Laying the Foundation for AI with AWS’s Dr. Sherry Marcus

    Episode Summary:
    In this episode, Maribel Lopez discusses generative AI with Dr. Sherry Marcus, the Director of Generative AI Sciences at Amazon Web Services. Her insights into the artificial intelligence needs of businesses gives her a unique perspective on the future of generative AI. Learn about the concept of agents in AI, why customers are moving toward the use of multiple models, and the ways AI might evolve in the future.

    Key Themes:
    Maribel and Sherry begin their conversation by discussing Amazon Bedrock, which is Amazon’s AI building service. The technology allows AWS customers to create their own AI models by offering choices of foundational models that can be customized.

    Next, Sherry and Maribel discuss AI agents. In AI, Agents can retrieve real-time data to assist LLMs in providing information they cannot access in their training data. They also discuss how customers are currently using artificial intelligence, and why there is a shift away from specific modes and toward using multiple models for different use cases.

    Dr. Sherry Marcus also explains how customers have historically used RAG (Retrieval Augmented Generation) to answer questions, and how that technology is evolving. Last, she explains why companies are using synthetic data to train their models, her predictions for the future of AI, and her favorite primer on AI.

    Read What Is Chat GPT Doing… and Why Does It Work? by Stephen Wolfham: https://www.amazon.com/What-ChatGPT-Doing-Does-Work/dp/1579550819 

    Follow Dr. Sherry Marcus: https://www.linkedin.com/in/sherry-marcus-ph-d-4a4110/ 

    Learn more about AWS: http://aws.amazon.com/ 

    Visit Maribel Lopez’s Website: https://www.lopezresearch.com/ 

    Follow Maribel Lopez on X/Twitter: https://x.com/maribellopez 

    Subscribe to Maribel Lopez on YouTube: https://www.youtube.com/c/MaribelLopezResearch 

    Follow Maribel Lopez on LinkedIn: https://linkedin.com/in/maribellopez/