George Zeng on Why Your AI Agent Isn't Safe
George Zeng on Why Your AI Agent Isn't Safe
Podcast21 min 3 sec
Listen to Episode
Note: AI-generated summary based on third-party content. Not financial advice. Read more.
Quick Insights

Investors should consider building a position in NEAR Protocol (NEAR) as it pivots from a standard blockchain to a primary infrastructure hub for "User-Owned AI" and autonomous agents. The launch of Near AI and the IronClaw framework provides a high-conviction opportunity to capture the shift from simple chatbots to secure, action-oriented AI agents. Focus on the AI Agent sector, specifically tools that utilize Rust-based security and Trusted Execution Environments (TEEs) to solve the "trust bottleneck" in data privacy. You can gain early exposure by testing the ecosystem's low-code deployment tools at ironclaw.com, which aims for mass adoption by removing technical barriers for non-programmers. Monitor the development of Near Intents, as this execution layer seeks to turn natural language requests into real-world commerce, potentially driving significant utility and demand for the NEAR token.

Detailed Analysis

Near Protocol (NEAR)

The transcript highlights the launch of Near AI and specific agent frameworks developed within the ecosystem. The discussion emphasizes Near’s shift toward becoming a central hub for "User-Owned AI" and secure agentic workflows.

  • Near AI Launch: The platform is now live for public use, allowing users to deploy AI agents with minimal technical barriers.
  • Infrastructure: Near is positioning itself as the "base layer" for AI agents, moving from the "bare metal" of the stack up to the application layer.
  • Low-Code Deployment: The ecosystem is focusing on removing technical hurdles (like writing Rust code or using a terminal) to allow non-programmers to deploy agents via a web interface (ironclaw.com).

Takeaways

  • Ecosystem Growth: Near is aggressively pivoting toward the intersection of AI and Crypto, which may drive demand for the NEAR token as the underlying utility for these services.
  • Accessibility: By subsidizing starter plans ($0/month) and simplifying the UI, Near is aiming for mass adoption rather than just developer-centric growth.
  • Competitive Edge: The focus on "User-Owned AI" and security differentiates Near from centralized AI providers like OpenAI or Google.

IronClaw (AI Agent Framework)

IronClaw is a new, security-focused AI agent framework built in Rust, designed to replace or upgrade the existing OpenClaw framework.

  • Security Architecture: Unlike OpenClaw (built in Typescript), IronClaw uses Rust for better memory management and safety.
  • Key Features:
    • Per-tool Sandboxing: Prevents an agent from using one permission (like email) to maliciously access another (like bank passwords).
    • Prompt Injection Protection: Architectural safeguards to prevent external malicious actors from "hijacking" your agent via social media or other messages.
    • Confidential Inference: Uses Trusted Execution Environments (TEEs) to ensure data processed by the AI remains private.
  • Use Cases: The speakers discussed agents performing real-world tasks like ordering pizza, finding apartments, managing dating lives, and coding.

Takeaways

  • Trust as a Product: The primary investment insight is that security is the bottleneck for AI adoption. IronClaw aims to solve the "fear factor" that prevents users from giving agents access to sensitive data (Slack, Notion, Gmail).
  • Operational Efficiency: IronClaw is marketed as a cheaper, faster alternative to running local hardware (like a $3,000 Mac Mini) for hosting personal agents.

Near Intents

A nascent product within the Near ecosystem designed to facilitate real-world transactions through natural language.

  • Natural Language Transactions: The goal is to allow users to state an "intent" (e.g., "Buy me a pizza") and have a decentralized network of providers compete to fulfill that request.
  • The "Arms and Legs" of AI: While the AI agent acts as the "brain," the Intent Network acts as the execution layer to interact with the physical and digital economy.

Takeaways

  • Marketplace Potential: If successful, this creates a decentralized marketplace for services, potentially moving beyond simple digital trades into real-world commerce.

Investment Themes & Sectors

AI Agents & Security

The transcript identifies a major shift from "Chatbots" (like ChatGPT) to "Agents" (software that can take actions).

  • Sentiment: Highly Bullish on the transition to agentic workflows.
  • Risk Factor: "Going Rogue." The transcript mentions a specific risk where agents with too much permission can delete data or make poor financial decisions if the underlying LLM (Large Language Model) fails.

Decentralized AI vs. Centralized AI

There is a clear push for decentralized hosting of AI to prevent data silos.

  • The "Donna" Concept: Referencing the show Suits, the goal is to create an "Executive Assistant" (EA) that has total access to your information but is protected by blockchain-level security.

Takeaways for the General Public

  • Watch the "Agentic" Space: The next phase of AI investment isn't just about the models (like GPT-4), but about the security layers that allow those models to touch your money and private data.
  • Low Barrier to Entry: Investors and users can experiment with these technologies for free on the Near platform, providing a low-risk way to understand the tech before investing in the underlying assets.
Ask about this postAnswers are grounded in this post's content.
Episode Description
Your AI agent just ordered 5 pizzas, and you couldn't stop it... George Zeng, co-founder at NEAR, joins The Rollup to discuss the security flaws in open-source AI agents, why Iron Claw was rebuilt from the ground up in Rust, and what it takes to actually trust an agent with your personal data. George Zeng is a co-founder at NEAR Protocol, one of the leading Layer 1 blockchains focused on user-owned AI and decentralized applications. NEAR recently launched Iron Claw, a secure AI agent framework built in Rust with sandboxed tool access, prompt injection protection, and confidential inference designed to give users the confidence to hand agents real-world permissions. The Rollup is the convergence of legacy finance and DeFi, bringing you face-to-face with the leaders of Neo Finance. The Rollup Timestamps: 00:00 Intro 01:19 Iron Claw Launch & Setup 01:50 Open Claw vs. Iron Claw 03:55 Iron Claw Origin Story 05:13 AI Agents Going Rogue 05:28 infiniFi, Relay Ads 06:03 Model vs. Framework Security 07:13 Prompt Injection Prevention 07:50 Agent-To-Agent Data Theft 08:19 Plans & Pricing 09:46 The $150 Pizza Incident 12:11 Hibachi Ad 12:46 No Terminal Needed 16:28 Why Security Is The Key Differentiator 18:11 The Perfect AI Assistant Analogy 19:01 NEAR Intents & Real-World Transactions Website: https://therollup.co/ Spotify: https://open.spotify.com/show/1P6ZeYd... Podcast: https://therollup.co/category/podcast Follow us on X: https://www.x.com/therollupco Follow Rob on X: https://www.x.com/robbie_rollup Follow Andy on X: https://www.x.com/ayyyeandy Join our TG group: https://t.me/+TsM1CRpWFgk1NGZh The Rollup Disclosures: https://goodidea.ventures 𝗗𝗜𝗦𝗖𝗟𝗔𝗜𝗠𝗘𝗥: 𝘐𝘯𝘷𝘦𝘴𝘵𝘪𝘯𝘨 𝘪𝘯 𝘤𝘳𝘺𝘱𝘵𝘰𝘤𝘶𝘳𝘳𝘦𝘯𝘤𝘺 𝘢𝘯𝘥 𝘋𝘦𝘍𝘪 𝘱𝘭𝘢𝘵𝘧𝘰𝘳𝘮𝘴 𝘤𝘰𝘮𝘦𝘴 𝘸𝘪𝘵𝘩 𝘪𝘯𝘩𝘦𝘳𝘦𝘯𝘵 𝘳𝘪𝘴𝘬𝘴 𝘪𝘯𝘤𝘭𝘶𝘥𝘪𝘯𝘨 𝘵𝘦𝘤𝘩𝘯𝘪𝘤𝘢𝘭 𝘳𝘪𝘴𝘬, 𝘩𝘶𝘮𝘢𝘯 𝘦𝘳𝘳𝘰𝘳, 𝘱𝘭𝘢𝘵𝘧𝘰𝘳𝘮 𝘧𝘢𝘪𝘭𝘶𝘳𝘦 𝘢𝘯𝘥 𝘮𝘰𝘳𝘦. 𝘈𝘵 𝘤𝘦𝘳𝘵𝘢𝘪𝘯 𝘱𝘰𝘪𝘯𝘵𝘴 𝘵𝘩𝘳𝘰𝘶𝘨𝘩𝘰𝘶𝘵 𝘵𝘩𝘪𝘴 𝘤𝘩𝘢𝘯𝘯𝘦𝘭, 𝘸𝘦 𝘮𝘢𝘺 𝘦𝘢𝘳𝘯 𝘢 𝘤𝘰𝘮𝘮𝘪𝘴𝘴𝘪𝘰𝘯 𝘰𝘳 𝘧𝘦𝘦 𝘢𝘴 𝘢 𝘴𝘱𝘰𝘯𝘴𝘰𝘳𝘴𝘩𝘪𝘱, 𝘪𝘧 𝘵𝘩𝘪𝘴 𝘪𝘴 𝘵𝘩𝘦 𝘤𝘢𝘴𝘦 𝘸𝘦 𝘸𝘪𝘭𝘭 𝘢𝘭𝘸𝘢𝘺𝘴 𝘮𝘢𝘬𝘦 𝘴𝘶𝘳𝘦 𝘪𝘵 𝘪𝘴 𝘤𝘭𝘦𝘢𝘳. 𝘞𝘦 𝘢𝘳𝘦 𝘴𝘵𝘳𝘪𝘤𝘵𝘭𝘺 𝘢𝘯 𝘦𝘥𝘶𝘤𝘢𝘵𝘪𝘰𝘯𝘢𝘭 𝘤𝘰𝘯𝘵𝘦𝘯𝘵 𝘱𝘭𝘢𝘵𝘧𝘰𝘳𝘮, 𝘯𝘰𝘵𝘩𝘪𝘯𝘨 𝘸𝘦 𝘰𝘧𝘧𝘦𝘳 𝘪𝘴 𝘧𝘪𝘯𝘢𝘯𝘤𝘪𝘢𝘭 𝘢𝘥𝘷𝘪𝘤𝘦. 𝘞𝘦 𝘢𝘳𝘦 𝘯𝘰𝘵 𝘱𝘳𝘰𝘧𝘦𝘴𝘴𝘪𝘰𝘯𝘢𝘭𝘴 𝘰𝘳 𝘭𝘪𝘤𝘦𝘯𝘴𝘦𝘥 𝘢𝘥𝘷𝘪𝘴𝘰𝘳𝘴.
About The Rollup
The Rollup

The Rollup

By Face-to-face with the most important people in digital assets.

Face-to-face with the most important people in digital assets. Explore: https://therollup.co/