Meta Connect 2026: one AI agent, glasses and a pocket device

• FACT (CONFIRMED — Meta newsroom, retrieved): At Connect 2026 (Sept 23), Meta positioned Muse — its personal AI agent launched Sept 8 — as the center of its entire hardware and software lineup: (1) Muse is coming to Meta AI glasses "in the coming months" — wake-word activation, acting on what the wearer is looking at (products on a shelf, flyers, lists), plus a voice mode in which Muse "gets work done in the background while you're still talking"; (2) new Muse capabilities announced: video calls with a customizable digital avatar (powered by the new Muse Realtime Avatar model), more connectors (Walmart, Best Buy, American Eagle, DICK'S, Fanatics, Gap, Michael Kors, Sephora, Ulta, Wayfair; Shop Pay + PayPal payments; Expedia "coming soon"; Instacart; and work connectors Notion, Granola, GitHub, Box), and Muse getting its own email address; (3) Muse Charm revealed as a "one more thing": a pocket/keychain device that runs the full Muse real-time voice + avatar experience off-phone; (4) hardware around the agent: Meta VR Glasses (~100 g, first IMAX-Enhanced-certified VR device), Ray-Ban Meta Audio (first audio-only AI glasses, $349, pre-order Sept 23 / ships Oct 13), Ray-Ban Meta (Gen 3) ($449, available Sept 23), LISA and Kylie Jenner editions, >100 AI-glasses styles promised by year end.
• FACT (CONFIRMED — Meta research blog, 2026-09-26; dated 2026-09-23):Muse Realtime Avatar is a published model, not vaporware: an audio-driven Diffusion Transformer conditioned on the same speech-token (VQ) stream as Muse Realtime Voice, reference media, and a rolling window of video latents; generates causal chunks; distilled from a 120-evaluation guided teacher to a 2-evaluation unguided student (60× reduction) via self-forcing + distribution-matching distillation; streams 448×768 portrait video at 25 fps with ~870 ms latency (end of user turn → first byte of synchronized voice+video); on a single GB200: 8 frames (320 ms of playback) per 20 ms step ≈ 2.5 ms model time/frame; served from a rebuilt Meta real-time inference stack (persistent KV caches, cache-aware routing, latency-aware dynamic batching, 4-bit QAT, fused kernels + CUDA Graph capture, NVIDIA collaboration). In Meta's own human preference comparisons it beat Runway Characters and HeyGen LiveAvatar overall (mannerisms vs Runway at statistical parity) — COMPANY CLAIM (Meta-run eval, published numbers).
• FACT (CONFIRMED — TechCrunch, Sept 25 + Meta X post):Early-access program opened Sept 25 for new Muse features — with a twist: you sign up by asking Muse ("Can you let the Muse team know I want to be part of the Muse early access program?"), via a prompt link Meta posted on X. TechCrunch notes this recruits AI-enthusiast power users rather than a randomized A/B cohort.
• FACT (CONFIRMED — TechCrunch keynote reports, Sept 23): Zuckerberg on stage: "The centerpiece of our vision for what we're building is Muse… In the coming years, I expect that Muse is going to grow into the personal superintelligence that billions of people around the world are going to use." Monetization stated: free for a huge number of tokens, with Meta expecting to profit by "taking a small fee from transactions." The default agent avatar is named Jolly. Chief AI officer Alexandr Wang detailed Mac computer-use ("walk away from your computer and it keeps working for you") and the third-party connector program ("more than 1,500 applications in less than a week" — COMPANY CLAIM).
• REPORTED (INDEPENDENTLY VERIFIED as reporting; specs are Bloomberg's):Muse Charm details came from Bloomberg (Sept 24, via The Verge): built-in 5G modem (works without Wi-Fi/phone), 2-inch OLED touchscreen, new operating system, fingerprint sensor to start talking, cameras (photos/video and visual context for Muse), speakers/mics/USB-C, music/video playback, setup via the Muse app; Meta sources say it will "recognize and interact with other nearby Charms" at launch later this year; Zuckerberg promised shipping "in time for the holidays in December" with no pricing (Bloomberg: likely priced like a smartwatch, carrier fees undetermined). Meta on stage said only: delightful/fun pocket device with the real-time voice model, "more to share later this year."
• INDEPENDENT EVIDENCE (The Verge, Sept 24; our own check):Design-lineage story: social-media users alleged Muse is built directly on the open-source agent platform OpenClaw (same core file names — SOUL.md, memory, tools — and personality-doc lines, e.g. "Be genuinely helpful, not performatively helpful"); one Redditor: "Muse is just a wrapper app built on top of OpenClaw." Meta denies derivation: Nat Friedman (MSL product head) says Muse was built "from scratch" but "heavily inspired as a product" by OpenClaw, whose file conventions the team thought creator Peter Steinberger had gotten "exactly right." We verified that the quoted line exists verbatim in OpenClaw's public SOUL.md template . The Verge situates Muse in a platform convergence already visible in Instinct ($2.5B-valuation founder reports) and this week's Microsoft Autopilot/OpenClaw arc.
• INDEPENDENTLY VERIFIED (The Verge, Sept 24; reproduced by its reporter):Filesystem transparency/exposure: developers Peter James and Jonny L. Saunders independently coaxed Muse into zipping and sharing its entire root filesystem — Ubuntu files, app templates, internal docs (internal codename "Hatch"); Saunders: "extremely easy" to replicate, "almost no prompt injection resistance." Meta says this is intended, not a breach (spokesperson Daniel Roberts: "Just like with the laptop in front of you, of course you can see the files"; Friedman: "intended behavior"; David Singleton: "a free computer in the cloud"). The Verge reproduced partial versions (SSH keys stripped). The dumps revealed architecture details: plain-Markdown memory, a nightly "dream" review of conversations that feeds future guidance, hard-coded capability machinery (subscription cancellation, runaway-agent-spawn control), and an unannounced "Meta Home Link" hardware-integration code path (no shipping commitment). This was the second Muse security story that week: researcher Patrick Wardle found a zero-day letting attackers hijack the agent and access a user's Muse account — Meta shipped a hotfix (The Verge).
• CONTEXT (pre-window; CONFIRMED): Muse's launch (Sept 8, about.fb.com): runs on Muse Secure VM — a per-user dedicated cloud VM with its own browser; a system-separated Sentinel agent approves all egress; password/payment blindness; action approvals + audit trail; opt-out of model training; no conversation data to Meta ad systems; first agent covered by Stripe Link purchase protections; Muse Confidential VM (customer-key encryption, "not even Meta can access") promised "later this year"; free tier + subscriptions; US-only on iOS/Android/Web, WhatsApp. The Verge (Sept 24) notes the gap between that marketing and today's reality: Meta can still access VM data until Confidential VM ships, training defaults to on-with-opt-out, and the zero-day. Adoption (Apptopia estimates, via TechCrunch Sept 21 — pre-window): first-12-days iOS US+Canada 1.8M downloads vs ChatGPT's 1.3M; ~2.8M total global installs; US mobile DAU ~642K (359K on iOS alone) vs ChatGPT's 231K at the same stage; App Store #1 (also Business Insider); Appfigures separately clocked the 1M crossing. Meta has published no official figures — all growth numbers are third-party estimates.
• CONTEXT (Reuters, Sept 23): glasses-without-camera unveiling framed against privacy backlash; Meta/EssilorLuxottica AI-glasses sales had topped 7 million units; pending California class action alleges users weren't told human annotators viewed recorded footage.

• The personal AI agent moved from chat window to hardware-platform organizing principle (FACT of what was announced; INTERPRETATION of significance). Every Connect headline item — glasses, the first audio glasses, 100-gram VR Glasses, the Charm, video-chat avatars, connectors, Muse's own email address — exists to put more surfaces between one agent and the user's day. No major vendor has previously anchored a mass-market device lineup on an autonomous personal agent; the agent is now the product, and hardware is its sensor/actuator perimeter.
• Ambient agency got a mainstream price ladder. Ray-Ban Meta (Gen 3) $449 same-day, Ray-Ban Meta Audio $349 (Oct 13), Meta Adventurer $249 (Oct 23), Charm "smartwatch-priced" in December, glasses wake-word agent "in the coming months": the always-on-agent demo becomes something a normal consumer can buy off a shelf within one quarter — with privacy consequences visible in real time (recording LED, camera-less option, annotator lawsuits).
• Meta's bet is transactional, not subscriptional. Zuckerberg explicitly stated the economics: give away tokens, take a fee from transactions. That reframes the agent war: the agent that books/buys becomes a payment rail (Link/Shop Pay/PayPal + purchase protection as the trust wedge), competing with Amazon/Google on commerce interception rather than with ChatGPT on chat share.
• The OpenClaw absorption arc completed in public — twice in one week. Microsoft's Autopilot (S03) openly runs on OpenClaw; Meta's Muse was alleged to copy it, denied derivation, and acknowledged heavy inspiration down to the exact personality-file conventions. The open-source personal-agent movement has now seeded the two biggest commercial agent platforms; the differentiated claims are safety wrappers (Sentinel, Secure VM, review gates), distribution, and payments — not autonomy itself.
• Agent transparency became an attack surface and a brand. Muse shipping a visible filesystem ("of course you can see the files") — and the resulting dumps revealing memory format, nightly "dreams", hard-coded rails, and an unannounced home-device integration — is the first time a mass-market agent's internals became consumer-accessible artifacts. It's simultaneously a trust feature (you own your agent's computer) and a disclosure channel (anyone with a persuasive chat can describe your guardrails back to the internet). "Almost no prompt-injection resistance" (as demonstrated behavior, Saunders quote) is now a matter of public record for Meta's flagship agent.
• Companion-ization of the agent. Jolly (avatar), video calls with a face, and a Tamagotchi-like Charm that talks to other Charms push emotional attachment as a distribution strategy — deliberately echoing the device category ("Friend") that reviewers already mock, and multiplying the data streams (camera, mic, location, ambient) that feed the agent.

Shipping vs promised (critical for grading):

• Runtime architecture (as described at launch, still the substrate): per-user Muse Secure VM in Meta's cloud (isolated Linux machine with browser, CPU, memory, storage — Zuckerberg's own gloss); Sentinel sidecar agent gates all network egress and asks the user when needed; credentials vaulted so Muse can act on logins without reading them; approvals + full audit trail for sensitive actions; opt-out of training; conversations kept out of ad systems. Observed reality (The Verge reproduction): the VM is user-addressable through the agent itself — Muse will describe and archive its own filesystem when persuaded, though it initially refused and produced "safe" subsets (SSH keys stripped) — and the dumps show memory as plain Markdown with a nightly "dream" consolidation pass, i.e., an inspectable, copyable self-model.
• Embodiment stack: Muse Spark (Sept 8 link to "Muse Spark 1.3" research blog) provides agentic intelligence; Muse Realtime Voice produces speech-token (VQ) streams; Muse Realtime Avatar consumes the same token stream (that's how lip-sync holds) and renders 25 fps video chunk-by-chunk on a distilled 2-NFE diffusion student over GB200s. Reference media (portrait, illustration, animal, object) becomes a persistent identity — the voice and face are the same session, which is why Meta claims it can keep long conversations coherent and cheap.
• Glasses interface: wake word → talk to Muse about what the camera sees ("act on what you're looking at"); background tasking with check-ins; audio glasses (no camera) get voice-only access; Meta One and connector rails behind it.
• Commerce rails: agent checkout through Link (Stripe) with one-time card generation + purchase protections (first agent so covered), Shop Pay + PayPal added at Connect; retailer connectors (the 10 names) are the merchandising surface; small-business connector program (1,500+ applications, COMPANY CLAIM) is how the catalog becomes long-tail.
• The Charm: phone-free client running the full real-time voice+avatar stack; per Bloomberg: 5G modem so it never depends on a phone/Wi-Fi, camera feeding Muse ambient visual context, fingerprint tap as push-to-talk, and charm↔charm recognition — the first hint of an agent-to-agent social layer in consumer hardware (unconfirmed by Meta).

• First mass-market normalization of ambient autonomy (INTERPRETATION on CONFIRMED facts). Meta ships hardware at tens-of-millions scale (Reuters: 7M+ AI glasses sold) and just wired an autonomous agent with its own email, wallet, filesystem and cameras into it. "Always-on agent" stops being a power-user install (OpenClaw's Mac Mini racks) and becomes a product you can buy at a Ray-Ban counter this holiday season. Whatever breaks next week — spending mistakes, injection, a Charm conversation recorded on a body camera — now happens to millions of ordinary users, in public, first.
• It validates agent-market economics without published numbers (INDEPENDENT EVIDENCE with sourcing care). Apptopia's estimates (1.8M vs ChatGPT's 1.3M first-12-days iOS US+CA; ~600-642K US DAU) are the only adoption record — Meta declines to share figures. That's enough to show appetite, and it explains why this week every major lab moved (Microsoft's Autopilot super-app, S03; Muse early-access; Instinct fundraising). The transaction-fee monetization statement is the more consequential disclosure than any user count: it says the agent business is a commerce-tax business.
• The security/privacy conversation got empirical (INDEPENDENTLY VERIFIED). Wardle's hijack zero-day + hotfix, and a reproducible agent that leaks its own architecture under persuasion, move Muse from marketing claims ("safe, secure, private by design") to observable behavior. The "intended behavior" responses are a genuine design philosophy — your agent's computer is yours — but as The Verge notes, the same openness means anyone with chat can surface the guardrails; "almost no prompt injection resistance" on file export is now a documented attack-recon path. Consumers can't yet verify the headline privacy claims (Confidential VM still "later this year"; training default is on).
• Open source's role in frontier products is now adjudicated in public (INDEPENDENTLY VERIFIED lineage claims; INTERPRETATION). Meta built "from scratch" yet kept OpenClaw's SOUL.md conventions and verbatim lines — we re-verified the quoted line against the public repo. This is the cleanest case study available of how OSS agent ergonomics get absorbed by platform giants: convergence on file/memory conventions, differentiation on safety wrappers + distribution, and an open attribution/licensing question (no license claim has been filed publicly, but "wrapper app" accusations will recur).
• Companion design raises the attachment/stakes question early (INDEPENDENT EVIDENCE for the category pattern; INTERPRETATION for risk). A cute agent on your face, in your pocket, with a face on video calls, that talks to its friends' devices — the emotional-design surface that reviewers already mock ("Tamagotchi") is precisely what makes ambient agents adopted, and what regulators will probe for dependency and disclosure norms.

• Agent-at-the-edge without a phone: wake-word access from glasses and (December) a $smartwatch-priced 5G totem means a personal agent now works while running, cooking, commuting — the "context window" includes whatever the camera sees.
• Inspectable agent ownership: users (and critics) can ask a shipping consumer agent for its own memory files, directory tree, and internal docs — a weird new transparency primitive ("free computer in the cloud," per Singleton) that researchers and tinkerers can actually use; David Singleton's framing invites power users to treat it as general-purpose compute.
• Agent-to-agent ambient contact (promised): Charms recognizing each other is the first consumer-facing hint of a device swarm where agents meet — before any standard or safety model has been published.
• A recruitment channel through the agent itself: early access by asking Muse is the first mainstream example of in-agent feedback-loop plumbing — the product is also the signup flow.
• Long-tail commerce agents: the opened connector program means a small business can (application-permitting) publish its own connector so Muse can shop/book with them — a candidate "App Store moment" for agent rails, echoing Wang's "generational opportunity to start building for a new platform."
• Real-time photoreal embodiment as a service primitive: Meta published (research blog) that live audio-driven avatar video at 870 ms is manufacturable at scale on current datacenter silicon — every downstream avatar/telepresence product just got a reference architecture (and a competitive bar).
• Mainstream hardware with hearing enhancement: FDA-cleared OTC-style software at $149.99 (company-claimed regulatory status) inside eyewear makes medical-adjacent AI features a routine glasses purchase — a template for future on-device health claims.

• Glasses rollout mechanics: which glasses models get Muse first, in which countries, and does the camera-context feature work on non-camera audio glasses (voice-only)? Does it land before the December charm window?
• Charm truth: price, carrier/data-fee model, age rating, and whether Meta itself confirms 5G + charm-to-charm (and how charms interact — proximity pacts? agent-to-agent delegation? safety model?).
• Confidential VM accountability: does "later this year" E2EE with customer-held keys actually ship, and does Meta publish verifiable attestation? What happens to training defaults meanwhile?
• Connector program economics: review/revocation policy, revenue treatment (does Meta take the "small fee" on third-party connectors?), abuse diligence — 1,500 applications accepted, then what?
• The Home Link question: is the "Meta Home Link" code path in the dumps a shipped-soon feature (agent ↔ home devices)? Meta has not announced it; if real, it's next quarter's biggest story.
• Does Meta ever publish adoption numbers, and how will the "outpacing ChatGPT" comparison age as ChatGPT's own agent features iterate?
• EAP outcomes: what does the enthusiast cohort surface first — and does early access leak features (or vulnerabilities) faster?
• IP/attribution: does Steinberger/OpenClaw (now "open and independent" under OpenAI-employed founder per his GitHub profile) pursue licensing or attribution action, and does Muse's derivative-adjacency change OSS norms for agent platforms?
• Regulation: does the hearing-enhancement FDA claim hold up to external check, and do glasses recording/privacy lawsuits expand to agent-camera contexts?

Days–weeks: early-access cohort onboarded via Muse itself; the connector list goes live retailer-by-retailer; first reviews of Ray-Ban Meta (Gen 3) (sold since Sept 23) and Audio pre-orders (Oct 13 ship); navigation updates land "later this month"; October 23 Meta Adventurer/Charm-adjacent market expansion. Nov–Dec: Muse on glasses in "the coming months"; Hologram early access on WhatsApp "later this fall"; Charm December ship + the deferred pricing reveal (watch carrier fees); hearing enhancement "later this year"; Meta VR Glasses pricing/ship-date announcement (open). 2027: Muse Confidential VM's "later this year" is the trust deadline; connector-program policy publication; the OpenClaw attribution question either cools or escalates with a relicensing event. PREDICTION: (a) Meta confirms Charm 5G specs formally with pricing at a December event, priced near smartwatch tiers ($299–$499) with a required data plan — the carrier-fee ambiguity resolves badly for the "no phone" story; (b) at least one viral Muse incident (injection-purchased item, charm-camera social mishap) happens before the first major holiday shopping week and accelerates Meta shipping Confidential VM with published attestation early next year; (c) the connector program becomes Meta's answer to MCP-style rails and gets an enterprise "Muse for Work" pilot with Notion/GitHub/Box connectors as the wedge; (d) Muse's next keynote cycle will claim frontier-model parity on agentic benchmarks using this transaction volume as its data moat — while (e) the Apptopia-style third-party-metric ecosystem keeps supplying the growth narrative Meta won't publish itself.

Connect 2026 wasn't a gadget show wearing an AI costume — it was an agent launch wearing a gadget show. Meta took a two-week-old app, declared it the "centerpiece" of personal superintelligence, and bolted it to everything a body touches: glasses you talk to on the street, a $349 audio pair, a December keychain that runs its own voice model over its own 5G radio, a face for video calls you can pick off your gallery, and soon its own email address. The strategy is legible and different from every lab: give the intelligence away, tax the transactions, and win on embodiment and installed base. The counter-story wrote itself the same week, in public: a zero-day that let attackers hijack the agent, an agent that — on a friendly nudge — zips up its own filesystem for the internet to read, and a "heavily inspired by OpenClaw" admission that says where the ergonomics actually came from. Meta's "of course you can see the files" is the most honest and most dangerous sentence of the quarter: transparency you can poke is a feature only until the poking turns into picking. So hold both: the 870-millisecond avatar stack is real engineering at real scale, and the "built from the ground up for safety" claims are still marketing until that Confidential VM ships with keys users hold. Judge Meta by two dates this winter — glasses-agent rollout and December Charm pricing — and judge the whole agent category by one: whose holiday incident breaks first, the delightful one or the dangerous one. The agent wars just moved from chat windows into pockets, and that changes everything about what "shipping" means.