hiw3c 日报精选
Hacker News Top 网页快照

HN 发布:Momentic(YC W24)—— 通过使用你的应用来捕捉漏洞的智能体

原文标题 · Launch HN: Momentic (YC W24) – Agents that catch bugs by using your app

HN ⭐ 158 · 107 条评论

来源:Hacker News Top · momentic.ai

正文为英文,可一键机器翻译(仅首次需要等待)

Catch bugs before they ship.

Mo is an AI QA engineer that tests your app end to end. Verify critical flows and find bugs from a prompt.

Trusted in production by teams shipping every day.

"Our team's experience with Momentic has been great. Setting up tests is simple and the developer experience has been fantastic."

"Having E2E QA be part of the development process, run this fast (6.3x parallel), and at this scale (for every single pull request) is a true dream. Seriously, a green CI now has a measurable impact on my sleep quality."

"Momentic makes it 3x faster for our team to write and maintain end-to-end tests. Startups win by shipping faster and better, and Momentic enabled us to do exactly that."

"I just ran our first automated eval across 110 prompts. This would have taken well over an hour manually — I kicked it off in 5 seconds and it was done in 14 minutes. HUGE for us."

"I love working with Momentic. Especially after having years of previous experience in QA, it feels like riding a bike, except the bike is a supercharged electric one!"

Code moves faster. Verification has to keep up.

Coding agents have made it dramatically faster to build software. The bottleneck is now knowing it works. Verification belongs in the agent loop. Agents need evidence from the app itself to verify that their changes deliver the intended behavior.

The agentic quality platform.

Write the user flows you need to verify. Momentic runs the tests against your app. Reuse successful AI actions and review proposed repairs as the app changes.

Add terminology, expected behavior, and test guidance to the Knowledge base. AI-assisted steps look up relevant entries as they run.

Momentic finds controls again when the UI changes during a run. Permanent healing proposes a test-file repair for you to review.

Give your coding agent the changed flow. It can use MCP to author a test, check it in a live session, and save the YAML alongside your code.

Inspect the failing step, screenshots, and traces. Classify failures as application bugs, test flakiness, or environment issues.

Run the CLI in your CI job. Use its exit code as a required check before merging or deploying.

Define what matters. Let Momentic verify it.

Write steps and assertions in plain-English YAML. Review and version the tests in your repository.

Write tests in plain English

Describe a user flow and its expected result in plain English. Keep the steps and assertions in YAML files your team and coding agent can review.

Run locally and in CI

Use the CLI to check the app you're changing. Run the same tests in CI before the next merge or deploy.

Find the root cause

See which step failed and inspect its screenshots and traces. AI triage investigates the cause and proposes a test repair for you to review.

Auto-heal as your product evolves

Momentic finds controls again when the UI changes. Permanent healing proposes test-file edits for review. Apply the diff and rerun to check the result.

Learns how your product works.

Describe your product’s terminology, business rules, and expected behavior in the Knowledge base. Agents use that context to choose actions and check outcomes.

Knowledge base

Give agents the product rules they need to check a flow.

App graph

Maps screens and user flows seen during test runs.

Review new guidance

Review session suggestions before adding them to the Knowledge base.

“Momentic gave us a fast and reliable way to validate Poe.com's AI responses, even when they weren't deterministic.”

“It's like giving someone your QA checklist and watching them execute it for you!”

“With Momentic, we've caught bugs that would have eluded even our most diligent internal tests.”

"Momentic gave us a fast and reliable way to validate Poe.com's AI responses, even when they weren't deterministic."

Momoko F. Head of Product Operations, Quora

"It's like giving someone your QA checklist and watching them execute it for you!"

Sriram S. Engineering Lead, Source Control, Retool

"With Momentic, we've caught bugs that would have eluded even our most diligent internal tests."

"We've already seen a 30% decrease in production incidents thanks to Momentic's automated testing."

"Momentic gives us reliable end-to-end coverage, so we can focus on features instead of maintaining tests."

Ship quality software, on your terms .

Test private apps with SSO and custom data policies. Get dedicated onboarding and priority support. Momentic is SOC 2 Type 2 certified.

SOC 2 Type 2

Independently audited. Compliance reports in the Trust Center.

Contractual uptime SLA

Service scope and uptime commitments are set in your Enterprise agreement.

SSO & RBAC

SAML and OIDC SSO, Admin and Member roles, and audit logs.

Priority support

Priority support and a dedicated account manager for enterprise accounts.

Bugs caught by Momentic

Examples of application failures found by Momentic, with the affected flow and its impact.

New-device 2FA prompt skipped

At a consumer fintech app, a login routing change bypassed the new-device verification step.

A security checkpoint was silently skipped.

Page creation flow broken on mobile

On mobile, keyboard auto-dismissed when creating a new page, breaking content flow.

Silent friction in the core creation flow.

Driver ETA stuck on 'calculating'

A dependency update on a large rideshare app caused the live ETA subscription to silently fail after a ride was booked.

Scheduling availability displayed incorrectly

Incorrect display and logic in the calendar scheduling view.

Timer reset when the screen locked

At a leading wellness app, an iOS lifecycle change reset the active sleep timer the moment the phone locked.

Audio sessions ended mid-playback overnight.

Saved cards dropped at checkout

At a top food-delivery marketplace, a payment-form refactor stopped pre-filling saved cards, forcing manual re-entry to pay.

Returning users abandoned checkout on mobile.

Filters cleared when paginating results

At a popular online retail marketplace, moving to page two reset every active category and price filter.

Shoppers lost their refined search results.

Valid promo codes rejected at the final step

At a large online travel marketplace, a validation change rejected multi-segment promo codes on the last checkout step.

Discounts failed and carts were abandoned.

Wrong subtitle language on first play

At a major streaming platform, a locale-detection bug auto-selected the wrong subtitle track on initial playback.

Wrong-language captions at session start.

Legacy API issues exposed

12 bugs caught in one day. Exposed legacy API issues that would have shipped undetected.

Risked shipping regressions into major release.

Verify what you ship .

Run your first test. Free to start, no credit card.

Changelog

Mo is generally available

Mo is out of beta. Start a session from your coding agent, the app, a PR comment, or the qa CLI. A separate agent reproduces each functional bug before Mo reports it.

QA Bench

We graded Mo, Codex, Claude Code, and Devin on 20 areas of Gitea, Metabase, Twenty, and Saleor. With 60 minutes per area, Mo found about 269 labeled bugs. The next best agent found about 86.

Mo on pull requests

Start Mo from a PR comment, a label, or the CLI. It tests the PR's preview deployment, posts a review with its findings, and sets a Mo commit check.

Effort levels for Mo

Pick low, medium, high, or max for each session, from about 15 minutes of testing for a pull request to about 2 hours for a whole app.

Triage Mo bugs from the CLI

Accept, dismiss, fix, or reopen a bug with qa bugs. A retest keeps the finding and its history, and marks it fixed when Mo can no longer reproduce it.

Hosted browsers GA

Run your tests on browsers Momentic manages. The knowledge base is generally available too, and classification, triage, and AI test selection dropped their beta labels.

Mo in private beta

Mo runs autonomous QA sessions in the cloud, on web or hosted Android and iOS devices, with your org's MCP servers and secrets attached to the session.

AI queries pick their own effort

Each v5 locator and assertion query now routes itself to a fast, medium, or extended effort based on how much reasoning it needs, which also sets its credit usage.

Caches that survive a rebuild

Generated ids are normalized and source-file attributes are left out of the cached selector, so rebuilding your app no longer misses every step.

Cached conditional flows

An AI action can cache a branch now, so the cookie banner that only shows up half the time replays from cache instead of waking the agent again.

Reviewed AI action outcomes

A separate reviewer looks at where the app actually ended up before an AI action passes, and hands the step back with its reasoning when your goal did not happen.

AI routing for repairs

Triage works out what broke each test. It commits the fixes your branch caused, then opens a pull request for every other cause and asks whoever owns it to review.

Android without the Android SDK

Run Android tests on hosted emulators without Android Studio, the SDK, or adb installed on your machine.

Run assertions

Say in plain English what should have been true at some point in a run. Momentic checks it against frames from the run video, so a toast that flashes for a second still counts.

Agent skills

Commit what your agents keep getting wrong about your app to .momentic/skills, and the explore, triage, and result-classification agents read it while they run.

Installation health checks

momentic doctor tells you what is wrong with your setup: CLI and Node versions, sign-in, browsers, project config, and the connection to Momentic. --fix clears out deprecated options.

Analytics API

Pull your finished runs and run groups over REST with an API key. Page through them by cursor and filter by date, status, or platform.

Test snapshots

Capture resolved tests into portable snapshots and replay them in isolation with momentic run --from-snapshot.

Explore agent upgrades

momentic ai explore now supports deeper planning controls, JSON output, and product bug reports with repro steps.

Run visibility upgrades

Runs now expose live progress, structured JSON output, and clearer Run Viewer diagnostics for cache status, retries, conditionals, and loops.

AI Action V3 by default

The V3 agent is now the default everywhere. It plans the flow up front, caches the resolved steps, and self-heals on failure.

Triage agent

momentic ai triage groups failures into labeled buckets, previews the plan with a dry run, and can quarantine what it cannot fix.

Simplified v2 project format

New projects scaffold in the cleaner v2 file format, and momentic upgrade migrates existing projects end to end.

Auto parallelism

Pass --parallel auto and Momentic sizes the worker pool from your host's CPU count for faster local and CI runs.

Email and SMS at runtime

Provision ephemeral inboxes with email.create() and lease numbers from your org pool with sms.lease() right inside a test.

Failure recovery v2

The recovery flow can inspect browser state, run steps, retry the failed step, and refresh stale caches, with per-step visibility.

Classify failures from the CLI

momentic ai classify categorizes a run from its ID or URL so you can route each failure category to the right action.

AI Action V3 for Android

Android AI actions now plan up front, cache resolved steps, and self-heal, matching the web experience.

Mobile video recording

Screen recordings are captured automatically during iOS and Android test runs and stored with the run attempt.

Mobile MCP server

Create tests and modules, run step ranges, and drive emulator sessions for iOS and Android from Claude Code or Cursor.

AI actions always on

AI actions are enabled by default, so the ai.aiAction switch is no longer needed in momentic.config.yaml.

Setup and teardown for mobile

Mobile tests gain dedicated setup and teardown sections so shared preconditions and cleanup live in one place.

iOS testing in beta

Author and run Momentic tests against iOS, with modules, AI actions, and hosted simulators alongside Android.

Momentic MCP server

Start and terminate browser sessions, splice steps, and run step ranges from your coding agent over a stdio MCP server.

Network mocking steps

New request listener, request recording, and mock route step types let agents capture and stub network traffic.

Run resource metrics

The Run Viewer now charts system and process CPU and memory captured during execution to help debug flaky runs.

Mobile failure recovery

Failure recovery now extends to mobile tests, retrying and adapting around transient issues on iOS and Android.

Local run viewer

momentic results view launches a local run viewer to browse results on your machine without uploading anything.

Undo and redo in the mobile editor

Step back and forward through edits in the mobile editor while authoring tests.

Memory for mobile agents

Mobile locator and assertion calls can reuse past results, configurable in momentic.config.yaml and per test.

Upgraded mobile models

Refreshed models for the mobile locator and assertion agents improve accuracy on Android and iOS.

We use cookies to understand how the site is used. See our Privacy Policy .