https://testomatica.com/blog/ Notes on testing at AI speed from the Testomatica Team. en-us https://testomatica.com/blog/early-access-is-open.html https://testomatica.com/blog/early-access-is-open.html Mon, 02 Nov 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Company Testomatica is opening to a small group of early teams. What onboarding looks like, who it's for, and what's still rough. https://testomatica.com/blog/halloween-silent-bugs.html https://testomatica.com/blog/halloween-silent-bugs.html Sat, 31 Oct 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Culture A crash at least screams. The bugs that keep us up at night return 200 OK and look perfectly fine. https://testomatica.com/blog/a-qa-teammate-for-coding-agents.html https://testomatica.com/blog/a-qa-teammate-for-coding-agents.html Wed, 21 Oct 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Product Coding agents can now ask Testomatica what a change will affect, which rules apply and which tests to run, before they write the code. https://testomatica.com/blog/measuring-360-coverage.html https://testomatica.com/blog/measuring-360-coverage.html Fri, 16 Oct 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Engineering "What did we test?" deserves a real answer. Here's how a coverage map turns a vague feeling into a number. https://testomatica.com/blog/every-bug-becomes-a-test.html https://testomatica.com/blog/every-bug-becomes-a-test.html Thu, 08 Oct 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Product Agents explore, a referee proves, and the finding becomes regression coverage. Your safety net grows with every release. https://testomatica.com/blog/first-dry-run-on-staging.html https://testomatica.com/blog/first-dry-run-on-staging.html Fri, 02 Oct 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Field notes Two dry runs, one laptop, one VPN. What the referee confirmed, what the agent got wrong, and what we're changing. https://testomatica.com/blog/impact-graph-for-agent-code.html https://testomatica.com/blog/impact-graph-for-agent-code.html Wed, 23 Sep 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Product A coding agent changes a SQL procedure. Which pages, rules and tests does that touch? We built a graph to answer that from the diff. https://testomatica.com/blog/x-marks-the-bug.html https://testomatica.com/blog/x-marks-the-bug.html Sat, 19 Sep 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Culture It's Talk Like a Pirate Day, so here's a bug report written like a treasure map. Turns out pirates had decent instincts about reproducible steps. https://testomatica.com/blog/programmers-day-second-pair-of-eyes.html https://testomatica.com/blog/programmers-day-second-pair-of-eyes.html Sun, 13 Sep 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Culture Programmers' Day falls on day 256, two to the eighth. A small celebration of the people who write code, and of the habit of asking someone else to look. https://testomatica.com/blog/why-we-built-on-playwright.html https://testomatica.com/blog/why-we-built-on-playwright.html Thu, 03 Sep 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Engineering Every test Testomatica writes is a plain Playwright test in TypeScript. You can run it without us, keep it if you leave, and read it like any other code. https://testomatica.com/blog/when-a-test-system-says-stop.html https://testomatica.com/blog/when-a-test-system-says-stop.html Wed, 26 Aug 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Product A production deploy asks one question: go, stop, or ask a human? Here's when we think a test system has earned the right to answer stop. https://testomatica.com/blog/confidence-you-can-calculate.html https://testomatica.com/blog/confidence-you-can-calculate.html Thu, 20 Aug 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Product We don't ask the model how sure it is. Our confidence score is three numbers multiplied together, and you can check the math yourself. https://testomatica.com/blog/evidence-on-every-run.html https://testomatica.com/blog/evidence-on-every-run.html Tue, 11 Aug 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Product A failing run without evidence is an argument. A passing run without evidence is a guess. Here's what we save on every attempt, and for how long. https://testomatica.com/blog/staging-is-not-production.html https://testomatica.com/blog/staging-is-not-production.html Wed, 05 Aug 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Methodology Staging has real-looking data but none of the real traffic. The rules we follow so tests on staging tell the truth instead of telling stories. https://testomatica.com/blog/sysadmin-day-staging.html https://testomatica.com/blog/sysadmin-day-staging.html Fri, 31 Jul 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Culture The last Friday of July is SysAdmin Day. A thank-you to the people who keep staging running, and a promise about how our tests will treat it. https://testomatica.com/blog/budgets-not-hopes.html https://testomatica.com/blog/budgets-not-hopes.html Thu, 23 Jul 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Engineering Agent exploration costs money every step. We cap it per run and per day, and when the money's gone, agents stop and the deterministic tests keep going. https://testomatica.com/blog/read-the-diff-first.html https://testomatica.com/blog/read-the-diff-first.html Tue, 14 Jul 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Product An agent exploring a whole store at random wastes most of its time. Ours starts with the diff and the ticket, then decides where to look. https://testomatica.com/blog/rules-every-store-should-check.html https://testomatica.com/blog/rules-every-store-should-check.html Wed, 08 Jul 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Engineering Seven checks that hold for almost any online store, why each one matters, and why every rule has to catch a broken page before it can block a release. https://testomatica.com/blog/independence-from-the-checklist.html https://testomatica.com/blog/independence-from-the-checklist.html Sat, 04 Jul 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Opinion The manual regression checklist did its job for years. On the Fourth of July, a few thoughts on what should replace it, and what shouldn't. https://testomatica.com/blog/infra-failure-is-not-a-test-failure.html https://testomatica.com/blog/infra-failure-is-not-a-test-failure.html Thu, 25 Jun 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Engineering When the VPN drops or the model provider is down, nothing is wrong with your product. Our design keeps those two kinds of red very far apart. https://testomatica.com/blog/fathers-day-fix-it-once.html https://testomatica.com/blog/fathers-day-fix-it-once.html Sun, 21 Jun 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Culture A dripping kitchen faucet, a patient dad, and the testing habit we keep coming back to: when you fix something, make sure it stays fixed. https://testomatica.com/blog/a-browser-a-model-and-a-loop.html https://testomatica.com/blog/a-browser-a-model-and-a-loop.html Thu, 11 Jun 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Engineering Our first rough prototype of an exploring agent is small: a handful of browser tools, a model, and a log a referee can replay without AI. https://testomatica.com/blog/why-our-referee-never-uses-ai.html https://testomatica.com/blog/why-our-referee-never-uses-ai.html Tue, 02 Jun 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Product The part of Testomatica that decides whether a finding is real has no model in it. That's on purpose, and here's why. https://testomatica.com/blog/oracles-ranked.html https://testomatica.com/blog/oracles-ranked.html Wed, 27 May 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Methodology Not every reason to call something broken is equally trustworthy. Here's the order we trust them in, with one store example for each. https://testomatica.com/blog/what-accessibility-scans-cant-see.html https://testomatica.com/blog/what-accessibility-scans-cant-see.html Thu, 21 May 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Quality What axe-core and WCAG 2.2 rules catch reliably, and the parts that still need a person with a keyboard and a screen reader. https://testomatica.com/blog/quarantine-first.html https://testomatica.com/blog/quarantine-first.html Wed, 13 May 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Engineering A new test doesn't block a release on day one. It has to prove it's stable first, and "ten green runs" isn't enough proof. https://testomatica.com/blog/mothers-day-check-it-twice.html https://testomatica.com/blog/mothers-day-check-it-twice.html Sun, 10 May 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Culture A small Mother's Day story about a stove, a front door, and the oldest verification habit any of us learned. https://testomatica.com/blog/may-day-the-work-we-automate.html https://testomatica.com/blog/may-day-the-work-we-automate.html Fri, 01 May 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Opinion May Day is about work and the people who do it. A good moment to be clear about which parts of QA we want machines to take, and which belong to people. https://testomatica.com/blog/earth-day-greenest-test.html https://testomatica.com/blog/earth-day-greenest-test.html Wed, 22 Apr 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Engineering Model calls cost money and energy. Most testing doesn't need one. A short note on why our regression runs with no LLM at all. https://testomatica.com/blog/the-coverage-universe.html https://testomatica.com/blog/the-coverage-universe.html Thu, 16 Apr 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Engineering Code coverage tells you which lines ran. It can't tell you whether anyone checked the checkout on a slow phone. So we're drawing a bigger map. https://testomatica.com/blog/session-based-testing-for-agents.html https://testomatica.com/blog/session-based-testing-for-agents.html Tue, 07 Apr 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Methodology Charters, time boxes and debriefs were invented to make human exploration accountable. They turn out to be exactly what an AI explorer needs too. https://testomatica.com/blog/bugs-that-look-like-jokes.html https://testomatica.com/blog/bugs-that-look-like-jokes.html Wed, 01 Apr 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Culture Some bugs are so absurd they read like a prank. That's exactly why they slip through. A short tour of the funny ones and why we check for them. https://testomatica.com/blog/risk-is-for-sorting.html https://testomatica.com/blog/risk-is-for-sorting.html Wed, 25 Mar 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Methodology Likelihood times impact is a fine way to decide what to test first. It's a bad way to decide what to skip. Here's how we use it. https://testomatica.com/blog/metamorphic-testing-shopping-cart.html https://testomatica.com/blog/metamorphic-testing-shopping-cart.html Thu, 19 Mar 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Methodology You often can't say what the right answer is. You can say how two answers must relate. That idea is behind a whole family of our checks. https://testomatica.com/blog/pi-day-two-out-of-three.html https://testomatica.com/blog/pi-day-two-out-of-three.html Sat, 14 Mar 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Methodology Pi starts with a 3, and so does our referee. A short, friendly walk through the math behind accepting a finding at 2 out of 3 replays. https://testomatica.com/blog/the-testers-who-taught-us-to-explore.html https://testomatica.com/blog/the-testers-who-taught-us-to-explore.html Sun, 08 Mar 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Culture For International Women's Day, a thank-you to three testers whose books shaped how we think about exploration and whole-team quality. https://testomatica.com/blog/personas-are-browser-settings.html https://testomatica.com/blog/personas-are-browser-settings.html Tue, 24 Feb 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Engineering Telling a model to pretend it's on a slow phone doesn't make the network slow. Why our personas are configuration first and character second. https://testomatica.com/blog/llm-suggests-code-decides.html https://testomatica.com/blog/llm-suggests-code-decides.html Thu, 19 Feb 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Methodology AI bug verdicts are right about one time in four. Here's the setup that keeps AI useful without flooding you with false alarms. https://testomatica.com/blog/love-letter-to-deterministic-tests.html https://testomatica.com/blog/love-letter-to-deterministic-tests.html Sat, 14 Feb 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Opinion Everyone's excited about AI agents. On Valentine's Day, we'd like to say a few kind words about the boring tests that actually hold things together. https://testomatica.com/blog/checking-vs-testing.html https://testomatica.com/blog/checking-vs-testing.html Thu, 05 Feb 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Methodology Some work in QA is checking, some is testing, and mixing them up is how AI tools end up crying wolf. How the distinction shaped our design. https://testomatica.com/blog/data-privacy-day.html https://testomatica.com/blog/data-privacy-day.html Wed, 28 Jan 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Security A testing agent that can see everything is a liability. These are the privacy rules we wrote down before writing any code. https://testomatica.com/blog/blue-monday-red-builds.html https://testomatica.com/blog/blue-monday-red-builds.html Mon, 19 Jan 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Engineering A one percent flake rate sounds harmless. Across 150 tests, it blocks most deploys. Here's the math, and what one retry does to it. https://testomatica.com/blog/forty-papers-on-ai-testing.html https://testomatica.com/blog/forty-papers-on-ai-testing.html Tue, 13 Jan 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Research Two weeks, about forty papers and a lot of coffee. Here's what changed our minds about AI testing, and what didn't. https://testomatica.com/blog/the-verification-gap.html https://testomatica.com/blog/the-verification-gap.html Wed, 07 Jan 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Opinion Teams pay for coding agents and CI minutes. Almost nobody has a line item for checking what those agents produce. https://testomatica.com/blog/new-year-same-bugs.html https://testomatica.com/blog/new-year-same-bugs.html Thu, 01 Jan 2026 00:00:00 GMT hello@testomatica.com (Testomatica Team) Company Code got faster. Checking it didn't. A new year, a small team, and the question we couldn't stop asking over the holidays.