Rybczak estimates that about 90% of startups in Y Combinator are focused on AI. He says YC is also investing in hardware and robotics, in part because the field has not yet had a ChatGPT-like breakthrough.
Who Tests AI-Written Code?
Speaker
At AI T Conf in Warsaw, Szymon Rybczak, CEO of TesterArmy and a former Callstack developer, talks with Callstack’s Luke Farrell and Ola about his startup journey and AI-assisted software testing.
Rybczak and co-founder Oscar built open-source developer tools while working at Callstack, including React Native AI and React Native Bottom Tabs. After trying several B2C ideas, they focused on a problem they saw in their work: manual testing could not keep pace with AI-assisted coding and frequent releases.
TesterArmy tests web and mobile apps, including native and React Native apps on iOS and Android emulators. Users can start with a website URL or app binary, then connect source code so the system can read pull request diffs and descriptions to create a tailored test plan. Teams can also provide business rules to help distinguish intended behavior from bugs.
The hosted product manages the platform and selects models for users. Rybczak says the team plans to open-source a TypeScript SDK called E2E, intended to support tests for web, mobile, desktop, and other software; its mobile support will use Agent Device and let users bring their own AI key and cloud.
Rybczak says the first TesterArmy logo was AI-generated, then founding designer Veronica created the pixel-art logo and animation. He sees agentic testing tools as a way to equip QA teams, rather than replace them.
Takeaways
- Look for bottlenecks that remain after AI speeds up another part of the workflow; Rybczak saw manual testing lag behind faster coding.
- Use pull request diffs and descriptions to focus test plans on the changes being shipped.
- Let teams provide business rules when automated tests need context about intended behavior.
- Offer a quick-start path, such as a URL or app binary, so users can try a testing product before a sales process.
- Frame QA automation as tooling for QA teams, not as a replacement for their expertise.
Mentioned in this talk
Search inside this talk
What was claimed 14
- works atSzymon Rybczak works at
Callstack“I'm a senior software developer at Callstack.”
YouTube Verified2 sources· Talk
- previously atSzymon Rybczak previously atCallstack
“you used to work at Callstack”
YouTube Unverified1 source· Talk
- metricTesterArmy: About 90% of startups are focused on AI
“about 90% of startups are all about AI”
YouTube Unverified1 source· Talk
- previously at
“who's also a former Callstack employee”
YouTube Unverified1 source· Talk
- foundedOscar founded TesterArmy
“I'm now building a company with Oscar”
YouTube Unverified1 source· Talk
- foundedSzymon Rybczak founded TesterArmy
“I'm now building a company with Oscar”
YouTube Unverified1 source· Talk
- featureTesterArmy: Agentic testing for web and mobile, including native apps and React Native on iOS and Android emulators
“an agentic testing platform that supports both web and mobile”
YouTube Unverified1 source· Talk
- featureTesterArmy: Learns about an app and accepts business-specific logic
“the TesterArmy agent learns about the app”
YouTube Unverified1 source· Talk
- featureTesterArmy: Can test a website from a URL or an app from an uploaded binary
“providing a URL to your website or uploading a binary file”
YouTube Unverified1 source· Talk
- featureTesterArmy: Reads pull request diffs and descriptions to create a dynamic test plan
“We read the diff and the description, then create a dynamic test plan”
YouTube Unverified1 source· Talk
- featureE2E: Planned TypeScript SDK to create tests for web, mobile, desktop, and other software
“It will be a TypeScript SDK to control and create tests for web, mobile, desktop”
YouTube Unverified1 source· Talk
- usesE2E uses Agent Device
“For mobile, it will use Agent Device under the hood.”
YouTube Unverified1 source· Talk
- featureTesterArmy: Hosted product supplies its own infrastructure
“we bring our own infrastructure”
YouTube Unverified1 source· Talk
- acquiredTesterArmy acquired
Y CombinatorAccepted into the accelerator“After we got into Y Combinator”
YouTube Unverified1 source· Talk
