This solves a massive headache. The drift between externally generated tests and an active codebase is a brutal problem to maintain.
Using vision-based execution instead of brittle XPaths is a great baseline, but moving the test definitions to live directly alongside the repo context is definitely the real win here.
Did you find that generating the YAML from the codebase context entirely eliminated the "stale test" issue, or do developers still need to manually tweak the generated YAML when mobile UI layouts change drastically? Great project!
> The shift for me was realizing test generation shouldn’t be a one-off step. Tests need to live alongside the codebase so they stay in sync and have more context.
Does the actual test code generated by the agent get persisted to project?
If not, you have kicked the proverbial can down the road.
15 comments
Monorepos have many benefits chiefly being able to commit atomically reduces incidental complexity from drift.
It’s good enough for Google and Facebook!
Using vision-based execution instead of brittle XPaths is a great baseline, but moving the test definitions to live directly alongside the repo context is definitely the real win here.
Did you find that generating the YAML from the codebase context entirely eliminated the "stale test" issue, or do developers still need to manually tweak the generated YAML when mobile UI layouts change drastically? Great project!
If not, you have kicked the proverbial can down the road.
We do something similar in our company for web with playwright but facing a lot of flaky tests.
Will check this out