Write test cases from a spec
Turn a feature spec into a checklist of test cases, including edge cases.
QA · Software · When you ask · Updated
Works with
- Slack
- Box
- Dropbox
- Notion
- Microsoft 365
Slack
Box
Dropbox
Notion
Microsoft 365How do you generate test cases from a spec?
To generate test cases from a spec, send Maito the document in Slack or by email. It reads the spec from Google Drive, Box, Dropbox, Notion or Microsoft 365, writes normal, edge and error cases with expected results, and attaches them as a spreadsheet. It points out places where the spec contradicts itself.
How it's done today
Test plans are written after the feature ships.
What Maito does
- Read the spec
- List normal, edge and error cases
Example
@Maito write test cases for the new invite flow. The spec is in Notion, Invite teammates v2.
24 test cases from the spec: 9 normal, 8 edge, 7 error. Attached: invite-flow-test-cases.xlsx. A few: • TC-07: invite an email that's already in the workspace. Expect 'Already a member' and no email. • TC-12: open an invite link 7 days and 1 minute after sending. Expect the expired page. • TC-19: admin removes the invitee, then they click the link. Catch: the spec contradicts itself. Section 3 says invites expire after 7 days, the FAQ says 14. I wrote TC-12 and TC-13 for 7 and marked them pending. It also doesn't say what happens when the invited person already has an account in another workspace. 3 cases are marked needs decision. From the Notion spec. Leo wrote it. Want me to email him these two questions?
@Maito yes, copy me.
Sent to Leo, with you copied. I'll update the cases when he answers.
Mia (9:15 AM):
write test cases for the new invite flow. The spec is in Notion, Invite teammates v2.
Maito (9:33 AM):
24 test cases from the spec: 9 normal, 8 edge, 7 error. Attached: invite-flow-test-cases.xlsx.
A few:
• TC-07: invite an email that's already in the workspace. Expect 'Already a member' and no email.
• TC-12: open an invite link 7 days and 1 minute after sending. Expect the expired page.
• TC-19: admin removes the invitee, then they click the link.
Catch: the spec contradicts itself. Section 3 says invites expire after 7 days, the FAQ says 14. I wrote TC-12 and TC-13 for 7 and marked them pending. It also doesn't say what happens when the invited person already has an account in another workspace. 3 cases are marked needs decision.
From the Notion spec. Leo wrote it. Want me to email him these two questions?
Mia (9:40 AM):
yes, copy me.
Maito (9:41 AM):
Sent to Leo, with you copied. I'll update the cases when he answers.
How to set it up
- Set up
Nothing to set up. Ask in Slack or by email whenever you need it.
- Connect files
- Google Drive
- Box
- Dropbox
- Notion
- Microsoft 365
Not connected yet? Your agent sends you a link to sign in.
What it won't do
It writes tests from what the spec says. Behavior the spec leaves out is flagged as a gap, not filled in with guesses.
Questions
A file you attach, or a document in Google Drive, Box, Dropbox, Notion or Microsoft 365.
A spreadsheet of test cases grouped as normal, edge and error, each with steps and an expected result.
Yes. Ask it to run chosen cases in a browser and report results with a video.