How many ad variants do you need?
The useful question is not how many variants, it is what changes between them.
Somebody told you to test three creatives, so you asked for three creatives. They came back and they are genuinely different from each other: different opening, different music, different edit, one has a voiceover and one has captions, two are vertical and one is square.
One of them did better than the other two. You now know that. You do not know why, which means you cannot ask for another one like it, and next month you are back where you started, asking for three more.
That is not a test. It is a raffle you paid to enter.
Why does the number not help you?
Because a variant is only useful if it can be attributed, and attribution comes from what is held still, never from how many things are running.
Two ads that differ in one respect give you a sentence at the end: this opening beat that opening. Two ads that differ in six respects give you a shrug. The winner is real, the money spent was real, and the finding is unusable, because the only honest description of it is that this whole file did better than that whole file, and neither file can be made again.
So the answer to how many is: as many as you can afford to run while changing one thing at a time. That is a structure, and the number falls out of it.
What does one variable at a time actually look like?
It looks duller than you want it to, and that is how you know it is working.
Same body, different hook. One video, cut three ways at the front, identical from the second scene onwards. Now whatever happens at the start is attributable to the start.
Same hook, different first frame. Identical video, but the still that appears before it plays is changed. The thing you are learning here is not about the ad at all, it is about what stops a thumb.
Same video, different opening line. Not a different scene: the same picture with a different sentence said or written over it. This is the cheapest test in the entire list and it is the one people skip, because it does not feel like enough work to count.
Same everything, different angle. The video is rebuilt around a different reason to care, and this is the only one on the list where a genuinely new asset is required.
Notice that three of the four are edits rather than shoots. Most useful testing is done in the timeline, on footage you already own, which is why filming several openings on the day is worth more than any decision you make afterwards.
How do you know your last test taught you anything?
Write the finding down as a sentence before you look at the results. If you cannot fill in the blank, the test could not have worked.
The sentence is: this test will tell me whether ______ beats ______, with everything else the same.
Try that on the last set of ads you ran. If the honest version is this will tell me whether ad A beats ad B, then the answer will be yes or no and nothing will be learned that survives into the next round. The test has produced a winner rather than a reason, and winners expire.
When is testing not worth doing at all?
When the numbers coming back are too small to separate the versions, which is most of the time for most small accounts, and nobody wants to say so.
Here is the mechanism, without any figures in it. Every result you see is the real difference between the ads plus a large amount of luck: who happened to be shown it, what time of day, what they were doing. When the amount of data is small, the luck is bigger than the difference. Split the same budget across more versions and each version gets an even smaller share, so you have made the noise worse and paid for the privilege.
That leads somewhere uncomfortable and worth saying plainly. If your spend is modest, running a wide test is the wrong move. You will get a ranking, you will believe it, and it will not repeat.
What do you do instead of a wide test?
A sequence. One change at a time, each one running long enough to mean something, in an order you decided in advance.
Start with the biggest lever, which is almost always the opening, because it is where the largest number of people leave. Run the current version against one alternative opening. Keep whichever survives. Then change the next thing on the list: the first frame, then the on-screen line, then the angle.
This is slower than testing five at once and it accumulates, which testing five at once does not. Each round leaves you with a fact you can carry into the next brief. After a few months you have a short list of things you know about your own customers, in your own category, which no general advice could have given you.
One caution. If you change the opening and the audience targeting in the same week, you have two explanations and no way to separate them. Whatever you are testing, everything else in the account stays where it was, including the parts that feel unrelated.
What to change on the next round
Take the ads you are running now and write down, in one line each, what is different between them. If the list runs past two items, you are not testing, and the next brief should ask for the same video with one thing changed rather than three new ideas.
The decision that follows is a temperamental one rather than a technical one: whether you would rather have a winner this month or a reason you can use for the rest of the year.
Keep reading
This is a service, and the method is written down.
Everything above came out of doing the work rather than writing about it. If you want the method instead of the story, it runs in order on one page.
Start with a free audit
Tell us where your content is now. We will come back with what we would change and what result to expect.
A person reads the channel and writes the audit by hand: a considered read typically takes three working days. That is the usual shape, not a promised turnaround. We use these details only to reply to you: no lists, no lurking.
What you will get
A fit snapshot: where your channel stands, and whether we are a match.
Two to three opportunities: specific, prioritised, yours to keep.
A recommended next step, even if that step is not us.
The audit is free and commits you to nothing: nobody follows up with a call you did not ask for.