Ask the Podcast Coach: After Further Review | What the Metrics Are Really Telling Me
After the microphones are off, I like to go back to the tape.
After Further Review is where I revisit a few things I said on Ask the Podcast Coach, look at them with the benefit of a little time and perspective, and decide what I’d add, clarify or change.
This week I’m reviewing three moments from Ask the Podcast Coach 595, “Is Podcast Advertising Doomed?”, published October 3, 2026.
Listen to the full episode here.
This isn’t a recap of the show, and it isn’t a review of Dave. I’m looking at my own comments and asking whether the call still holds up after another look.
[42:46] | Vanity Metrics Are Still Metrics
The Call on the Field
While we were talking about measuring social-media experiments, I said:
“Vanity metrics are still metrics.”
What I meant was that I’m trying to separate two different things in my YouTube Shorts testing: whether YouTube is actually serving the Short, and whether people choose to stay once it does. Those are related, but they are not the same measurement.
Under Review
A metric doesn’t become useless just because somebody calls it vanity.
If YouTube barely serves a Short, I may be looking at a distribution problem. If YouTube serves it widely and people immediately swipe away, I may have a content problem. The end result may look equally disappointing, but the diagnosis is completely different.
After Further Review
After further review, I’d sharpen what I said on the show this way: there really aren’t vanity metrics; there are metrics being asked to answer the wrong question.
I’ve seen that repeatedly in my Shorts testing. A good example is “Taylor Swift Was the One Topic Off Limits.” That Short reached roughly 1,300 views and had a strong Stayed to Watch rate, so it told a pretty clean story: YouTube gave it a chance, and a meaningful percentage of people chose to stay.
Other Shorts have told different stories. One can win on views, another can have the best Stayed to Watch rate, and another can show strong average percentage viewed even though too many people leave right at the start.
None of those numbers is wrong. They are just measuring different parts of the experience.
That’s changed how I look at the experiment. I’m less interested now in asking how many views a Short got and more interested in whether YouTube gave it a chance, whether the opening earned attention, and whether people stayed once they stopped scrolling.
One of the clearest lessons has been how important the opening one to three seconds are, which is why I’ve been moving toward stranger-friendly hooks instead of assuming viewers already know the guest, episode or context.
The most important part may still be the uncomfortable line I said on the show:
“Maybe my stuff, people don’t want to stay for it.”
That’s not fun to admit, but it’s useful. If the platform gives the content an opportunity and people repeatedly leave, eventually I have to review the content instead of blaming the algorithm.
Analytics aren’t there to congratulate me or insult me. They’re there to give me evidence, and my job is to understand what that evidence is actually saying.
The Ruling
Call Confirmed — with clarification.
Vanity metrics are still metrics, but a metric becomes vanity when I use it to tell myself a story it cannot actually prove.
Know what you’re trying to learn first, then use the metric that can actually tell you something about it.
[50:46] | There’s No Free Lunch in Creator Growth
The Call on the Field
We were talking about creators who share impressive growth stories, often while selling the system that supposedly produced those results. I said:
“There’s great principles in there. Please, on your side, you’ve got to put the work and the effort…”
And then I got to the part I think matters most:
“There’s no free lunch.”
Some creators have teams. Some arrived early. Some are paying other people to edit, post, schedule and produce. If I’m doing those same things myself, the cost hasn’t disappeared. I’m simply paying for it with my time.
Under Review
The point wasn’t that successful creators are exaggerating their results or that there’s nothing to learn from them.
The danger is copying the result without understanding the inputs.
Someone says Shorts grew their channel, so I should make Shorts. Someone says publish every day, build a newsletter, start a community or make more clips.
Those ideas may be perfectly good. But every one of them has a cost.
After Further Review
I’ve felt that directly in my own work lately.
The Shorts experiment is a good example. Once I figured out a repeatable process, creating them became easier, but it never became free. I still have to find the cuts, build them, publish them, measure them and learn from the results.
The same is true for clips, show notes, WordPress posts and everything else surrounding the shows.
AI and automation have absolutely helped me do more than I could have done a few years ago, but they mostly change where the work happens. They don’t eliminate the need to decide what is actually worth doing.
Before copying somebody else’s growth strategy, I need to understand what it really costs them to produce the result. They may be spending money where I’m spending time, or they may have staff, an existing audience or resources that I don’t have.
The useful question isn’t simply, “Did this work for them?” It’s whether the result is worth the required input for me.
The Ruling
Call Stands.
There is no free lunch in creator growth.
You can pay with money, you can pay with time, and increasingly you can use technology to reduce the bill. But somebody—or something—still has to do the work.
The goal isn’t to copy somebody else’s output. It’s to build a system whose cost you can actually sustain.
[30:27] | Consistency Isn’t the Same as Frequency
The Call on the Field
When we got into social promotion, I said the biggest thing I was learning from my recent experiments was consistency.
I talked about how I had resisted Shorts for a long time, finally found a workflow that made them easier, then started publishing more aggressively. At one point, one of my longtime subscribers actually messaged me and said I was blowing up his YouTube feed.
That was useful feedback.
I adjusted back toward a more sustainable pace, roughly one Short a day, without abandoning the experiment.
Under Review
What I was trying to say is that consistency matters, but consistency does not mean flooding the channel.
There is a point where publishing more stops feeling like presence and starts feeling like noise.
That matters because there are two audiences in play. There is the algorithm, which may reward regular activity, and there are the actual humans who already chose to follow me.
I have to serve both.
After Further Review
After further review, I think the better way to say it is this:
Algorithms may reward consistency, but humans experience frequency.
That distinction has become pretty obvious in my own work.
The Shorts experiment worked better once I stopped thinking in terms of bursts and started thinking in terms of a repeatable rhythm. Posting a pile of content all at once may technically increase output, but it can also overwhelm the people I already have.
The same lesson applies beyond Shorts. I’ve been more consistent on X lately, testing posts and watching what comes back. I’m not trying to be everywhere. I’m trying to be useful in places where I’m comfortable enough to keep showing up.
That matters more than forcing myself onto every platform because somebody says I should.
Consistency only works if I can sustain it and the audience can tolerate it.
The Ruling
Call Confirmed.
Consistency matters.
But consistency is not volume for volume’s sake. It is showing up often enough to learn, improve and stay visible without exhausting yourself or the people already paying attention.
A sustainable rhythm beats a temporary flood.
Final Whistle
Looking back at these three calls, I think there’s a common thread running through all of them.
Growth gets easier to understand when I stop looking for one magic number, one magic platform or one magic strategy.
The metrics have context. The tactics have costs. And even something as simple as “be consistent” has to fit both the platform and the people on the other side of it.
That’s probably the biggest thing I’m taking away from this round of experiments: measure carefully, pay attention to the tradeoffs, and give the work enough time to teach you something.
You can hear the full conversation in Ask the Podcast Coach 595, “Is Podcast Advertising Doomed?”
