I've compiled these examples first hand over the years and can count on them to provide real signal when evaluating a product or investment. These factors apply to almost all types of businesses except for consumer social. That means it should not matter if you're building a hard-tech product (like
Sonic Fire), or a B2B SaaS company (like
PassNinja) - they will apply.
ICP willingness to talk is nice - Getting your ideal customer profile to talk to you is a very helpful signal, the further they are from you socially, the better. The higher the likelihood the better. Why? Your mom loves you. Your moms co-worker cares about her and by proxy cares about you. Some dude you met in a telegram group? Probably doesn't care about you at all, but does care about his own problems.
If I can convince at least 1 in every 10 strangers I reach out to directly to respond to me, I will assign this factor a value of 0.8. I will add 2 basis points for each additional person, per 10 strangers I reach out to - stopping at 0.99. Anything below 1 in 10, is 0.5.
I deliberately use the word stranger, because you should not know these people!
This is an easy way to start to understand if you will have PMF before having a product, but it can easily be a false positive if you're not discerning about your ICP. For instance, if you reach out to 10 BD or sales people, you will likely get 8+ of them responding to you emphatically - it's their job!
Pre-sales are top tier signal - Getting strangers you do not know personally, to pay you for your product before it even exists is typically the strongest indicator that you are onto something. It implies the problem you're aiming to solve is so pressing, that people will use their imagination and faith in the hope of solving their problem. The further you are from product, the better. So just an email describing the solution with no pictures is best, conversation second best, mockups third, etc etc
If I can pre-sell some product once, I'll assign this factor a value of 0.80. Each additional pre-sale adds 1 basis point to the factor up to 0.99. So 20 pre-sales would give us 0.99.
You can't use this factor in perpetuity, as once you have a product, it's moot. If this is the case, leave the factor out of the equation.
Support tickets are premium - Having people pay for pre-sales is a very strong signal, but sometimes there are externalities that are not accounted for in pre-sales. Things like recommendations from bosses to solve a problem (even if the subordinate doesn't think it's a problem) can lead to false positives on the pre-sale factor. As an additional factor, I like to include the number of support tickets that come in once the product is live. Having people open support tickets usually indicates that at a bare minimum, people are trying to use your product, couldn't and care enough about their problem to make it yours too. In the ideal case, they accomplished their goal, but have some feedback about how they wish it worked instead.
Now you don't need some fancy support ticket software like Zendesk for this, just having open lines of communication with users is good enough. SMS, WhatsApp, iMessage, Slack, etc are all valid for getting your support tickets from users.
For the first 25 product iterations or 12 weeks (whichever happens last): If I can get at least 1 support ticket for every 20 customers, that I'll assign this factor a value of 0.75. For each additional unique customer writing in per 20 customers, I'll add 5 basis points up to 0.99.
After the first 25 product iterations or 12 weeks (whichever happens last): The factor inverts. Meaning, ideally you get less than 1 support ticket for every 50 customers. If you're at 1 support ticket per 50 or under, you set the factor to 0.95. For each additional unique customer writing in per 50 customers, deduct 3 basis points - all the way down to 0.5.
This factor should change over time, to go down.
Growth rate speaks volumes -
Paul Graham's essay on Growth should be a canonical text for all startup founders. It is an amazing composite of all of the above factors that you can measure weekly. The takeaway for us here is that you should be growing your core metric (which should be either revenue, or active users, in my opinion) at a minimum of 5% week over week, once you have launched your product. The cool thing here is that this is very easy to do at the outset, and becomes much harder as time goes on, so you don't get to play on easy mode once you get decent at this.
Looking at this as the average weekly growth rate for the last 4 weeks, I assign this factor a value of 0.4 for anything under 5%, 0.7 for 5-6% and 10 basis points for each break above 6% until 0.99. So an average weekly growth rate of 8.1% for the last month is 0.9 and a growth rate of 12% for the last month, 0.99.
Retention is the last factor - There are a hand full of ways to measure retention, but my favorite for evaluating PMF is to use Net Dollar Retention. There are some good resources for understanding the underlying methodology. Here are my two favorite resources:
stripe +
saas cfo. This retention number basically tells you if your customers find what you're doing for them valuable enough to spend more money with you over time. Hugely valuable for understanding PMF.
This factor takes time to crystallize, so in the early months (up to about month 4 of the product being live), I just leave it off the equation. Once I have some data, I score anything under 100% NDR as 0.5, 100-110% as 0.8 and then add 1 basis point for each 5% increase over 110% NDR up to 0.99. So 200% NDR would be 0.98 factor.