Over time, as you continue to improve and succeed, your strategy needs to change.
The opportunity cost of your time increases as you become more successful. At first, you just eliminate the obvious distractions and explore the rest. As your skills improve and you learn to separate what works from what doesn't, you have to continually increase your threshold for saying yes.
You still need to say no to distractions, but you also need to learn to say no to opportunities that were previously good uses of time, so you can make space for great uses of time. It's a good problem to have, but it can be a tough skill to master.
In other words, you have to upgrade your “no's” over time.
Upgrading your no doesn't mean you'll never say yes. It just means you default to saying no and only say yes when it really makes sense. To quote the investor Brent Beshore, “Saying no is so powerful because it preserves the opportunity to say yes.”
The general trend seems to be something like this: If you can learn to say no to bad distractions, then eventually you'll earn the right to say no to good opportunities.