New clients just make your business bigger. Good clients make your business better. And they make your life better long-term.
One of the biggest business lies is One Stop Shop syndrome, where a business claims to cover all your needs, but is mediocre at most of them. Don't do that.
There is great business opportunity in helping lazy-ass clients do less work and go home at 5pm.