As with so many other questions, the answer is: well, it depends.....
As a musician, you are able to play any sound your instrument can make at any time during a piece.
What makes you a musician instead of a technician is that the sounds you choose to make and when you choose to make them (or not) will be, well, *musical*.
What's musical (or not) is of course, subject to opinion.
Listen actively, choose wisely.
)BOB