Currently, there is no way to turn off notifications in Slack when someone comments on a task that you are following. This is a request to add the option to be able to do so.