Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already declare readOnlyHint=false, idempotentHint=true, destructiveHint=false and openWorldHint=false, which tells the agent this is a safe, repeatable local mutation. The description adds only the fact that both addition and removal are supported in one call. It says nothing about what happens when a label is unknown, whether add and remove may overlap, or any auth requirement — acceptable given annotations, but thin.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.