Note Visibility should be able to be toggled while in the people panel view and not just the project candidate panel view. When a note has a context associated with the project, it shouldn't matter if you are in candidate view or not - you should be able to toggle that notes visibility on or off from any panel view since you know it will be associated with that project context anyway.