Handling button inside NavigationLink without selecting link or navigating?

In my macOS SwiftUI app I have a list of "layers" on the left. Clicking on a layer focuses it on the right for acting upon. Each link has a little eye icon that's used to toggle visibility of that layer in the view to the right.

I'd like to be able to click on that eye button without selecting the layer or activating it. Is that possible?
Handling button inside NavigationLink without selecting link or navigating?
 
 
Q