Limit to this workspace option still shows all workspaces apps

As the title says I've enabled the option "limit to this workspace" but on plank I can still see all the apps from all the workspaces. If I click an already opened app I'm brought to it's corresponding workspace.

Using Arch Linux with gnome. Did I misunderstood the behavior of this option maybe?

Edit: RIght clicking-> open new, launch a new instance of the selected application. Clicking it normally bring in focus that workspace's instance, while right clicking allows to select the other instances on the other workspaces.