Hi Edwin,
I opened a case about this fairly recently. There was no satisfactory answer, it is not possible to "ignore them" currently.
I would say it is worth posting as an idea. You had the ability to chose associations in a more granular way in 9.1 but it was removed in 10.x.
Regards,
Toby