Politicians have long raised concerns about the extent to which international human rights law affects UK migration policy.