They argued that the Trump administration should have gone all out with the H-1B restrictions by levying an annual fee on all H-1B visa holders.