The U.S. is facing a steep decline in international travelers—and this fee will only make it worse, say tourism officials.