Refugees may be voluntarily staying out of the U.S.