Shooting blind as I have no first-hand experience with this, but you may find people in a similar "isolated immigrant" situation in language courses for the local language.
They'll probably not all be native English speakers, but it's usually the Lingua Franca in these things.
It also depends on the country and your range of interests, but universities usually tend to have a significant number of foreign students (specially if they're free). Maybe you could look into university-related events and programmes that are open to the general community.