‘The Holy Family were refugees. This is not political interpretation, this is the reality described,’ the church says.