I would take the Bible. It was offered as a gift. Find out which church or service that you are being invited to. Go to it. OH I forgot to mention, put on a ritual robe, MUCH jewelry and or large pentragram and go.
Now when the church people stumble overselves, you can say: "Well, you did invite me."
I know I am such a B-A-D pagan.