Why does Orchard Bank have a P.O. Address if they are not a Scam?

The moment I saw that they had an annual fee I called and canceled. They failed to tell me up front my credit limit. I never received a credit card or charged a thing. When I call they say that my card is account is canceled and all fees waved but then I just got my second notice for $64.57. Of course they have a PO Box and I can't send them a registered letter. Apparently they are lying to me. The woman just told me that I can't record her saying my account is closed and there are no fees or charges owing. I asked her to write me a letter stating that and she said they already did. Then why did they send this past due statement! SCAM is what a lot of people say online and I agree with them!