Why are you majoring in physics? Do you plan to do IP?
In general, BA vs. BS, no, one is not respected more than the other. Most admissions books will tell you this, with the slight caveat that a low GPA in an easy major, like Women's Studies, may be less respected than the same GPA in Physics.
I'm against changing a major based on how you think admissions counselors will view your application. Make sure you spend those 4 years studying what you want to study.