Is it shallow/narrow-minded that I don't want to date someone because they smoke?

No, I find smoking a gross habit. Just like guys that chew dip. It is repulsive and unattractive. If you really like him you can get him to quit. If he cares about you, he will try to quit smoking both pot and cigarettes.