I have some best friends since my school days, years ago. I am the only person among them who is baptized. We all meet twice a year and during that meeting they all drink and smoke. I don't drink and smoke since I was baptized. They are all good, sincere people and don't do any bad activities, except drinking and smoking and even that is done without disturbing anyone. They don't compel me to drink. Shall I avoid those drinking meetings or can I continue?
"I wrote you in my letter not to associate with immoral people; I did not at all mean with the immoral people of this world, or with the covetous and swindlers, or with idolaters, for then you would have to go out of the world. But actually, I wrote to you not to associate with any so-called brother if he is an immoral person, or covetous, or an idolater, or a reviler, or a drunkard, or a swindler--not even to eat with such a one" (I Corinthians 5:9-11).
We can't isolate ourselves from worldly people. If we did, we would never get the Gospel taught to others. What you are describing is not bad, so long as being with them doesn't tempt you to sin. If you have no desire to drink and smoke, there is no reason not to enjoy the company of your friends on these occasions.