i started out using gloves, found i couldn't feel properly ,i find I'm allot gently with out th am.Do get hit every now and than ,i put it down to being ruff.
Doesn't have anything to do with you being rough or not, (well, you def don't wanna go at it like a bull in a china shop) some hives will just have bees that are more ornery at any particular moment. Moods change, one day a hive is nice and gentle, another day, that same hive may have a few that wanna hit ya.
I don't generally wear gloves (rubber ones) either but always have them close by in case a hive goes psycho.
I always give my hives smoke before exploring.