I think small-medium amounts of exp should be given when you...:
Mine a rock (physique)
Successfully cast a spell (magic)
Hit a monster with a bullet/bolt/missile/etc spell (magic)
Successfully concealing self (agility)
Making a bow successfully (whatever bowyer was in)
Smithing a weapon or armor or tool if you have Smithing skill (whatever smithing is in)