Well... there must be some limitations for the shops & stuff
And the things you can produce in them!
You shouldnt be able to have a super-blacksmith!
The garden thing is a good idea. A herb garden would be
a nice extension
Satrek is right, building should take a REALLY BIG amount of materials
and it should require teamwork...