I don't like the idea of full on mat farm. I like the idea that's been brainstormed here on the forum of little flower beds, or planters (which are crafted by players) that are just for decoration but maybe drop one or two materials a day.
I think it would be good decoration, and gives a nice touch of time progression in housing, without being exploitable.