Hi Dan. I have used pea gravel in landscaping and don't think it would alter your water chemistry at all. But I do think lots of uneaten foods and poo will end up down in the gravel and unless you do a complete gravel vacume almost everyday there will sure be a whole lot of debris that will accumulate in there. At least with a sand bottom the debris stays on top to clean up easily.
Barbara