In general, I would think there would be no problem but there are a few cases where some care might be needed as it is a natural product and they do advise that it will vary. So some looking at what the bag has will be a good idea. If you get a bag of some gravel and pair it with water that is acidic, you may see some change in the water parameters. But that is just something that is worth being aware of in case you do have that type water. If you have alkaline water with lots of buffering, you are less likely to see any change, so it may be more a matter of how much rinsing and dust is involved.
On the other hand, one might find good value in going to a landscape supply if one is nearby enough to make it practical. They will likely sell it in bulk for a much lower price.