Please don't judge me as I know this will sound cheap 
I have some leftover cactus potting soil and I was planning to grow some rosemary in a pot. (I don't have masses of space to keep leftover multipurpose soil bags or a garden to properly grow herbs ATM)
Is there anything I need to take into account regarding potting mixes to plant edible plants in, or would any of them be safe (thinking mainly of whether they are going to contain anything toxic or not be sterile enough for this purpose)
I try to avoid those supermarket pots with herbs in, as IME they usually come with some sort of bug and I find them a bit disgusting.
Similarly for fertiliser, would fruit and vegetable organic fertiliser be safe to use?