This study conducted experiments using Stipa grandis, the dominant species of the typical steppe in Inner Mongolia. The research explored the different effects of mowing and grazing on organic carbon, total nitrogen, available nitrogen, total phosphorus and available phosphorus in rhizosphere and bulk soil. The results showed that: Both mowing and grazing inhibited assemble and storage capacity of rhizosphere, and decreased the organic carbon, total nitrogen, and available nitrogen contents in rhizosphere soil. The rhizosphere effect on total phosphorus in soil was found to be insignificant because of its high immobility. Available phosphorus in soil was distributed heterogeneously. Available soil phosphorus under mowing and grazing changed but the difference was not significant between rhizosphere and bulk soil. Grazing drastically reduced the number of soil microbes. The availability of soil nutrients was significantly correlated with soil microbial numbers. The status of soil nutrients could be more closely aligned with the change in bacteria and fungi. Grazing brought about greater soil nutrient loss and soil microbe loss than did mowing.