Tell your doctor exactly what you are saying here. There are two general strains of ADHD meds, and even amongst those two the variants tend to have certain side effects.
For me, I had very similar side effects from vyvanse. It did make me very conscious and able to live totally in the moment, which was wonderful. However, it also gave me bad anxiety. For some time my Psych tried to counter that with anti-anxiety meds, but it did not work, so I was switched to Concerta. Concerta and Ritalin are from the same strain, and if Vyvanse is not agreeing with you, it may be a great reason to switch.