It's a lady beetle. But not a larva. Instead it's a pupa, the next step on the way to becoming a lady beetle. It goes like this: egg; larva; pupa; adult. With time, the pupal case will split down the back and an adult lady beetle will step out. Congrats. You have successful biological control going on at your place!

I tried to rinse them off, ==>>> its more of a blasting them off ... not just a dip and rinse .... indoors i would use the kitchen sink.. if you have a hard enough spray ... or the shower if you have a hand shower head .... you want enough pressure.. just short of injuring too many leaves .. the last pic above.. 'looks' heavily stippled on the back of the leaf.. if so .... you are going to have to be pretty aggressive .. if you could do it outdoors.. the hose would even work ... there are a host of things you could use on non-edible plants .... so thats out ... as to doing it by hand... well ... using the old cost benefit ratio ... it might be cheaper the throw them out ... and go buy some new herb plants .. rather than spend hours trying to do it by hand .... most likely ... you will have to do this once a week until you are sure they ... and all the generations are gone ... ken

@Vicky Renee OMG this is one fear that I had to make myself overcome when I started gardening (and am still working on it...) My coworker who is an avid gardener always laugh at how "urban" i am lol She talks about giving slugs "tummy tucks"......I don't think I'll be doing that anytime soon lol

if you see no damage.. there is nothing to do about them ... but knowledge is power.. so dont get me wrong on getting an ID ... it appears to be a pollinator ... but how many of us grow roses for rose hips ... besides... you cant spray a bloom.. or it is immediately ruined .. and done with ... so what can you do about it??? sorry i cant ID it... ken