I not too good on identifying bugs, but check out this site. He has a lot of information on roses plus pictures of rose pest. http://www.sactorose.org/rosebug/

I had both a whitefly & aphid infestation after some neighbors who did not take care of their plants moved nearby. I also do not like insecticides. On my outdoor plants I kept cleaning underneath the leaves by flushing them with water or wiping them with an alcohol pad. I removed any leaf that looked like it was developing a population. It did not solve the problem but minimized it. I also had a problem inside my greenhouse. Like Willard, I got rid of all the plants & media, scrubbed the greenhouse, did not use it for awhile, & started from scratch. My neighbors & their infested plants eventually moved, & thatÂs when the pests finally stopped. You need to make sure what bugs you have if you want to specifically treat your problem. UC Davis has a good site for pests & peppers. You can get a magnifying glass & compare your bugs to the pictures. Sticky traps may help. If you are going to keep the plant you need to isolate it from other plants or they may become infested. Also, here is also the USDA whitefly database: http://whiteflies.ifas.ufl.edu/wfly0002.htm?

Spring aphids tend to congregate on tender new growth & buds and then work their way down under leaves directly below. The white flecks you see on the leaf under the bud shoot in your first photo are the skins shed by the aphid nymphs/juveniles as they grow. Aphids suck the sap/juice from the plant rather than chewing on it, and excrete a sticky substance called honeydew. I keep an eye out this time of year for their arrival, and when I first see what you have, take action. Some use a hand spritzer of water with a drop of liquid dish soap shaken up in it to kill aphids by direct contact. Used to do that years ago & it's effective, but when the hand sprayer eventually broke, went on to my current practice of dealing with early arrivals. I slide thumb & fingers from below the group up the stem & over the bud in a steady motion to remove them. Wiping the residue off fingers onto a kleenex or paper towel, the leaves then get the same treatment with fingers held like scissors in the rock, paper, scissors hand game, with two extended fingers closed over the stem end of the leaf & drawn along to the tip, treating both sides of the leaf at once. If the stem or leaf is sticky after the aphids have been dealt with, I'll go over the stems, buds & leaves again with a kleenex dampened with water between my fingers to remove the residue. I'd call your aphids moderate, having seen them many aphids thick obscuring the tender growth, so should be easily remedied. When they're very thick, I use a kleenex dampened with rubbing/isopropyl alcohol to remove both aphids & residue. (Rubbing alcohol is cheap & found with bandaids in groceries & pharmacies. Keep a bottle in the pail that holds clippers, gloves etc. ready for the garden, as well as some poured into a jar the clipper blades fit into for disinfecting between pruning cuts. Handy stuff!) Afterwards I'll use the hose with a watering wand set to a fine spray to wash away any remains. If I using the alcohol, I spritz with water immediately after to prevent the alcohol from drying out the new growth. Shortly after dispatching the first Spring aphids, the good bugs usually show up right on cue & take care of any more that crop up. First on the scene are usually ladybugs & their newly hatched ladybug lions. Many wild birds here & the small ones love to perch sideways on the branches & groom the roses of aphids & other pests. Christopher, we also enjoy three companion African Grey parrots & their daily discards go along with bird seed to feed our wild friends & neighbors. Birdbaths, fountain, pond & stream slake their thirst. Tend to use the hose to knock them off more with Summer aphids, as I find it hard to keep the right blast strength with the tender Spring growth. With the watering wand, I start at the top & go down each branch hosing the top & bottom of leaves. Of all the rose pests in this garden, aphids are the easiest to discourage.

I found a cool site that lists a number of common garden pests in Australia (includes those that can impact citrus) - https://blog.fantasticgardenersmelbourne.com.au/common-garden-pests-australia/ You may have a couple of things doing something to those leaves.