I would leave the white trim around the doors but I guess it wouldn’t hurt to try painting it the same as the door. You can always paint it white again if needed :)