Try rinsing your plant with lightly warm water. Remove lady bugs first. Some of the aphids may wash off. You can also try taking a damp cloth to wipe stems and leaves. I've done this and it works half the time. The only other thing you can do is buy or make insecticidal soap. It's chemical free and will get rid of the aphids but won't harm the plant.