I want to build muscle
Hold the dumbells with all: move your arms around in circles, doesn't really matter, do sit ups with something hold your feet and as the dumbbells are on your chest, then just pushups.
I do push-ups, pull-ups and sit-ups and it works. That light weights are useless. I used to lift a heavily loaded rucksack, you can try that too.