In order to adjust the volume by speech command using Google Assistant, face the smart speaker and speak aloud the percentage you want to set the volume to (0 - 100), followed by "percent".
Ex. If you want to set the volume to "5", tell Google Assistant "volume 5 percent".