There are small voltage boost converter modules for a couple of dollars.
Will handle a couple of amps on the output.
They say they will operate down to 3v but bear in mind that your AA's voltage will drop below this as they drain down.
A string of LED "fairy lights" is sold at The Dollar Store and uses one AA cell and lights about 20 LEDs.
I have two that have 10 LEDs that can be switched on or switched to flashing and they are powered from one rechargeable AAA cell and are charged from a little solar panel.
The LEDs are all matched so that they are connected in parallel.