Fifty years ago, Electronics Illustrated showed this pointer for testing batteries with a multitester. Just measuring the voltage won’t do much good, as the battery will probably show its full voltage, even if depleted, with no load.
The solution is to put a resistor in parallel across the battery. If the battery shows full voltage across this 100 ohm resistor, it’s probably good.
These days, multitesters are even cheaper than they were 50 years ago. In fact, occasionally stores will give them away free. If you don’t have one around the house, get one, as you won’t know what you did without it.
Some of the meters below give you an idea of how inexpensive they are these days.
If you don’t have that 100 ohm resistor in your junque box, you can also get it on Amazon.
Some links on this page are affiliate links, meaning that this site gets a small commission if you make a purchase after clicking on the link.