1. They are almost always NiMH
Most cordless handsets take one or two rechargeable AAA cells, printed as AAA or HR3. The battery door says how many and which size, and the type is written on the cell itself.
2. Check the type, not just the size
A nickel-metal hydride (NiMH) cell gives about 1.2 volts, against 1.5 for alkaline. The handset charges its own cells, so it needs NiMH. An alkaline cell will not charge properly and can leak in the compartment.
3. Give a new cell two or three cycles
A new NiMH cell often arrives partly charged, and it needs a few full charges in the handset before it gives a full day of talk time.
4. Change them together
One new cell next to an old one gives an uneven supply, and the old cell can make the handset show a low battery early. Replace both at once, with cells of the same age and make.
5. Clean the contacts when it will not charge
The metal contacts in a handset turn dull and green over time. Wipe them with a dry cloth, or a cotton bud with a little rubbing alcohol, and check that the cell is the right way round.