Phoneme

The smallest sound unit that distinguishes meaning in a language — swap one and the word changes.

English /p/ and /b/ are separate phonemes because "pat" and "bat" mean different things.
Inventories range from about a dozen phonemes in Rotokas to well over a hundred in !Xóõ.
A phoneme is an abstraction: its actual sound varies by context while the contrast stays constant.