Understanding Byte and Bit

What is the difference between a bit and a byte, and how are they utilized in computing?