There are 8 bits to a byte.
But what has an infinite number of bites to a bit?

Bites to a bit or bytes to a bit? If it's bites to a bit, you could technically use bites to encode data by establishing what kind of bite encodes a 0 and what kind encodes a 1. Then, as long as the material is soft enough you could encode a bit with a single bite.

So the answer for infinite bites to a bit is my roommate's five day old baguette.

A time loop.

A horse?

If you bite a snake it will bite you back indefinitely.

@devdiddydog I mean, if you bite it in half then I mean... Not indefinitely lol

@spongessuck A horse harness contains a metal "bit" that the horse continually bites. Yay! You win!

A byte isn't necessarily 8 bits.

@Demolishun It would have to be an immortal horse, surely?