shitty C pointer arithmetic

Why are pointers in C aligned to the size of their data? Why cant they just reference memory bytewise?

How can i manipulate a pointer so that it references a address not by its own size, without typecasting it?

>>25
Yes, It's ugly. Guess what? Its even fuglier in every other language you can use, except assembly.