shitty C pointer arithmetic

Why are pointers in C aligned to the size of their data? Why cant they just reference memory bytewise?

How can i manipulate a pointer so that it references a address not by its own size, without typecasting it?

You can't, the behaviour would be undefined, and it's a stupid thing to do anyway. Don't do it. If you really wanted to, learn assembly. Then realize that it's a stupid idea. Then don't do it.