Why is "y" not considered a vowel?

I understand that saying: a,e,i,o,u and sometimes y. And that every word needs a vowel, the word "why" is an example of "y" covering for a vowel. "y" also has a short sound AND a long sound. How come it is just not a vowel?