No...There isnt anything to say that your elements have to match your charts you know. If you take taijutsu, you dont use an element. The reason for the elements is for certain attacks.
Using an obvious example, Rasengan. It is normally a neutral element, just a blob of chakra, but you can add in an element to it to make it stronger. What element you can add to it to determined by what two you pick when you make your character.
If you want your character to be like Rock Lee, then elements wont really matter because you would have really no chakra manipulation skills at all. On the other hand you can look at Asuma for ways of how elements can really help out someone who uses taijutsu.