it's fine, but you will only specialize in one language stat that way. if you want to broaden your horizons but maybe miss out on some of the highest tier skills (not very useful, you get to bully people with gimmicky grammar rule casts but that's about it), try switching around to a different cuisine for a while and stick with it, if anything you made the smarter call by not eating all around and never being able to consistently level up any of your trees