Language, particularly grammar, and thus meaning, and thus perception, is hard wired in us and in our environment.
Seminal sources that you might have relied on are Chomsky's transformational grammar, Lenneberg's Biological foundations of Language, and Neisser's Cognitive Psychology. These sources would lead us to a whole series of qualifications and detailed expressions that would undermine much of what you think you can conclude.
Chomsky's transformational grammar works so well because it creates on organizational structure that ignores semantic structure (meaning). How we obtain meaning from the world is not understood very well, but it clearly involves complex cognitive and perceptual processes that lead our understanding in very different directions as we develop. The foundations that govern our patterns of interactions may be hard wired, but the specializations among those patterns can and do lead us in very different directions. By the time a child is 5 years old (or so), he has differentiated sufficiently to belong to a culture which will be somewhat unique.
So being hard-wired may not be that big a deal.