Our knowledge of the external world is central to our lives as rational agents as we engage with the world in every step we take. How can there be an external world if the knowledge we have of it is determined by how we are designed as epistemic agents? The problem affects the advanced sciences the most due to the referential norm: science aims to discover basic joints of nature. If the world itself is a construction of science, what is there to discover? However, there is also the striking fact that the human mind can find mathematical forms all over nature. These joints suggest a strong notion of reality grasped by humans. The scientific mode of inquiry is not available in common life. Does that mean that our lives are mostly lived in phenomenal fiction? In the Tagore–Einstein conversation, Tagore makes the obvious point that physics itself is a human enterprise, as with any other human creation such as music, poetry, painting and sculpture. A range of Tagore's poetry is analysed at this point to show that one way to grasp the world is simply to live in the world in terms of the rich experiences furnished thereof. But then such a conception of the world is grounded in a very different form of inquiry.