This study explores the first East Asian encounters with Western museums by travelers in the nineteenth century. In contrast with our contemporary familiarity with this institution, these travelers had to translate their new discovery into their own meaningful categories. In translating the word “museum,” East Asian travelers composed several words using Chinese character compounds that reveal much about their understanding of the concept in terms of their own culture and language. Moreover, the underlying conceptual categories they invoked shaped their perception of the displays they saw in the various museums they encountered. We see their struggle to settle on a shared term for “museum” so that Kume Kunitake (1839-1931), for example, differentiated the British Museum, the Mauritshuis Museum, and the Swedish Nationalmuseum by employing different common nouns. However, their insights, bewilderment, and even their “misunderstandings” offer us an opportunity to reconsider the modern museum from an external perspective.