SCIM: Simultaneous Clustering, Inference, and Mapping for Open-World Semantic Scene Understanding