mutlimodal

Stream-Omni is a GPT-4o-like language-vision-speech chatbot that simultaneously supports interaction across various modality combinations.

Probing the limitations of multimodal language models for chemistry and materials research