AI & ML interests
LLM
Recent Activity
Papers
MOSS-Image Technical Report
Mechanics of Long-Context Hybrid Models Part 1.1: From Hybrid Attention to Hybrid Position
A unified multimodal large language model for end-to-end speaker-attributed, time-stamped transcription.
-
MOSS Transcribe Diarize: Accurate Transcription with Speaker Diarization
Paper ⢠2601.01554 ⢠Published ⢠66 -
MOSS Transcribe Diarize
š¢106Transcribe audio or video with speaker diarization
-
OpenMOSS-Team/MOSS-Transcribe-preview-2B
Automatic Speech Recognition ⢠2B ⢠Updated ⢠377 ⢠54 -
OpenMOSS-Team/MOSS-Transcribe-Diarize
Audio-Text-to-Text ⢠0.9B ⢠Updated ⢠119k ⢠505
-
OpenMOSS-Team/moss-video-preview-base
Video-Text-to-Text ⢠11B ⢠Updated ⢠44 ⢠16 -
OpenMOSS-Team/moss-video-preview-sft
Video-Text-to-Text ⢠11B ⢠Updated ⢠88 ⢠18 -
OpenMOSS-Team/moss-video-preview-realtime-sft
Video-Text-to-Text ⢠11B ⢠Updated ⢠65 ⢠28 -
OpenMOSS-Team/Realtime-QA-100K
Viewer ⢠Updated ⢠100k ⢠294 ⢠8
-
OpenMOSS-Team/MOSS-TTS
Text-to-Speech ⢠8B ⢠Updated ⢠6.61k ⢠435 -
OpenMOSS-Team/MOSS-TTS-Local-Transformer
Text-to-Speech ⢠3B ⢠Updated ⢠150k ⢠32 -
OpenMOSS-Team/MOSS-TTS-Realtime
Text-to-Speech ⢠2B ⢠Updated ⢠22.2k ⢠115 -
OpenMOSS-Team/MOSS-TTS-Nano-100M
Text-to-Speech ⢠Updated ⢠115k ⢠247
Opensource Lorsas and Transcoders
-
OpenMOSS-Team/MOSS-TTSD-v1.0
Text-to-Speech ⢠8B ⢠Updated ⢠11.8k ⢠63 -
OpenMOSS-Team/MOSS-TTSD-v0.7
Text-to-Speech ⢠2B ⢠Updated ⢠171 ⢠18 -
OpenMOSS-Team/MOSS-TTSD-v0.5
Text-to-Speech ⢠2B ⢠Updated ⢠321 ⢠54 -
OpenMOSS-Team/MOSS-TTSD-v0
Text-to-Speech ⢠2B ⢠Updated ⢠28 ⢠28
Evaluating Agentic Backend Coding Capabilities in Real-World Development Scenarios
-
ABC-Bench: Benchmarking Agentic Backend Coding in Real-World Development
Paper ⢠2601.11077 ⢠Published ⢠67 -
OpenMOSS-Team/ABC-Bench
Viewer ⢠Updated ⢠224 ⢠203 ⢠4 -
OpenMOSS-Team/Qwen3-32B-ABC
Text Generation ⢠33B ⢠Updated ⢠33 ⢠3 -
OpenMOSS-Team/Qwen3-8B-ABC
Text Generation ⢠8B ⢠Updated ⢠582 ⢠3
[ICLR 2026] Game-RL: Synthesizing Multimodal Verifiable Game Data to Boost VLMs' General Reasoning
An Efficient Training Framework for Diffusion Language Models
-
World Modeling Makes a Better Planner: Dual Preference Optimization for Embodied Task Planning
Paper ⢠2503.10480 ⢠Published ⢠58 -
Unleashing Embodied Task Planning Ability in LLMs via Reinforcement Learning
Paper ⢠2506.23127 ⢠Published ⢠2 -
World-aware Planning Narratives Enhance Large Vision-Language Model Planner
Paper ⢠2506.21230 ⢠Published ⢠1 -
OpenMOSS-Team/Embodied_R1-ScienceWorld
8B ⢠Updated ⢠28 ⢠1
The MHA2MLA model published in the paper "Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-Based LLMs"
-
OpenMOSS-Team/SmolLM-135M-MLA-d_kv_8-refactor
Text Generation ⢠0.1B ⢠Updated ⢠28 ⢠1 -
OpenMOSS-Team/SmolLM-135M-MLA-d_kv_32-refactor
Text Generation ⢠0.1B ⢠Updated ⢠26 ⢠1 -
OpenMOSS-Team/SmolLM-135M-MLA-d_kv_16-refactor
Text Generation ⢠0.1B ⢠Updated ⢠24 ⢠1 -
OpenMOSS-Team/SmolLM-360M-MLA-d_kv_8-refactor
Text Generation ⢠0.3B ⢠Updated ⢠29 ⢠1
-
OpenMOSS-Team/moss-moon-003-sft-plugin
Text Generation ⢠Updated ⢠136 ⢠72 -
OpenMOSS-Team/moss-moon-003-sft
Text Generation ⢠Updated ⢠177 ⢠129 -
OpenMOSS-Team/moss-moon-003-base
Text Generation ⢠Updated ⢠163 ⢠132 -
OpenMOSS-Team/moss-moon-003-sft-int4
Text Generation ⢠Updated ⢠131 ⢠41
openeta: embodied task agent
An open-source audio understanding model supporting speech recognition, environmental sound analysis, music understanding, time-aware QA, and complex
-
MOSS Audio 8B Thinking
š¢30Generate answers from uploaded audio or video
-
OpenMOSS-Team/MOSS-Audio-4B-Instruct
Audio-Text-to-Text ⢠5B ⢠Updated ⢠3.96k ⢠90 -
OpenMOSS-Team/MOSS-Audio-4B-Thinking
Audio-Text-to-Text ⢠5B ⢠Updated ⢠462 ⢠39 -
OpenMOSS-Team/MOSS-Audio-8B-Instruct
Audio-Text-to-Text ⢠9B ⢠Updated ⢠1.52k ⢠56
-
OpenMOSS-Team/MOSS-VL-Instruct-0408
Video-Text-to-Text ⢠11B ⢠Updated ⢠173 ⢠108 -
OpenMOSS-Team/MOSS-VL-Base-0408
Video-Text-to-Text ⢠11B ⢠Updated ⢠116 ⢠64 -
OpenMOSS-Team/MOSS-VL-Instruct-0708
Video-Text-to-Text ⢠11B ⢠Updated ⢠253 ⢠34 -
OpenMOSS-Team/MOSS-VL-Base-0708
Video-Text-to-Text ⢠11B ⢠Updated ⢠93 ⢠19
-
AI Can Learn Scientific Taste
Paper ⢠2603.14473 ⢠Published ⢠319 -
OpenMOSS-Team/SciJudgeBench
Viewer ⢠Updated ⢠732k ⢠363 ⢠11 -
OpenMOSS-Team/SciJudge-4B-2605
Text Generation ⢠4B ⢠Updated ⢠89 ⢠6 -
OpenMOSS-Team/SciJudge-30B-2605
Text Generation ⢠31B ⢠Updated ⢠792 ⢠4
True Speech-to-Speech Langugage Model
First Omni-modal Future Forecasting Benchmark
https://github.com/OpenMOSS/FRoM-W1
Proactive Robot Manipulation in Omni-modal Context
Open source weights of Lorsa modules introduced in "Towards Understanding the Nature of Attention with Low-Rank Sparse Decomposition".
The MHA2MLA model published in the paper "Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-Based LLMs"
-
Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
Paper ⢠2502.14837 ⢠Published ⢠4 -
OpenMOSS-Team/Llama-2-7B-MLA-d_kv_16
Text Generation ⢠6B ⢠Updated ⢠18 ⢠1 -
OpenMOSS-Team/Llama-2-7B-MLA-d_kv_32
Text Generation ⢠6B ⢠Updated ⢠21 ⢠1 -
OpenMOSS-Team/Llama-2-7B-MLA-d_kv_64
Text Generation ⢠7B ⢠Updated ⢠28 ⢠1
openeta: embodied task agent
A unified multimodal large language model for end-to-end speaker-attributed, time-stamped transcription.
-
MOSS Transcribe Diarize: Accurate Transcription with Speaker Diarization
Paper ⢠2601.01554 ⢠Published ⢠66 -
MOSS Transcribe Diarize
š¢106Transcribe audio or video with speaker diarization
-
OpenMOSS-Team/MOSS-Transcribe-preview-2B
Automatic Speech Recognition ⢠2B ⢠Updated ⢠377 ⢠54 -
OpenMOSS-Team/MOSS-Transcribe-Diarize
Audio-Text-to-Text ⢠0.9B ⢠Updated ⢠119k ⢠505
An open-source audio understanding model supporting speech recognition, environmental sound analysis, music understanding, time-aware QA, and complex
-
MOSS Audio 8B Thinking
š¢30Generate answers from uploaded audio or video
-
OpenMOSS-Team/MOSS-Audio-4B-Instruct
Audio-Text-to-Text ⢠5B ⢠Updated ⢠3.96k ⢠90 -
OpenMOSS-Team/MOSS-Audio-4B-Thinking
Audio-Text-to-Text ⢠5B ⢠Updated ⢠462 ⢠39 -
OpenMOSS-Team/MOSS-Audio-8B-Instruct
Audio-Text-to-Text ⢠9B ⢠Updated ⢠1.52k ⢠56
-
OpenMOSS-Team/moss-video-preview-base
Video-Text-to-Text ⢠11B ⢠Updated ⢠44 ⢠16 -
OpenMOSS-Team/moss-video-preview-sft
Video-Text-to-Text ⢠11B ⢠Updated ⢠88 ⢠18 -
OpenMOSS-Team/moss-video-preview-realtime-sft
Video-Text-to-Text ⢠11B ⢠Updated ⢠65 ⢠28 -
OpenMOSS-Team/Realtime-QA-100K
Viewer ⢠Updated ⢠100k ⢠294 ⢠8
-
OpenMOSS-Team/MOSS-VL-Instruct-0408
Video-Text-to-Text ⢠11B ⢠Updated ⢠173 ⢠108 -
OpenMOSS-Team/MOSS-VL-Base-0408
Video-Text-to-Text ⢠11B ⢠Updated ⢠116 ⢠64 -
OpenMOSS-Team/MOSS-VL-Instruct-0708
Video-Text-to-Text ⢠11B ⢠Updated ⢠253 ⢠34 -
OpenMOSS-Team/MOSS-VL-Base-0708
Video-Text-to-Text ⢠11B ⢠Updated ⢠93 ⢠19
-
OpenMOSS-Team/MOSS-TTS
Text-to-Speech ⢠8B ⢠Updated ⢠6.61k ⢠435 -
OpenMOSS-Team/MOSS-TTS-Local-Transformer
Text-to-Speech ⢠3B ⢠Updated ⢠150k ⢠32 -
OpenMOSS-Team/MOSS-TTS-Realtime
Text-to-Speech ⢠2B ⢠Updated ⢠22.2k ⢠115 -
OpenMOSS-Team/MOSS-TTS-Nano-100M
Text-to-Speech ⢠Updated ⢠115k ⢠247
-
AI Can Learn Scientific Taste
Paper ⢠2603.14473 ⢠Published ⢠319 -
OpenMOSS-Team/SciJudgeBench
Viewer ⢠Updated ⢠732k ⢠363 ⢠11 -
OpenMOSS-Team/SciJudge-4B-2605
Text Generation ⢠4B ⢠Updated ⢠89 ⢠6 -
OpenMOSS-Team/SciJudge-30B-2605
Text Generation ⢠31B ⢠Updated ⢠792 ⢠4
Opensource Lorsas and Transcoders
-
OpenMOSS-Team/MOSS-TTSD-v1.0
Text-to-Speech ⢠8B ⢠Updated ⢠11.8k ⢠63 -
OpenMOSS-Team/MOSS-TTSD-v0.7
Text-to-Speech ⢠2B ⢠Updated ⢠171 ⢠18 -
OpenMOSS-Team/MOSS-TTSD-v0.5
Text-to-Speech ⢠2B ⢠Updated ⢠321 ⢠54 -
OpenMOSS-Team/MOSS-TTSD-v0
Text-to-Speech ⢠2B ⢠Updated ⢠28 ⢠28
True Speech-to-Speech Langugage Model
Evaluating Agentic Backend Coding Capabilities in Real-World Development Scenarios
-
ABC-Bench: Benchmarking Agentic Backend Coding in Real-World Development
Paper ⢠2601.11077 ⢠Published ⢠67 -
OpenMOSS-Team/ABC-Bench
Viewer ⢠Updated ⢠224 ⢠203 ⢠4 -
OpenMOSS-Team/Qwen3-32B-ABC
Text Generation ⢠33B ⢠Updated ⢠33 ⢠3 -
OpenMOSS-Team/Qwen3-8B-ABC
Text Generation ⢠8B ⢠Updated ⢠582 ⢠3
First Omni-modal Future Forecasting Benchmark
[ICLR 2026] Game-RL: Synthesizing Multimodal Verifiable Game Data to Boost VLMs' General Reasoning
https://github.com/OpenMOSS/FRoM-W1
An Efficient Training Framework for Diffusion Language Models
Proactive Robot Manipulation in Omni-modal Context
-
World Modeling Makes a Better Planner: Dual Preference Optimization for Embodied Task Planning
Paper ⢠2503.10480 ⢠Published ⢠58 -
Unleashing Embodied Task Planning Ability in LLMs via Reinforcement Learning
Paper ⢠2506.23127 ⢠Published ⢠2 -
World-aware Planning Narratives Enhance Large Vision-Language Model Planner
Paper ⢠2506.21230 ⢠Published ⢠1 -
OpenMOSS-Team/Embodied_R1-ScienceWorld
8B ⢠Updated ⢠28 ⢠1
Open source weights of Lorsa modules introduced in "Towards Understanding the Nature of Attention with Low-Rank Sparse Decomposition".
The MHA2MLA model published in the paper "Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-Based LLMs"
-
OpenMOSS-Team/SmolLM-135M-MLA-d_kv_8-refactor
Text Generation ⢠0.1B ⢠Updated ⢠28 ⢠1 -
OpenMOSS-Team/SmolLM-135M-MLA-d_kv_32-refactor
Text Generation ⢠0.1B ⢠Updated ⢠26 ⢠1 -
OpenMOSS-Team/SmolLM-135M-MLA-d_kv_16-refactor
Text Generation ⢠0.1B ⢠Updated ⢠24 ⢠1 -
OpenMOSS-Team/SmolLM-360M-MLA-d_kv_8-refactor
Text Generation ⢠0.3B ⢠Updated ⢠29 ⢠1
The MHA2MLA model published in the paper "Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-Based LLMs"
-
Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
Paper ⢠2502.14837 ⢠Published ⢠4 -
OpenMOSS-Team/Llama-2-7B-MLA-d_kv_16
Text Generation ⢠6B ⢠Updated ⢠18 ⢠1 -
OpenMOSS-Team/Llama-2-7B-MLA-d_kv_32
Text Generation ⢠6B ⢠Updated ⢠21 ⢠1 -
OpenMOSS-Team/Llama-2-7B-MLA-d_kv_64
Text Generation ⢠7B ⢠Updated ⢠28 ⢠1
-
OpenMOSS-Team/moss-moon-003-sft-plugin
Text Generation ⢠Updated ⢠136 ⢠72 -
OpenMOSS-Team/moss-moon-003-sft
Text Generation ⢠Updated ⢠177 ⢠129 -
OpenMOSS-Team/moss-moon-003-base
Text Generation ⢠Updated ⢠163 ⢠132 -
OpenMOSS-Team/moss-moon-003-sft-int4
Text Generation ⢠Updated ⢠131 ⢠41