Log inSign up
Ai2
3,744 posts
Image
user avatar
Ai2
@allen_ai
Breakthrough AI to solve the world's biggest problems. › Join us: allenai.org/careers › Newsletter: tinyurl.com/3vc2r2m8
Seattle, WA
allenai.org
Joined September 2015
440
Following
85.1K
Followers
  • Pinned
    user avatar
    Ai2
    @allen_ai
    May 7
    Today we’re bringing new NSF OMAI compute online with NVIDIA Blackwell Ultra-powered systems, turning a $152M national investment from @NSF & @nvidia into a foundation for truly open AI research. 🧵
    Image
    Image
    Image
    291K
  • Ai2 reposted
    user avatar
    William Merrill
    @lambdaviking
    17h
    New work from @YanhongLi2062 digging into the specific tokens that hybrid models predict better than transformers 📈 Spoiler alert: gains are broad across token categories, especially large on content words. Gains diminish on copying tokens, but even there hybrids aren't worse
    user avatar
    Ai2
    @allen_ai
    19h
    Hybrid (transformer–RNN) models are fast becoming a serious alternative to the transformer, but a big question remains: how do they process tokens differently & how does this impact performance? We compared our transformer (Olmo 3) & hybrid (Olmo Hybrid) models to find out. 🧵
    Image
    1.9K
  • user avatar
    Ai2
    @allen_ai
    19h
    Hybrid (transformer–RNN) models are fast becoming a serious alternative to the transformer, but a big question remains: how do they process tokens differently & how does this impact performance? We compared our transformer (Olmo 3) & hybrid (Olmo Hybrid) models to find out. 🧵
    Image
    13K
    user avatar
    Ai2
    @allen_ai
    19h
    Replying to @allen_ai
    We find that filtering loss by token type is a promising way to spot architecture differences. Overall loss (left) makes transformers & RNNs appear even, with hybrids ahead. Filtered losses (center, right) reveal where transformers & RNNs each shine.
    Image
    1.2K
    user avatar
    Ai2
    @allen_ai
    19h
    We hope this kind of token-level comparison helps the field build better, more architecturally diverse models. Going forward, we plan to explore applications of these findings to pretraining evals. ✍️ Blog: allenai.org/blog/hybrid-to… 📄 Tech report: arxiv.org/abs/2606.20936
    Image
    Which tokens does a hybrid model predict better? | Ai2
    From allenai.org
    1.1K
  • user avatar
    Ai2
    @allen_ai
    Jun 24
    MolmoSpaces is our open leaderboard for robot policies. Congrats to @NVIDIARobotics on the current top spot. Anyone can submit a policy and try to beat it: molmospaces.allen.ai/leaderboard
    user avatar
    NVIDIA Robotics
    NVIDIA
    @NVIDIARobotics
    Jun 24
    Cosmos 3 wins another leaderboard. The power of an open frontier model. 🎉 Ranked #1 on @allen_ai's MolmoSpaces robot policies leaderboard, a policy model post-trained on Cosmos 3 Nano shows the strongest performance in environments that require models to interpret, reason, and
    Image
    4.5K
  • user avatar
    Ai2
    @allen_ai
    Jun 18
    Learn how @aisquaredai & @domynai used Olmo, our family of fully open language models, to build their own models for regulated industries like finance, healthcare, & the public sector. 🧵
    Image
    3.6K
    user avatar
    Ai2
    @allen_ai
    Jun 18
    Replying to @allen_ai @aisquaredai and @domynai
    In AISquared's platform, Bolt now handles request routing & acts as a policy guardrail. For Domyn, our Dolci dataset added 10.1 points to Domyn-Small on GPQA-Diamond, a graduate-level science reasoning benchmark—its biggest single post-training gain.
    Image
    956
    user avatar
    Ai2
    @allen_ai
    Jun 18
    The throughline: for AI labs working in high-stakes domains, the bar isn't just capability—it's transparency & control. Ai2's full openness is what puts that within reach. 📝 Read more:
    Image
    How Domyn and AISquared built on Ai2's open releases | Ai2
    From allenai.org
    826
  • Ai2 reposted
    user avatar
    Jieyu Zhang
    @JieyuZhang20
    Jun 17
    MolmoMotion is not just another cool work built on top of Molmo2’s video grounding capabilities. It shows grounding in 3D can enable motion forecasting (for both data and capabilities), which serves as an objective and representation for controllable video generation and
    user avatar
    Ai2
    @allen_ai
    Jun 17
    We're releasing MolmoMotion, a 3D motion forecasting model. Given one or a few video frames, 3D points on an object, & an instruction like "Put the white bowl on the table," MolmoMotion predicts where those points will go over the next few seconds in a shared 3D world frame. 🧵
    Image
    00:00
    3.6K
  • Ai2 reposted
    user avatar
    Jason Ren
    @RenZhongzheng
    Jun 17
    Thrilled to introduce MolmoMotion🚀where we found 3D motion prediction is becoming very doable with existing tools. And this capability can be very useful for downstream tasks like Robotics📷and VideoGen📷 As always, MolmoMotion is fully open! Great work led by @jianingnz
    user avatar
    Ai2
    @allen_ai
    Jun 17
    We're releasing MolmoMotion, a 3D motion forecasting model. Given one or a few video frames, 3D points on an object, & an instruction like "Put the white bowl on the table," MolmoMotion predicts where those points will go over the next few seconds in a shared 3D world frame. 🧵
    Image
    00:00
    3.1K
  • Ai2 reposted
    user avatar
    Zixian Ma@CVPR
    @zixianma02
    Jun 17
    Very cool project with nice applications of motion prediction in video generation and robotics! Also cool to see positive transfer from Molmo2’s video pointing & tracking capabilities to motion prediction 📈
    user avatar
    Ai2
    @allen_ai
    Jun 17
    We're releasing MolmoMotion, a 3D motion forecasting model. Given one or a few video frames, 3D points on an object, & an instruction like "Put the white bowl on the table," MolmoMotion predicts where those points will go over the next few seconds in a shared 3D world frame. 🧵
    Image
    00:00
    2.4K
  • Ai2 reposted
    user avatar
    Rustin Soraki
    @rustinsoraki
    Jun 17
    We released MolmoMotion today, and I’m excited to finally share it! Give it a frame, mark a few points on an object, and say what you want to happen. It traces where they travel in 3D over the next few seconds. The weights, data, and benchmark are all open, so give it a try 👇
    user avatar
    Ai2
    @allen_ai
    Jun 17
    We're releasing MolmoMotion, a 3D motion forecasting model. Given one or a few video frames, 3D points on an object, & an instruction like "Put the white bowl on the table," MolmoMotion predicts where those points will go over the next few seconds in a shared 3D world frame. 🧵
    Image
    00:00
    1.8K
  • Ai2 reposted
    user avatar
    Weikai Huang
    @weikaih04
    Jun 17
    Another strong proof point for upgrading VLMs into 3D foundation models, and ultimately supporting robotics. Huge shout-out and congrats to the team!
    user avatar
    Ai2
    @allen_ai
    Jun 17
    We're releasing MolmoMotion, a 3D motion forecasting model. Given one or a few video frames, 3D points on an object, & an instruction like "Put the white bowl on the table," MolmoMotion predicts where those points will go over the next few seconds in a shared 3D world frame. 🧵
    Image
    00:00
    3.3K
  • Ai2 reposted
    user avatar
    Jiafei Duan
    @DJiafei
    Jun 17
    Language gave foundation models semantics. Vision gave them grounding. Motion may be the next ingredient. Molmo Motion explores learning from the dynamics of the world itself capturing how objects, people, and agents move through time. Check out our latest work MolmoMotion!
    user avatar
    Ai2
    @allen_ai
    Jun 17
    We're releasing MolmoMotion, a 3D motion forecasting model. Given one or a few video frames, 3D points on an object, & an instruction like "Put the white bowl on the table," MolmoMotion predicts where those points will go over the next few seconds in a shared 3D world frame. 🧵
    Image
    00:00
    5.2K

New to X?

Sign up now to get your own personalized timeline!

Create account

By signing up, you agree to the Terms of Service and Privacy Policy, including Cookie Use.

Terms·Privacy·Cookies·Accessibility·Ads Info·© 2026 X Corp.
Don't miss what's happening
People on X are the first to know.
Log inSign up