Researchers open source Sky-T1, a 'reasoning' AI model that can be trained for less than $450
Days Since Published
10
Created: Jan 12, 2025 02:01
Highly Recommended
Highly Recommended
1
Recommended
0
Not Recommended
0
Your Vote
You have not voted yet
Researchers open source Sky-T1, a 'reasoning' AI model that can be trained for less than $450
So-called reasoning AI models are becoming easier — and cheaper — to develop. On Friday, NovaSky, a team of researchers based out of UC Berkeley's ...
Published on: Jan 12, 2025
Original Article: Click here to read the original article
Thawakery Quick Summary:
Researchers from UC Berkeley’s Sky Computing Lab have unveiled Sky-T1-32B-Preview, a new open source “reasoning model” that rivals an earlier version of OpenAI’s o1 on math- and coding-focused benchmarks. Significantly, Sky-T1 reportedly cost less than $450 to train—a stark contrast to the millions of dollars often spent on comparable large-scale models not long ago. The team credits synthetic training data for helping cut down expenses; Sky-T1’s initial dataset was generated by Alibaba’s QwQ-32B-Preview, and then refined with OpenAI’s GPT-4o-mini. Training the 32-billion-parameter Sky-T1 took only 19 hours on a cluster of eight Nvidia H100 GPUs, illustrating both the growing affordability and rapid development pace for advanced AI projects.
Though Sky-T1 outperforms the preview version of o1 on complex math and coding tests, it lags behind o1 in a separate domain of graduate-level science questions, and also trails OpenAI’s more polished GA release of o1. Nonetheless, Sky-T1 stands as a promising step toward fully open source models with robust reasoning capabilities—models that can “fact-check” themselves and potentially avoid errors that often plague conventional AI. The Sky Computing Lab team plans to keep refining their approach, working on ways to boost both efficiency and performance for their future reasoning models.
Do you recommend others read this article?
Original Article: Click here to read the original article
*WARNING* - If the "Source" link above is not working, the article was moved or removed, and we do NOT have control of that part. Just so you know.
Featured Articles
-
Business Productivity Software Market to Grow by USD 119.4 Billion from 2025-2029
Integration capabilities with other business functions like customer relationship management (CRM), ...
-
Cybersecurity myths that are putting businesses at risk | Microscope - Computer Weekly
Customer Relationship Management (CRM) Services · Enterprise Resource Management (ERP) Services · In...
About
Welcome to our news section where we bring you the latest articles across various topics. Explore, engage, and stay informed.