{"id":257538,"date":"2025-03-12T14:12:08","date_gmt":"2025-03-12T14:12:08","guid":{"rendered":"https:\/\/news.talkwithrattan.com\/index.php\/2025\/03\/12\/googles-new-gemma-3-open-source-ai-models-can-run-on-a-single-gpu\/"},"modified":"2025-03-12T14:12:08","modified_gmt":"2025-03-12T14:12:08","slug":"googles-new-gemma-3-open-source-ai-models-can-run-on-a-single-gpu","status":"publish","type":"post","link":"https:\/\/news.talkwithrattan.com\/index.php\/2025\/03\/12\/googles-new-gemma-3-open-source-ai-models-can-run-on-a-single-gpu\/","title":{"rendered":"Google\u2019s New Gemma 3 Open-Source AI Models Can Run on a Single GPU"},"content":{"rendered":"
\"Google\u2019s<\/div>


\n<\/p>\n

\n
\n

Google<\/a> released the Gemma 3 family of artificial intelligence (AI) models on Wednesday. Successor to the Gemma 2 series, which was introduced<\/a>\u00a0in August 2024, the new open-source models arrive with text and visual reasoning capabilities. The Mountain View-based tech giant said these models offer support for more than 35 languages and can be fine-tuned to offer additional support for 140 languages. Notably, the tech giant claimed that these models are optimised to run on a single GPU or Google’s Tensor processing unit (TPU).<\/p>\n

Google Releases Gemma 3 Series AI Models<\/h2>\n

In a blog post<\/a>, the tech giant detailed the new small language models (SLMs), highlighting that these were built using the same technology as the company’s flagship Gemini 2.0 models. The Gemma series is known for being open-source and offering on-device performance. Google revealed that so far, the Gemma models have been downloaded more than 100 million times and have been used to create more than 60,000 variants.<\/p>\n

The tech giant claimed that Gemma<\/a> outperforms Meta’s Llama-405B, DeepSeek-V3, OpenAI’s o3-mini AI models on the LMArena’s leaderboard. These models are available in four sizes \u2014 1B, 4B, 12B, and 27B parameters. They can be run on a single GPU or TPU, the company claimed.<\/p>\n

Gemma 3 series offers advanced text and visual reasoning capabilities, and can analyse images, text, and short videos. The AI models offer a context window of 1,28,000 tokens. The models also offer function calling support, which will allow developers to build agentic capabilities in the apps and software they create.<\/p>\n

Google said that the AI models were developed using careful risk assessment. The company claimed that it enforced internal safety policies via fine-tuning and benchmark evaluations. The models were also tested using more capable models. The model displayed a low risk level, the company claimed.<\/p>\n

In addition to Gemma 3 series, the company also launched ShieldGemma 2, a 4B parameter image safety checker, that ensures that the AI models do not generate content with dangerous, sexually explicit, or violent content. Developers have also been given the option to further customise ShieldGemma to enhance the safety parameters. Gemma 3 family of AI models can be downloaded via Google’s Hugging Face listing<\/a> or on Kaggle.<\/p>\n<\/div>\n

\n For the latest tech news<\/a> and reviews<\/a>, follow Gadgets 360 on X<\/a>, Facebook<\/a>, WhatsApp<\/a>, Threads<\/a> and Google News<\/a>. For the latest videos on gadgets and tech, subscribe to our YouTube channel<\/a>. If you want to know everything about top influencers, follow our in-house Who’sThat360<\/a> on Instagram<\/a> and YouTube<\/a>. <\/p>\n

\n
\n
\n <\/p>\n
<\/div>\n

Infinix Note 50X 5G Confirmed to Launch in India With Android 15-Based XOS 15<\/span>
\n <\/a>\n <\/div>\n

\n
\n
\n South Korea to Finalise Crypto-Focussed \u2018Corporate Market Participation’ Guidelines by April<\/span><\/p>\n
\n \"\"\n <\/div>\n

<\/a>\n <\/div>\n<\/div><\/div>\n