{"id":202745,"date":"2024-12-26T22:16:44","date_gmt":"2024-12-26T22:16:44","guid":{"rendered":"https:\/\/news.talkwithrattan.com\/index.php\/2024\/12\/26\/google-might-be-using-claude-to-improve-geminis-performance\/"},"modified":"2024-12-26T22:16:44","modified_gmt":"2024-12-26T22:16:44","slug":"google-might-be-using-claude-to-improve-geminis-performance","status":"publish","type":"post","link":"https:\/\/news.talkwithrattan.com\/index.php\/2024\/12\/26\/google-might-be-using-claude-to-improve-geminis-performance\/","title":{"rendered":"Google Might Be Using Claude to Improve Gemini\u2019s Performance"},"content":{"rendered":"
\"Google<\/div>


\n<\/p>\n

\n

Google<\/a> is reportedly comparing Gemini’s responses against those generated by Anthropic’s Claude artificial intelligence (AI) models. As per the report, the Mountain View-based tech giant asked third-party contractors who work on evaluating the quality of Gemini’s responses to also rate whether Claude’s responses are better. While it is not an uncommon practice, using third-party AI models for this purpose requires obtaining permission from the company. The report could not confirm whether the tech giant had received any permission from Anthropic.<\/p>\n

Gemini Reportedly Being Improved Using Claude<\/h2>\n

According to a TechCrunch report<\/a>, contractors working on Gemini are comparing its outputs against those created by Claude, a direct competitor of the former. The publication claimed to have seen internal correspondence between Google and the contractors, where they were told to follow this practice.<\/p>\n

The report also claimed that the contractors are given up to 30 minutes per prompt where they are tasked to determine if they prefer Gemini<\/a> or Claude’s response. Notably, these contractors are typically subject matter experts and they evaluate the chatbot’s responses on niche and technical topics across several parameters such as truthfulness, precision, and verbosity.<\/p>\n

After the practice began, some contractors reportedly began noticing references to Anthropic and Claude<\/a> in Gemini’s responses. The publication claimed that one Gemini output directly stated \u201cI am Claude, created by Anthropic.\u201d Typically, this should not happen if Gemini’s responses are simply being compared against Claude’s. This raises the concern of whether developers are feeding Claude’s output to Gemini in instances where the former’s responses are better.<\/p>\n

In its commercial terms<\/a> of conditions, Anthropic states that those accessing Claude are forbidden from building \u201ccompeting product or service\u201d or training \u201ccompeting AI models\u201d without obtaining approval from Anthropic<\/a>.<\/p>\n

Speaking with TechCrunch, Google DeepMind’s spokesperson Shira McNamara said that while the division does compare model outputs for evaluation purposes, Gemini is not trained on Anthropic’s AI models.<\/p>\n

Last week, a report<\/a> claimed that the contractors assigned to evaluate Gemini’s responses were being told to rate the chatbot’s outputs even when they were outside of their expertise. While earlier, contractors could skip such questions, the option to do so was reportedly being removed.<\/p>\n<\/div>\n


\n
Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

Google is reportedly comparing Gemini’s responses against those generated by Anthropic’s Claude artificial intelligence (AI) models. As per the report, the Mountain View-based tech giant asked third-party contractors who work on evaluating the quality of Gemini’s responses to also rate whether Claude’s responses are better. While it is not an uncommon practice, using third-party AI […]<\/p>\n","protected":false},"author":2,"featured_media":202746,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"tdm_status":"","tdm_grid_status":"","fifu_image_url":"https:\/\/i.gadgets360cdn.com\/large\/gemini_gadgets1_1735206452354.jpg","fifu_image_alt":"","footnotes":""},"categories":[607],"tags":[1274,16588,890,35777,64,4304,1098,159409,4207,438],"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/posts\/202745"}],"collection":[{"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/comments?post=202745"}],"version-history":[{"count":1,"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/posts\/202745\/revisions"}],"predecessor-version":[{"id":202747,"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/posts\/202745\/revisions\/202747"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/media\/202746"}],"wp:attachment":[{"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/media?parent=202745"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/categories?post=202745"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/tags?post=202745"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}