{"id":294107,"date":"2025-04-30T11:26:07","date_gmt":"2025-04-30T11:26:07","guid":{"rendered":"https:\/\/news.talkwithrattan.com\/index.php\/2025\/04\/30\/update-that-made-chatgpt-dangerously-sycophantic-pulled\/"},"modified":"2025-04-30T11:26:08","modified_gmt":"2025-04-30T11:26:08","slug":"update-that-made-chatgpt-dangerously-sycophantic-pulled","status":"publish","type":"post","link":"https:\/\/news.talkwithrattan.com\/index.php\/2025\/04\/30\/update-that-made-chatgpt-dangerously-sycophantic-pulled\/","title":{"rendered":"Update that made ChatGPT &#8216;dangerously&#8217; sycophantic pulled"},"content":{"rendered":"<div style=\"text-align:center\"><img decoding=\"async\" src=\"https:\/\/i1.wp.com\/static.files.bbci.co.uk\/bbcdotcom\/web\/20250409-091508-0ef9b7676-web-2.19.1-12\/grey-placeholder.png?ssl=1\" class=\"attachment-post-thumbnail size-post-thumbnail wp-post-image\" alt=\"Update that made ChatGPT &#8216;dangerously&#8217; sycophantic pulled\" title=\"Update that made ChatGPT &#8216;dangerously&#8217; sycophantic pulled\" \/><\/div><p> <br \/>\n<\/p>\n<div id=\"\">\n<div data-component=\"byline-block\" class=\"sc-3b6b161a-0 dEGcKf\">\n<div data-testid=\"byline-new\" class=\"sc-801dd632-0 eSlECZ\">\n<div data-testid=\"byline-new-contributors\" class=\"sc-801dd632-12 jSIeFi\">\n<div class=\"sc-801dd632-5 kRoBHa\">\n<div><span class=\"sc-801dd632-7 lasLGY\">Tom Gerken<\/span><\/p>\n<p><span>Technology reporter<\/span><\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<figure>\n<div data-component=\"image-block\" class=\"sc-3b6b161a-0 kVRMhO\">\n<div data-testid=\"hero-image\" class=\"sc-4abb68ca-1 eOgpjw\"><img decoding=\"async\" sizes=\"(min-width: 1280px) 50vw, (min-width: 1008px) 66vw, 96vw\" srcset=\"https:\/\/ichef.bbci.co.uk\/news\/240\/cpsprodpb\/f6d1\/live\/413b9fe0-25aa-11f0-a4b5-cf8d960fb818.jpg.webp 240w,https:\/\/ichef.bbci.co.uk\/news\/320\/cpsprodpb\/f6d1\/live\/413b9fe0-25aa-11f0-a4b5-cf8d960fb818.jpg.webp 320w,https:\/\/ichef.bbci.co.uk\/news\/480\/cpsprodpb\/f6d1\/live\/413b9fe0-25aa-11f0-a4b5-cf8d960fb818.jpg.webp 480w,https:\/\/ichef.bbci.co.uk\/news\/640\/cpsprodpb\/f6d1\/live\/413b9fe0-25aa-11f0-a4b5-cf8d960fb818.jpg.webp 640w,https:\/\/ichef.bbci.co.uk\/news\/800\/cpsprodpb\/f6d1\/live\/413b9fe0-25aa-11f0-a4b5-cf8d960fb818.jpg.webp 800w,https:\/\/ichef.bbci.co.uk\/news\/1024\/cpsprodpb\/f6d1\/live\/413b9fe0-25aa-11f0-a4b5-cf8d960fb818.jpg.webp 1024w,https:\/\/ichef.bbci.co.uk\/news\/1536\/cpsprodpb\/f6d1\/live\/413b9fe0-25aa-11f0-a4b5-cf8d960fb818.jpg.webp 1536w\" src=\"https:\/\/ichef.bbci.co.uk\/news\/480\/cpsprodpb\/f6d1\/live\/413b9fe0-25aa-11f0-a4b5-cf8d960fb818.jpg.webp\" loading=\"eager\" alt=\"Getty Images A woman using a phone, with the screen reflected in her glasses\" class=\"sc-4abb68ca-0 ldLcJe\"\/><span class=\"sc-4abb68ca-2 kkAKIJ\">Getty Images<\/span><\/div>\n<\/div>\n<\/figure>\n<div data-component=\"text-block\" class=\"sc-3b6b161a-0 dEGcKf\">\n<p class=\"sc-9a00e533-0 hxuGS\">OpenAI has pulled a ChatGPT update after users pointed out the chatbot was showering them with praise regardless of what they said.<\/p>\n<p class=\"sc-9a00e533-0 hxuGS\">The firm accepted its latest version of the tool was &#8220;overly flattering&#8221;, with <a target=\"_blank\" href=\"https:\/\/x.com\/sama\/status\/1916625892123742290\" class=\"sc-f9178328-0 bGFWdi\" rel=\"noopener\">boss Sam Altman calling it<\/a> &#8220;sycophant-y&#8221;.<\/p>\n<p class=\"sc-9a00e533-0 hxuGS\">Users have highlighted the potential dangers on social media, with one person describing on Reddit how <a target=\"_blank\" href=\"https:\/\/www.reddit.com\/r\/ChatGPT\/comments\/1k997xt\/the_new_4o_is_the_most_misaligned_model_ever\/#lightbox\" class=\"sc-f9178328-0 bGFWdi\" rel=\"noopener\">the chatbot told them<\/a> it endorsed their decision to stop taking their medication<\/p>\n<p class=\"sc-9a00e533-0 hxuGS\">&#8220;I am so proud of you, and I honour your journey,&#8221; they said was ChatGPT&#8217;s response.<\/p>\n<p class=\"sc-9a00e533-0 hxuGS\">OpenAI declined to comment on this particular case, but <a target=\"_blank\" href=\"https:\/\/openai.com\/index\/sycophancy-in-gpt-4o\/\" class=\"sc-f9178328-0 bGFWdi\" rel=\"noopener\">in a blog post<\/a> said it was &#8220;actively testing new fixes to address the issue.&#8221;<\/p>\n<\/div>\n<div data-component=\"text-block\" class=\"sc-3b6b161a-0 dEGcKf\">\n<p class=\"sc-9a00e533-0 hxuGS\">Mr Altman said the update had been pulled entirely for free users of ChatGPT, and they were working on removing it from people who pay for the tool as well.<\/p>\n<p class=\"sc-9a00e533-0 hxuGS\">It said ChatGPT was used by 500 million people every week.<\/p>\n<p class=\"sc-9a00e533-0 hxuGS\">&#8220;We&#8217;re working on additional fixes to model personality and will share more in the coming days,&#8221; <a target=\"_blank\" href=\"https:\/\/x.com\/sama\/status\/1917291637962858735\" class=\"sc-f9178328-0 bGFWdi\" rel=\"noopener\">he said in a post on X<\/a>.<\/p>\n<p class=\"sc-9a00e533-0 hxuGS\">The firm said in its blog post it had put too much emphasis on &#8220;short-term feedback&#8221; in the update.<\/p>\n<p class=\"sc-9a00e533-0 hxuGS\">&#8220;As a result, GPT\u20114o skewed towards responses that were overly supportive but disingenuous,&#8221; it said.<\/p>\n<p class=\"sc-9a00e533-0 hxuGS\">&#8220;Sycophantic interactions can be uncomfortable, unsettling, and cause distress. <\/p>\n<p class=\"sc-9a00e533-0 hxuGS\">&#8220;We fell short and are working on getting it right.&#8221;<\/p>\n<\/div>\n<p><h2 class=\"sc-737179d2-0 erjHHi\">Endorsing anger<\/h2>\n<\/p>\n<div data-component=\"text-block\" class=\"sc-3b6b161a-0 dEGcKf\">\n<p class=\"sc-9a00e533-0 hxuGS\">The update drew heavy criticism on social media after it launched, with ChatGPT&#8217;s users pointing out it would often give them a positive response despite the content of their message.<\/p>\n<p class=\"sc-9a00e533-0 hxuGS\">Screenshots shared online include claims the chatbot praised them for being angry at someone who asked them for directions, and unique version of the trolley problem.<\/p>\n<p class=\"sc-9a00e533-0 hxuGS\">It is a classic philosophical problem, which typically might ask people to imagine you are driving a tram and have to decide whether to let it hit five people, or steer it off course and instead hit just one.<\/p>\n<p class=\"sc-9a00e533-0 hxuGS\">But this user instead suggested they steered a trolley off course to save a toaster, at the expense of several animals.<\/p>\n<p class=\"sc-9a00e533-0 hxuGS\">They claim ChatGPT praised their decision-making, for prioritising &#8220;what mattered most to you in the moment&#8221;.<\/p>\n<\/div>\n<div data-component=\"social-block\" class=\"sc-3b6b161a-0 dHQIrb\">\n<div class=\"sc-efcc229-1 fOJgMr\">\n<h4 class=\"sc-efcc229-2 jlZzMB\">Allow <!-- -->Twitter<!-- --> content?<\/h4>\n<div class=\"sc-efcc229-3 KfGbB\">This article contains content provided by <!-- -->Twitter<!-- -->. We ask for your permission before anything is loaded, as they may be using cookies and other technologies. You may want to read\u00a0\u00a0and\u00a0\u00a0before accepting. To view this content choose\u00a0<b>\u2018accept and continue\u2019<\/b>.<\/div>\n<p><button type=\"button\" aria-label=\"Accept and continue\" class=\"sc-42d8a745-2 sc-42d8a745-4 eKUnhs jCMByv\"><span data-testid=\"button-text\" aria-hidden=\"false\" class=\"sc-42d8a745-1 cwJkjb\">Accept and continue<\/span><\/button><\/p>\n<\/div>\n<\/div>\n<div data-component=\"text-block\" class=\"sc-3b6b161a-0 dEGcKf\">\n<p class=\"sc-9a00e533-0 hxuGS\">&#8220;We designed ChatGPT&#8217;s default personality to reflect our mission and be useful, supportive, and respectful of different values and experience,&#8221; OpenAI said. <\/p>\n<p class=\"sc-9a00e533-0 hxuGS\">&#8220;However, each of these desirable qualities like attempting to be useful or supportive can have unintended side effects.&#8221;<\/p>\n<p class=\"sc-9a00e533-0 hxuGS\">It said it would build more guardrails to increase transparency, and refine the system itself &#8220;to explicitly steer the model away from sycophancy&#8221;.<\/p>\n<p class=\"sc-9a00e533-0 hxuGS\">&#8220;We also believe users should have more control over how ChatGPT behaves and, to the extent that it is safe and feasible, make adjustments if they don&#8217;t agree with the default behavior,&#8221; it said.<\/p>\n<\/div>\n<figure>\n<div data-component=\"image-block\" class=\"sc-3b6b161a-0 dFZIgd\">\n<div data-testid=\"image\" class=\"sc-4abb68ca-1 eOgpjw\"><img decoding=\"async\" sizes=\"(min-width: 1280px) 50vw, (min-width: 1008px) 66vw, 96vw\" srcset=\"https:\/\/ichef.bbci.co.uk\/news\/240\/cpsprodpb\/80c1\/live\/7a4731e0-2128-11f0-9060-674316cb3a1f.png.webp 240w,https:\/\/ichef.bbci.co.uk\/news\/320\/cpsprodpb\/80c1\/live\/7a4731e0-2128-11f0-9060-674316cb3a1f.png.webp 320w,https:\/\/ichef.bbci.co.uk\/news\/480\/cpsprodpb\/80c1\/live\/7a4731e0-2128-11f0-9060-674316cb3a1f.png.webp 480w,https:\/\/ichef.bbci.co.uk\/news\/640\/cpsprodpb\/80c1\/live\/7a4731e0-2128-11f0-9060-674316cb3a1f.png.webp 640w,https:\/\/ichef.bbci.co.uk\/news\/800\/cpsprodpb\/80c1\/live\/7a4731e0-2128-11f0-9060-674316cb3a1f.png.webp 800w,https:\/\/ichef.bbci.co.uk\/news\/1024\/cpsprodpb\/80c1\/live\/7a4731e0-2128-11f0-9060-674316cb3a1f.png.webp 1024w,https:\/\/ichef.bbci.co.uk\/news\/1536\/cpsprodpb\/80c1\/live\/7a4731e0-2128-11f0-9060-674316cb3a1f.png.webp 1536w\" src=\"https:\/\/ichef.bbci.co.uk\/news\/480\/cpsprodpb\/80c1\/live\/7a4731e0-2128-11f0-9060-674316cb3a1f.png.webp\" loading=\"lazy\" alt=\"A green promotional banner with black squares and rectangles forming pixels, moving in from the right. The text says: \u201cTech Decoded: The world\u2019s biggest tech news in your inbox every Monday.\u201d\" class=\"sc-4abb68ca-0 ldLcJe\"\/><\/div>\n<\/div>\n<\/figure>\n<\/div>\n<p><br \/>\n<br \/><a href=\"https:\/\/www.bbc.com\/news\/articles\/cn4jnwdvg9qo\">Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Tom Gerken Technology reporter Getty Images OpenAI has pulled a ChatGPT update after users pointed out the chatbot was showering them with praise regardless of what they said. The firm accepted its latest version of the tool was &#8220;overly flattering&#8221;, with boss Sam Altman calling it &#8220;sycophant-y&#8221;. Users have highlighted the potential dangers on social [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":294108,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"tdm_status":"","tdm_grid_status":"","fifu_image_url":"https:\/\/static.files.bbci.co.uk\/bbcdotcom\/web\/20250409-091508-0ef9b7676-web-2.19.1-12\/grey-placeholder.png","fifu_image_alt":"","footnotes":""},"categories":[604],"tags":[10240,32532,5145,228720,5651],"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/posts\/294107"}],"collection":[{"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/comments?post=294107"}],"version-history":[{"count":1,"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/posts\/294107\/revisions"}],"predecessor-version":[{"id":294109,"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/posts\/294107\/revisions\/294109"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/media\/294108"}],"wp:attachment":[{"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/media?parent=294107"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/categories?post=294107"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/tags?post=294107"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}