{"id":58051,"date":"2024-05-24T13:51:23","date_gmt":"2024-05-24T13:51:23","guid":{"rendered":"https:\/\/news.talkwithrattan.com\/index.php\/2024\/05\/24\/reinforcement-learning-ai-might-bring-humanoid-robots-to-the-real-world\/"},"modified":"2024-05-24T13:51:24","modified_gmt":"2024-05-24T13:51:24","slug":"reinforcement-learning-ai-might-bring-humanoid-robots-to-the-real-world","status":"publish","type":"post","link":"https:\/\/news.talkwithrattan.com\/index.php\/2024\/05\/24\/reinforcement-learning-ai-might-bring-humanoid-robots-to-the-real-world\/","title":{"rendered":"Reinforcement learning AI might bring humanoid robots to the real world"},"content":{"rendered":"<div style=\"text-align:center\"><img decoding=\"async\" src=\"https:\/\/i0.wp.com\/www.sciencenews.org\/wp-content\/uploads\/2024\/05\/052124_mh_ai-movement_feat.jpg?fit=800%2C450&amp;ssl=1\" class=\"attachment-post-thumbnail size-post-thumbnail wp-post-image\" alt=\"Reinforcement learning AI might bring humanoid robots to the real world\" title=\"Reinforcement learning AI might bring humanoid robots to the real world\" \/><\/div> \r\n<br><br><div data-component=\"video-embed\">\n\t\t\t\t\n\n\n\n\n<p>ChatGPT and other AI tools are upending our digital lives, but our AI interactions are about to get physical. Humanoid robots trained with a particular type of AI to <a href=\"https:\/\/www.sciencenews.org\/article\/robots-artificial-intelligence-gets-physical\">sense and react to their world<\/a> could lend a hand in factories, space stations, nursing homes and beyond. Two recent papers in <em>Science Robotics<\/em> highlight how that type of AI \u2014 called reinforcement learning \u2014 could make such robots a reality.<\/p>\n\n\n\n<p>\u201cWe\u2019ve seen really wonderful progress in AI in the digital world <a href=\"https:\/\/www.sciencenews.org\/article\/generative-ai-chatgpt-safety\">with tools like GPT<\/a>,\u201d says Ilija Radosavovic, a computer scientist at the University of California, Berkeley. \u201cBut I think that AI in the physical world has the potential to be even more transformational.\u201d<\/p>\n\n\n<aside class=\"sn-conversion rich-text rich-text--with-sidebar\">\n<style><![CDATA[\n.email-conversion {\n  border: 1px solid #ffcccb;\n  color: white;\n  margin-top: 50px;\n  background-image: url(\"\/wp-content\/themes\/sciencenews\/client\/src\/images\/cta-module@2x.jpg\");\n  padding: 20px;\n  clear: both;\n}\n\n]]><\/style>\n\n\n\n                        <style class=\"is-layout-flow wp-block-group-is-layout-flow\"><![CDATA[.zephr-form-progress-bar.svelte-d78fa2{width:100%;border:0;border-radius:20px;margin-top:10px}.zephr-form-progress-bar.svelte-d78fa2::-webkit-progress-bar{background-color:var(--zephr-color-background-tinted);border:0;border-radius:20px}.zephr-form-progress-bar.svelte-d78fa2::-webkit-progress-value{background-color:var(--zephr-color-text-tinted);border:0;border-radius:20px}.zephr-progress-bar-step.svelte-d78fa2{margin:auto;color:var(--zephr-color-text-tinted);font-size:var(--zf-subtext-fontSize);font-family:var(--zf-root-fontFamily);cursor:pointer}.zephr-progress-bar-step.svelte-d78fa2:first-child{margin-left:0}.zephr-progress-bar-step.svelte-d78fa2:last-child{margin-right:0}.zephr-progress-bar-step.disabled.svelte-d78fa2{cursor:default}\n.zephr-form-button-top-margin.svelte-1eqnyqe{margin-top:20px}.zephr-form-button.svelte-1eqnyqe{padding:0 20px;text-decoration:none;text-transform:capitalize;border-radius:calc(var(--zephr-button-borderRadius) * 1px);font-size:var(--zf-button-fontSize);font-weight:normal;cursor:pointer;border-style:solid;border-width:calc(var(--zephr-button-borderWidth) * 1px);border-color:var(--zephr-color-action-tinted);transition:backdrop-filter 0.2s, background-color 0.2s;display:flex;justify-content:center;align-items:center;width:100%;background-color:var(--zephr-color-action-main);color:var(--zf-button-color);position:relative;overflow:hidden;font-family:var(--zf-root-fontFamily)}.zephr-form-button.svelte-1eqnyqe:hover{background-color:var(--zephr-color-action-tinted);border-color:var(--zephr-color-action-tinted)}.zephr-form-button.svelte-1eqnyqe:disabled{background-color:var(--zephr-color-background-tinted);border-color:var(--zephr-color-background-tinted)}.zephr-form-button.svelte-1eqnyqe:disabled:hover{background-color:var(--zephr-color-background-tinted);border-color:var(--zephr-color-background-tinted)}.zephr-form-button.inputHeight.svelte-1eqnyqe{height:calc(var(--zephr-input-height) * 1px)}.zephr-form-button.svelte-1eqnyqe:not(inputHeight){height:calc(var(--zephr-button-height) * 1px)}.zephr-form-button.aside.svelte-1eqnyqe{width:auto;margin-left:10px}\n.payment-option-wrapper.svelte-wecxzz>input[type=\"radio\"].svelte-wecxzz{display:none}.payment-option-wrapper.svelte-wecxzz.svelte-wecxzz{display:flex;flex:1 0 28%;width:100%}.payment-option-wrapper.svelte-wecxzz.svelte-wecxzz:only-child{max-width:325px}.box-container.svelte-wecxzz.svelte-wecxzz{display:flex;flex-direction:column;flex:1 1 0;width:0;text-align:center}.inner-box.svelte-wecxzz.svelte-wecxzz{border:var(--zf-payment-options-border);border-radius:var(--zf-payment-options-borderRadius);background-color:var(--zf-payment-options-bgColor);height:100%;display:flex;flex-direction:column}.box-container.highlighted.svelte-wecxzz .inner-box.svelte-wecxzz{border-top-left-radius:0;border-top-right-radius:0}.box-container.svelte-wecxzz .box-content.svelte-wecxzz{flex-grow:1;padding:30px 20px;margin:0 10px;overflow:hidden}.box-container.svelte-wecxzz .styled-box-content.svelte-wecxzz{color:var(--zephr-color-text-main);font-family:var(--zf-root-fontFamily)}\n  .box-container .styled-box-content h1,\n  .box-container .styled-box-content h2,\n  .box-container .styled-box-content h3,\n  .box-container .styled-box-content p,\n  .box-container .styled-box-content span\n   {color:var(--zephr-color-text-main);font-family:var(--zf-root-fontFamily)}.payment-options-container .box-container .styled-box-content button{color:#fff;background-color:var(--zephr-color-action-main);border-width:calc(var(--zephr-button-borderWidth) * 1px);border-color:var(--zephr-color-action-tinted);border-radius:calc(var(--zephr-button-borderRadius) * 1px);font-size:var(--zf-button-fontSize)}.payment-options-container .box-container .styled-box-content button:hover{background-color:var(--zephr-color-action-tinted);border-color:var(--zephr-color-action-tinted)}.payment-options-container .box-container .box-content img{max-width:210px;height:auto}.box-top.svelte-wecxzz.svelte-wecxzz{height:40px}.box-container.highlighted.svelte-wecxzz .box-top.svelte-wecxzz{color:var(--zf-payment-options-highlighted-color);background-color:var(--zf-payment-options-highlighted-bgColor);position:relative;border:var(--zf-payment-options-border);border-bottom-width:0;border-radius:var(--zf-payment-options-borderRadius);border-bottom-left-radius:0;border-bottom-right-radius:0;display:flex;justify-content:center;align-items:center}.box-container.highlighted.svelte-wecxzz .box-top .box-top-text.svelte-wecxzz{font-weight:bold}.box-container.svelte-wecxzz .box-bottom.svelte-wecxzz{min-height:60px;display:flex;flex-direction:column;align-items:center;padding:20px 0 30px;margin:0 30px}.button-sub-text.svelte-wecxzz.svelte-wecxzz{margin-top:10px}\n.payment-options-container.svelte-15oxdku{flex-wrap:wrap;font-size:var(--zf-payment-options-fontSize);width:100%;color:var(--zf-payment-options-color);line-height:18px;padding:31px 0 20px;display:grid;justify-content:space-evenly;justify-items:center;grid-template-columns:repeat(auto-fit, minmax(300px, 1fr));gap:13px}@media(max-width: 340px){.payment-options-container.svelte-15oxdku{grid-template-columns:repeat(auto-fit, minmax(280px, 1fr))}}\n.zephr-form-error-message-min-height.svelte-719cfr{min-height:1.1em}.zephr-form-error-message.svelte-719cfr{color:var(--zephr-color-warning-main);font-size:var(--zf-subtext-fontSize);margin-top:0.5em;position:relative;margin-left:1.2em;margin-right:1.2em}\n.zephr-form-input-inner-container.svelte-127vcsp{position:relative}.zephr-form-input-full-width.svelte-127vcsp{width:100%}.zephr-form-input.svelte-127vcsp{width:100%;display:block;height:calc(var(--zephr-input-height) * 1px);padding-left:8px;font-size:var(--zf-input-fontSize);border:calc(var(--zephr-input-borderWidth) * 1px) solid\n      var(--zephr-input-borderColor);border-radius:calc(var(--zephr-input-borderRadius) * 1px);transition:border-color 0.25s ease, box-shadow 0.25s ease;outline:0;color:var(--zephr-color-text-main);background-color:var(--zf-input-bgColor);font-family:var(--zf-root-fontFamily)}.zephr-form-input.svelte-127vcsp::placeholder{color:var(--zephr-color-background-tinted);font-family:var(--zf-root-fontFamily)}.zephr-form-input-checkbox.svelte-127vcsp{width:auto;height:auto;margin:8px 5px 0 0;float:left}.zephr-form-input-radio.svelte-127vcsp{position:absolute;opacity:0;cursor:pointer;height:0;width:0}.zephr-form-input-color[type=\"color\"].svelte-127vcsp{width:50px;padding:0;border-radius:50%}.zephr-form-input-color[type=\"color\"].svelte-127vcsp::-webkit-color-swatch{border:none;border-radius:50%;padding:0}.zephr-form-input-color[type=\"color\"].svelte-127vcsp::-webkit-color-swatch-wrapper{border:none;border-radius:50%;padding:0}.zephr-form-input.disabled.svelte-127vcsp,.zephr-form-input.disabled.svelte-127vcsp:hover{border:calc(var(--zephr-input-borderWidth) * 1px) solid\n      var(--zephr-input-borderColor);background-color:var(--zephr-color-background-tinted)}.zephr-form-input.error.svelte-127vcsp{border:1px solid var(--zephr-color-warning-main)}\n.zephr-form-input-label.svelte-vnzoa4.svelte-vnzoa4{margin-top:10px;display:block;line-height:30px;font-size:var(--zf-subtext-fontSize);color:var(--zephr-color-text-tinted);font-family:var(--zf-root-fontFamily)}.zephr-form-input-label.svelte-vnzoa4.svelte-vnzoa4:first-child{margin-top:0}.zephr-form-input-label.svelte-vnzoa4 span.svelte-vnzoa4{display:block}\n.svelte-fa-base{height:1em;overflow:visible;transform-origin:center;vertical-align:-0.125em}.svelte-fa-fw{text-align:center;width:1.25em}.svelte-fa-pull-left.svelte-bvo74f{float:left}.svelte-fa-pull-right.svelte-bvo74f{float:right}.svelte-fa-size-lg.svelte-bvo74f{font-size:1.33333em;line-height:0.75em;vertical-align:-0.225em}.svelte-fa-size-sm.svelte-bvo74f{font-size:0.875em}.svelte-fa-size-xs.svelte-bvo74f{font-size:0.75em}.spin.svelte-bvo74f{animation:svelte-bvo74f-spin 2s 0s infinite linear}.pulse.svelte-bvo74f{animation:svelte-bvo74f-spin 1s infinite steps(8)}@keyframes svelte-bvo74f-spin{0%{transform:rotate(0deg)}100%{transform:rotate(360deg)}}\n.svelte-fa-layers.svelte-1sinijc{display:inline-block;position:relative}.svelte-fa-layers.svelte-1sinijc .svelte-fa{position:absolute;bottom:0;left:0;right:0;top:0;margin:auto;text-align:center}.svelte-fa-layers.svelte-1sinijc .svelte-fa-layers-text{position:absolute;top:50%;left:50%;transform:translate(-50%, -50%)}.svelte-fa-layers.svelte-1sinijc .svelte-fa-layers-text span{display:inline-block}.svelte-fa-pull-left.svelte-1sinijc{float:left}.svelte-fa-pull-right.svelte-1sinijc{float:right}.svelte-fa-size-lg.svelte-1sinijc{font-size:1.33333em;line-height:0.75em;vertical-align:-0.225em}.svelte-fa-size-sm.svelte-1sinijc{font-size:0.875em}.svelte-fa-size-xs.svelte-1sinijc{font-size:0.75em}\n.container.svelte-1x0c3df{display:inline-block;height:auto}.svelte-fa-size-lg.svelte-1x0c3df{font-size:1.33333em;line-height:0.75em;vertical-align:-0.225em}.svelte-fa-size-sm.svelte-1x0c3df{font-size:0.875em}.svelte-fa-size-xs.svelte-1x0c3df{font-size:0.75em}\n.zephr-form-password-match.svelte-11tz5c7.svelte-11tz5c7{margin:20px 0;justify-content:center}.zephr-form-password-match.svelte-11tz5c7 ul.svelte-11tz5c7{padding-left:0;margin:0}.zephr-form-password-requirement.svelte-11tz5c7.svelte-11tz5c7{display:flex;align-items:center;color:var(--zephr-color-text-tinted);font-size:var(--zf-subtext-fontSize);min-height:20px;font-family:var(--zf-root-fontFamily)}.zephr-form-password-requirement-icon.svelte-11tz5c7.svelte-11tz5c7{margin-right:10px;font-size:15px}\n.zephr-form-password-progress.svelte-1b6w0g8.svelte-1b6w0g8{display:flex;margin-top:10px}.zephr-form-password-bar.svelte-1b6w0g8.svelte-1b6w0g8{width:100%;height:4px;border-radius:2px}.zephr-form-password-bar.svelte-1b6w0g8.svelte-1b6w0g8:not(:first-child){margin-left:8px}.zephr-form-password-requirements.svelte-1b6w0g8.svelte-1b6w0g8{margin:20px 0;justify-content:center}.zephr-form-password-requirements.svelte-1b6w0g8 ul.svelte-1b6w0g8{padding-left:0;margin:0}.zephr-form-password-requirement.svelte-1b6w0g8.svelte-1b6w0g8{display:flex;align-items:center;color:var(--zephr-color-text-tinted);font-size:var(--zf-subtext-fontSize);min-height:20px;font-family:var(--zf-root-fontFamily)}.zephr-form-password-requirement-icon.svelte-1b6w0g8.svelte-1b6w0g8{margin-right:10px;font-size:15px}\n.apple-pay-button{display:inline-block;-webkit-appearance:-apple-pay-button;-apple-pay-button-type:pay;width:440px;max-width:100%;height:45px;margin-top:20px}.apple-pay-button-black{-apple-pay-button-style:black}#google-pay-button.svelte-1acsmhs{width:440px;max-width:100%;height:45px;margin-top:20px}\n#braintree-dropin-container.svelte-z7jd27{margin-top:1em;margin-bottom:1em}\n#stripe-element.svelte-1lhuc6b{margin-top:2em;margin-bottom:1em;border:calc(var(--zephr-input-borderWidth) * 1px) solid\n      var(--zephr-input-borderColor);border-radius:calc(var(--zephr-input-borderRadius) * 1px);padding:1em}#stripe-element.svelte-1lhuc6b iframe:focus{outline:none !important}\n#stripe-mobile-pay-button.svelte-1t95nqv{width:440px;max-width:100%;height:45px;margin-top:20px}\n#zuora_payment.svelte-6vr22l{margin-top:1em;margin-bottom:1em}.spinner-container.svelte-6vr22l{text-align:center;padding:2em}.zuora-disabled-iframe-container.svelte-6vr22l .z_hppm_iframe{pointer-events:none;opacity:0.3}\n#payment-element.svelte-1oygrrs{margin-top:1em;margin-bottom:1em;border:calc(var(--zephr-input-borderWidth) * 1px) solid\n            var(--zephr-input-borderColor);border-radius:calc(var(--zephr-input-borderRadius) * 1px);padding:1em}\n.check-image.svelte-12ljnq4{height:1.2em;vertical-align:middle;margin-right:0.5em}.zephr-form-success-message.svelte-12ljnq4{color:var(--zephr-color-text-main);display:inline-block}\n.zephr-form-verification-resend-link-container.svelte-b6r3ph{margin-bottom:2em}.zephr-form-verification-resend-link.svelte-b6r3ph,.zephr-form-verification-resend-text.svelte-b6r3ph{float:right;position:absolute;padding-right:2px;padding-top:0.5em;padding-left:0.5em;font-size:var(--zf-subtext-fontSize);right:0}.zephr-form-verification-resend-link.svelte-b6r3ph{cursor:pointer;color:var(--zf-link-color)}\n.zephr-form-custom-text.svelte-12fdogm{margin-top:1em;margin-bottom:1em;color:var(--zephr-color-text-main)}\n.zephr-form-checkbox.svelte-eyzg32.svelte-eyzg32.svelte-eyzg32{position:absolute;opacity:0;cursor:pointer;height:0;width:0}.zephr-form-checkbox-label.svelte-eyzg32.svelte-eyzg32.svelte-eyzg32{display:flex;align-items:center;font-family:var(--zf-root-fontFamily)}.zephr-form-checkmark.svelte-eyzg32.svelte-eyzg32.svelte-eyzg32{position:relative;box-sizing:border-box;height:23px;width:23px;background-color:#fff;border:calc(var(--zephr-input-borderWidth) * 1px) solid\n      var(--zephr-input-borderColor);border-radius:6px;margin-right:12px;cursor:pointer}.zephr-form-checkmark.checked.svelte-eyzg32.svelte-eyzg32.svelte-eyzg32{border-color:var(--zephr-color-action-main)}.zephr-form-checkmark.checked.svelte-eyzg32.svelte-eyzg32.svelte-eyzg32:after{content:\"\";position:absolute;width:6px;height:13px;border:solid var(--zephr-color-action-main);border-width:0 2px 2px 0;transform:rotate(45deg);top:3px;left:8px;box-sizing:border-box}.zephr-form-checkmark.disabled.svelte-eyzg32.svelte-eyzg32.svelte-eyzg32{border:calc(var(--zephr-input-borderWidth) * 1px) solid\n      var(--zephr-color-background-tinted)}.zephr-form-checkmark.disabled.checked.svelte-eyzg32.svelte-eyzg32.svelte-eyzg32:after{border:solid var(--zephr-color-background-tinted);border-width:0 2px 2px 0}.zephr-form-checkmark.error.svelte-eyzg32.svelte-eyzg32.svelte-eyzg32{border:calc(var(--zephr-input-borderWidth) * 1px) solid\n      var(--zephr-color-warning-main)}.zephr-form-checkbox.svelte-eyzg32:focus-visible+.zephr-form-checkbox-label.svelte-eyzg32>.zephr-form-checkmark.svelte-eyzg32{outline:2px solid var(--zephr-color-action-main);outline-color:-webkit-focus-ring-color}\n.zephr-form-input-radio.svelte-17rnpjv.svelte-17rnpjv.svelte-17rnpjv{position:absolute;opacity:0;cursor:pointer;height:0;width:0}.zephr-form-radio-label.svelte-17rnpjv.svelte-17rnpjv.svelte-17rnpjv{display:flex;align-items:center;font-family:var(--zf-root-fontFamily)}.zephr-form-radio-dot.svelte-17rnpjv.svelte-17rnpjv.svelte-17rnpjv{display:block;position:relative;box-sizing:border-box;height:23px;width:23px;background-color:#fff;border:1px solid #ebebeb;border-radius:50%;margin-right:12px;cursor:pointer}.checked.svelte-17rnpjv.svelte-17rnpjv.svelte-17rnpjv{border-color:var(--zephr-color-action-main)}.checked.svelte-17rnpjv.svelte-17rnpjv.svelte-17rnpjv:after{content:\"\";position:absolute;width:17px;height:17px;background:var(--zephr-color-action-main);border-radius:50%;top:2px;left:2px}.disabled.checked.svelte-17rnpjv.svelte-17rnpjv.svelte-17rnpjv:after{background:var(--zephr-color-background-tinted)}.error.svelte-17rnpjv.svelte-17rnpjv.svelte-17rnpjv{border:1px solid var(--zephr-color-warning-main)}.zephr-form-input-radio.svelte-17rnpjv:focus-visible+.zephr-form-radio-label.svelte-17rnpjv>.zephr-form-radio-dot.svelte-17rnpjv{outline:2px solid var(--zephr-color-action-main);outline-color:-webkit-focus-ring-color}\n.zephr-form-input-error-text.svelte-1f2hwm0{color:var(--zephr-color-warning-main);font-family:var(--zf-root-fontFamily)}.zephr-form-input-select.svelte-1f2hwm0{display:block;appearance:auto;width:100%;height:calc(var(--zephr-input-height) * 1px);font-size:var(--zf-input-fontSize);font-family:var(--zf-root-fontFamily);border:calc(var(--zephr-input-borderWidth) * 1px) solid\n      var(--zephr-input-borderColor);border-radius:calc(var(--zephr-input-borderRadius) * 1px);transition:border-color 0.25s ease, box-shadow 0.25s ease;outline:0;color:var(--zephr-color-text-main);background-color:var(--zf-input-bgColor);padding:10px}.zephr-form-input-select.unselected.svelte-1f2hwm0{color:var(--zephr-color-background-tinted)}.zephr-form-input-select.error.svelte-1f2hwm0{border-color:var(--zephr-color-warning-main)}.zephr-form-input-textarea.svelte-1f2hwm0{display:block;min-height:calc(var(--zephr-input-height) * 1px);min-width:100%;max-width:100%;background-color:var(--zf-input-bgColor);border:calc(var(--zephr-input-borderWidth) * 1px) solid var(--zephr-input-borderColor);border-radius:calc(var(--zephr-input-borderRadius) * 1px);transition:border-color 0.25s ease, box-shadow 0.25s ease;color:var(--zephr-color-text-main);font-size:var(--zf-input-fontSize);font-weight:300;padding:16px 8px;font-family:var(--zf-root-fontFamily);outline:0}.zephr-form-input-textarea.svelte-1f2hwm0::placeholder{color:var(--zephr-color-background-tinted);font-family:var(--zf-root-fontFamily)}.zephr-form-input-slider-output.svelte-1f2hwm0{margin:13px 0 0 10px}\n.zephr-form-link.svelte-12a6t5j{margin:10px 0;color:var(--zf-link-color);text-decoration:underline;cursor:pointer;font-family:var(--zf-root-fontFamily)}.zephr-form-link-disabled.svelte-12a6t5j{color:var(--zephr-color-text-main);cursor:none;text-decoration:none}\n.zephr-form-reset-link-container.svelte-11qigta{min-height:2.5em}.zephr-form-link-message.svelte-11qigta{margin:10px 0 10px 20px;font-family:var(--zf-root-fontFamily)}\n.zephr-form-reset-link-container.svelte-11qigta{min-height:2.5em}.zephr-form-link-message.svelte-11qigta{margin:10px 0 10px 20px;font-family:var(--zf-root-fontFamily)}\n.zephr-form-google-icon.svelte-155mfls{width:20px}\n.zephr-form-social-sign-in.svelte-18a7qws{align-items:center}.zephr-form-social-sign-in-button.svelte-18a7qws{width:100%;min-height:55px;padding:15px;color:#000;background-color:#fff;box-shadow:0 0 5px rgba(0, 0, 0, 0.3);border-radius:10px;font-size:17px;display:flex;align-items:center;cursor:pointer;margin-top:20px;font-family:var(--zf-root-fontFamily)}.zephr-form-social-sign-in-button.svelte-18a7qws:hover{background-color:#fafafa}.zephr-form-social-sign-in-icon.svelte-18a7qws{display:flex;justify-content:center;margin-right:30px;width:25px}\n.zephr-form-promo-input-container.svelte-u2fzg{flex:0.4}.zephr-form-promo-activate-line.svelte-u2fzg{display:flex;cursor:pointer;min-height:calc(var(--zephr-input-height) * 1px);margin:1em 1.2em;font-size:var(--zf-payment-summary-fontSize);line-height:calc(var(--zephr-input-height) * 1px);color:var(--zf-link-color)}.zephr-form-promo-line.svelte-u2fzg{display:flex;min-height:calc(var(--zephr-input-height) * 1px);margin:1em 1.2em}.zephr-form-addon-line.svelte-u2fzg{display:flex;padding-top:1em;padding-bottom:1em;margin-left:1.2em}.zephr-form-summary-prorate-disclaimer.svelte-u2fzg{padding-top:0.25em;padding-left:1em;color:var(--zephr-color-text-tinted)}.zephr-form-summary-charge-description.svelte-u2fzg{color:var(--zephr-color-text-tinted)}.zephr-form-charge-line.svelte-u2fzg{display:flex;padding-top:1em;margin-left:1.2em;padding-left:1em}.zephr-form-summary-line-right.svelte-u2fzg{margin-left:auto;margin-right:1.5em;text-align:right}.zephr-form-summary-line-left.svelte-u2fzg{margin-left:10px}.zephr-form-summary-promo-middle.svelte-u2fzg{position:relative;top:calc(var(--zephr-input-height) * 0.5px)}.zephr-form-summary.svelte-u2fzg{border:var(--zf-payment-summary-border);border-radius:var(--zf-payment-summary-borderRadius);padding-top:1em;padding-bottom:1em;font-size:var(--zf-payment-summary-fontSize);margin-top:1.5em;margin-bottom:1.5em;color:var(--zf-payment-summary-color);background-color:var(--zf-payment-summary-bgColor)}.zephr-form-summary.svelte-u2fzg:first-child{margin-top:0}.zephr-form-summary-title.svelte-u2fzg{margin-bottom:1em;margin-left:1.2em}.zephr-form-summary-price-line.svelte-u2fzg{font-weight:bold;padding-left:1em;padding-top:1em}.zephr-form-summary-line.svelte-u2fzg{display:flex}.zephr-form-summary-price-line-upper.svelte-u2fzg{border-top:var(--zf-payment-summary-border);margin-top:1em}.zephr-form-summary-line-title.svelte-u2fzg{flex:0 0 65%;margin-left:1.2em}.zephr-form-summary-line-price.svelte-u2fzg{flex:1;text-align:right;margin-right:1.5em}\n.zephr-form-divider-container.svelte-1ni5n6w{display:flex;align-items:center;justify-content:center;margin:1.5em 0}.zephr-form-divider-line.svelte-1ni5n6w{height:1px;width:50%;margin:0 5px;background-color:var(--zephr-color-text-tinted)}.zephr-form-divider-line-complete.svelte-1ni5n6w{height:1px;width:100%;margin:0 5px;background-color:var(--zephr-color-text-tinted)}.zephr-form-divider-text.svelte-1ni5n6w{margin:0 12px;color:var(--zephr-color-text-main);font-size:14px;font-family:var(--zf-root-fontFamily);white-space:nowrap}\n.zephr-form-login-link.svelte-1bpa3mq.svelte-1bpa3mq{margin-top:1em;margin-bottom:1em;text-align:center}.zephr-form-login-link.svelte-1bpa3mq>a.svelte-1bpa3mq{color:var(--zf-link-color);margin-left:0.25em}\n.zephr-form-account-code-container.svelte-ctt9he{margin-top:1.5em}\n.zephr-form-invitation-container.svelte-yy7ok3{border:1px solid;margin:1.5em 0;padding:20px;color:var(--zephr-color-text-main)}.zephr-form-invitation-title.svelte-yy7ok3{margin-bottom:20px;font-weight:bold;font-family:var(--zf-root-fontFamily)}.zephr-form-invitation-email.svelte-yy7ok3{display:flex;align-items:center}.zephr-form-invitation-input-container.svelte-yy7ok3{flex-grow:1}.zephr-form-invitation-success-message.svelte-yy7ok3{margin-top:0.5em}\n.zephr-form-content.svelte-1g2h5zh{padding:var(--zf-container-padding);background-color:var(--zf-container-bgColor);border:var(--zf-container-border);border-radius:var(--zf-container-borderRadius)}.zephr-payment-options-content.svelte-1g2h5zh{background-color:transparent;border:none;border-radius:0}.zephr-form-max-width.svelte-1g2h5zh{max-width:var(--zf-container-maxWidth);margin:auto}.close-button-container.svelte-1g2h5zh{text-align:right;width:100%;margin-bottom:15px}.close-button.svelte-1g2h5zh{cursor:pointer;display:inline;padding:7px;min-width:32px;min-height:32px;border-radius:16px;margin:1px}\n.zephr-form{--zf-root-fontSize:16px;--zf-root-fontFamily:var(--zephr-typography-body-font), var(--zephr-typography-body-fallbackFont);--zf-container-maxWidth:440px;--zf-container-padding:20px;--zf-container-margin:20px auto;--zf-container-border:none;--zf-container-borderRadius:calc(var(--zephr-input-borderRadius) * 1px);--zf-container-color:var(--zephr-color-text-main);--zf-container-bgColor:var(--zephr-color-background-main, transparent);--zf-subtext-fontSize:12px;--zf-link-color:#6ba5e9;--zf-input-fontSize:var(--zf-root-fontSize);--zf-input-bgColor:var(--zephr-color-background-main, transparent);--zf-button-fontSize:calc(var(--zephr-button-fontSize, 16) * 1px);--zf-button-color:#fff;--zf-password-valid-color:#7bcb7f;--zf-password-invalid-color:#c4c4c4;--zf-payment-options-fontSize:var(--zf-subtext-fontSize);--zf-payment-options-color:var(--zephr-color-text-main);--zf-payment-options-bgColor:var(--zf-container-bgColor);--zf-payment-options-border:calc(var(--zephr-input-borderWidth) * 1px) solid var(--zephr-input-borderColor);--zf-payment-options-borderRadius:calc(var(--zephr-input-borderRadius) * 1px);--zf-payment-options-highlighted-color:var(--zephr-color-text-main);--zf-payment-options-highlighted-bgColor:var(--zephr-color-accent-main);--zf-payment-summary-fontSize:var(--zf-subtext-fontSize);--zf-payment-summary-color:var(--zephr-color-text-main);--zf-payment-summary-bgColor:var(--zf-input-bgColor);--zf-payment-summary-border:calc(var(--zephr-input-borderWidth) * 1px) solid var(--zephr-input-borderColor);--zf-payment-summary-borderRadius:calc(var(--zephr-input-borderRadius) * 1px)}.zephr-form.svelte-1ta1qs8{color:var(--zf-container-color);margin:var(--zf-container-margin);font-size:var(--zf-root-fontSize);font-family:var(--zf-root-fontFamily)}.zephr-form *{box-sizing:border-box}:where(.zephr-form) button{text-transform:unset;overflow:visible;font-family:var(--zf-root-fontFamily, unset);font-size:var(--zf-root-fontSize, unset);line-height:unset;margin:unset;padding:unset;border:unset;background:unset;&:hover, &:focus-visible {\n            border: unset;\n            background: unset;\n        }}.zephr-form-disabled-div{pointer-events:none;opacity:0.8}.zephr-form-relative-container{position:relative}.zephr-form-flex-container{display:flex}.zephr-form-input-inner-button{cursor:pointer;position:absolute;top:50%;transform:translateY(-50%);right:5px;padding:10px 5px}.zephr-form-input-inner-text{color:var(--zephr-color-text-main);font-size:var(--zf-subtext-fontSize);font-weight:bold;font-family:var(--zf-root-fontFamily)}\n]]><\/style>\n                        \n                        <style><![CDATA[.zephr-form-max-width.zephr-payment-form-max-width {\n    background-image: url(https:\/\/www.sciencenews.org\/wp-content\/themes\/sciencenews\/client\/src\/images\/cta-module@2x.jpg);\n    padding:20px;\n    max-width: 100%;\n}\n\n.zephr-form-custom-text > p {\n    display: none;\n}\n\nform.zephr-form-content {\n    opacity: .9;\n}\n\nlabel.zephr-form-checkbox-label {\n    font-size: 1.2rem;\n    font-weight: bolder;\n}\n\n.zephr-form-custom-text > h4 {\n    color: black !important;\n}\n\nbutton.zephr-form-button {\n    background: #d4441f !important;\n    font-weight: bold !important;\n    text-transform: uppercase !important;\n}\n\nlabel.zephr-payment-form-checkbox-label {\n    color: white;\n    font-size: 1.6rem;\n}\n\n.zephr-form-content {\n    background:#2f537f;\n    \n}\n\n.zephr-payment-form-custom-text {\n    margin-top: .2rem;\n}\n\n.zephr-payment-form-checkbox-label {\n    display: flex;\n    align-items: center;\n    font-family: var(--zephr-typography-body-font), var(--zephr-typography-body-fallbackFont);\n    color: white;\n    font-weight: bold;\n}]]><\/style>\n                        \n                        \n<\/aside>\n\n\n<p>The state-of-the-art software that controls the movements of bipedal bots often uses what\u2019s called model-based predictive control. It\u2019s led to very sophisticated systems, such as the <a href=\"https:\/\/www.cnn.com\/videos\/business\/2021\/08\/17\/boston-dynamics-parkour-atlas-orig.cnn-business\" target=\"_blank\" rel=\"noopener\">parkour-performing Atlas robot <\/a>from Boston Dynamics. But these robot brains require a fair amount of human expertise to program, and they don\u2019t adapt well to unfamiliar situations. Reinforcement learning, or RL, in which AI learns through trial and error to perform sequences of actions, may prove a better approach.<\/p>\n\n\n\n<p>\u201cWe wanted to see how far we can push reinforcement learning in real robots,\u201d says Tuomas Haarnoja, a computer scientist at Google DeepMind and coauthor of <a href=\"https:\/\/www.science.org\/doi\/10.1126\/scirobotics.adi8022\" target=\"_blank\" rel=\"noopener\">one of the <em>Science Robotics<\/em> papers<\/a>. Haarnoja and colleagues chose to develop software for a 20-inch-tall toy robot called OP3, made by the company Robotis. The team not only wanted to teach OP3 to walk but also to play one-on-one soccer.<\/p>\n\n\n\n<p>\u201cSoccer is a nice environment to study general reinforcement learning,\u201d says Guy Lever of Google DeepMind, a coauthor of the paper. It requires planning, agility, exploration, cooperation and competition.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><p>\n<div class=\"youtube-embed\" data-video_id=\"FHIFOYo5W-k\"><iframe loading=\"lazy\" title=\"Robot soccer players are more agile when controlled by reinforcement learning | Science News\" width=\"696\" height=\"392\" src=\"https:\/\/www.youtube.com\/embed\/FHIFOYo5W-k?feature=oembed&#038;enablejsapi=1\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/div>\n<\/p><figcaption class=\"wp-element-caption\">The robots were more responsive when they learned to move on their own, versus being manually programmed. As input, the AIs received data including the positions and movements of the robot\u2019s joints and, from external cameras, the positions of everything else in the game. The AIs had to output new joint positions.<\/figcaption><\/figure>\n\n\n\n<p>The toy size of the robots \u201callowed us to iterate fast,\u201d Haarnoja says, because larger robots are harder to operate and repair. And before deploying the machine learning software in the real robots \u2014 which can break when they fall over \u2014 the researchers trained it on virtual robots, a technique known as sim-to-real transfer.<\/p>\n\n\n\n<p>Training of the virtual bots came in two stages. In the first stage, the team trained one AI using RL merely to get the virtual robot up from the ground, and another to score goals without falling over. As input, the AIs received data including the positions and movements of the robot\u2019s joints and, from external cameras, the positions of everything else in the game. (In a recently posted preprint, the team created a version of the system that <a href=\"https:\/\/sites.google.com\/view\/vision-soccer\" target=\"_blank\" rel=\"noopener\">relies on the robot\u2019s own vision<\/a>.) The AIs had to output new joint positions. If they performed well, their internal parameters were updated to encourage more of the same behavior. In the second stage, the researchers trained an AI to imitate each of the first two AIs and to score against closely matched opponents (versions of itself).<\/p>\n\n\n\n<p>To prepare the control software, called a controller, for the real-world robots, the researchers varied aspects of the simulation, including friction, sensor delays and body-mass distribution. They also rewarded the AI not just for scoring goals but also for other things, like minimizing knee torque to avoid injury.<\/p>\n\n\n\n<p>Real robots tested with the RL control software walked nearly twice as fast, turned three times as quickly and took less than half the time to get up compared with robots using the scripted controller made by the manufacturer. But more advanced skills also emerged, like fluidly stringing together actions. \u201cIt was really nice to see more complex motor skills being learned by robots,\u201d says Radosavovic, who was not a part of the research. And the controller learned not just single moves, but also the planning required to play the game, like knowing to stand in the way of an opponent\u2019s shot.<\/p>\n\n\n\n<p>\u201cIn my eyes, the soccer paper is amazing,\u201d says Joonho Lee, a roboticist at ETH Zurich. \u201cWe\u2019ve never seen such resilience from humanoids.\u201d<\/p>\n\n\n\n<p>But what about human-sized humanoids? In <a href=\"https:\/\/www.science.org\/doi\/10.1126\/scirobotics.adi9579\" target=\"_blank\" rel=\"noopener\">the other recent paper<\/a>, Radosavovic worked with colleagues to train a controller for a larger humanoid robot. This one, <a href=\"https:\/\/spectrum.ieee.org\/agility-robotics-digit\" target=\"_blank\" rel=\"noopener\">Digit from Agility Robotics<\/a>, stands about five feet tall and has knees that bend backward like an ostrich. The team\u2019s approach was similar to Google DeepMind\u2019s. Both teams used computer brains known as neural networks, but Radosavovic used a specialized type called a transformer, the kind common in large language models like those powering ChatGPT.<\/p>\n\n\n\n\n\n<p>Instead of taking in words and outputting more words, the model took in 16 observation-action pairs \u2014 what the robot had sensed and done for the previous 16 snapshots of time, covering roughly a third of a second \u2014 and output its next action. To make learning easier, it first learned based on observations of its actual joint positions and velocity, before using observations with added noise, a more realistic task. To further enable sim-to-real transfer, the researchers slightly randomized aspects of the virtual robot\u2019s body and created a variety of virtual terrain, including slopes, trip-inducing cables and bubble wrap.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><p>\n<div class=\"youtube-embed\" data-video_id=\"d5qNkzzlOLI\"><iframe loading=\"lazy\" title=\"Reinforcement learning helps this humanoid robot navigate the world | Science News\" width=\"696\" height=\"392\" src=\"https:\/\/www.youtube.com\/embed\/d5qNkzzlOLI?feature=oembed&#038;enablejsapi=1\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/div>\n<\/p><figcaption class=\"wp-element-caption\">This bipedal robot learned to handle a variety of physical challenges, including walking on different terrains and being bumped off balance by an exercise ball. Part of the robot\u2019s training involved\u00a0a transformer model, like the one used in ChatGPT, to process data inputs and learn and decide on its next movement.<\/figcaption><\/figure>\n\n\n\n<p>After training in the digital world, the controller operated a real robot for a full week of tests outside \u2014 preventing the robot from falling over even a single time. And in the lab, the robot resisted external forces like having an inflatable exercise ball thrown at it. The controller also outperformed the non-machine-learning controller from the manufacturer, easily traversing an array of planks on the ground. And whereas the default controller got stuck attempting to climb a step, the RL one managed to figure it out, even though it hadn\u2019t seen steps during training.<\/p>\n\n\n\n<p>Reinforcement learning for four-legged locomotion has become popular in the last few years, and these studies show the same techniques now working for two-legged robots. \u201cThese papers are either at-par or have pushed beyond manually defined controllers \u2014 a tipping point,\u201d says Pulkit Agrawal, a computer scientist at MIT. \u201cWith the power of data, it will be possible to unlock many more capabilities in a relatively short period of time.\u201d\u00a0<\/p>\n\n\n\n<p>And the papers\u2019 approaches are likely complementary. Future AI robots may need the robustness of Berkeley\u2019s system and the dexterity of Google DeepMind\u2019s. Real-world soccer incorporates both. According to Lever, soccer \u201c<a href=\"https:\/\/www.robocup.org\/objective\" target=\"_blank\" rel=\"noopener\">has been a grand challenge<\/a> for robotics and AI for quite some time.\u201d<\/p>\n\n\n\n\t\t\t<\/div>\r\n<br>\r\n<br><a href=\"https:\/\/www.sciencenews.org\/article\/reinforcement-learn-ai-humanoid-robots\">Source link <\/a>","protected":false},"excerpt":{"rendered":"<p>ChatGPT and other AI tools are upending our digital lives, but our AI interactions are about to get physical. Humanoid robots trained with a particular type of AI to sense and react to their world could lend a hand in factories, space stations, nursing homes and beyond. Two recent papers in Science Robotics highlight how [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":58052,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"tdm_status":"","tdm_grid_status":"","fifu_image_url":"https:\/\/i0.wp.com\/www.sciencenews.org\/wp-content\/uploads\/2024\/05\/052124_mh_ai-movement_feat.jpg?fit=800%2C450&ssl=1","fifu_image_alt":"","footnotes":""},"categories":[606],"tags":[5191,12642,12803,2881,5841,12640,1052],"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/posts\/58051"}],"collection":[{"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/comments?post=58051"}],"version-history":[{"count":1,"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/posts\/58051\/revisions"}],"predecessor-version":[{"id":58053,"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/posts\/58051\/revisions\/58053"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/media\/58052"}],"wp:attachment":[{"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/media?parent=58051"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/categories?post=58051"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/news.talkwithrattan.com\/index.php\/wp-json\/wp\/v2\/tags?post=58051"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}