 |
|
|
|||||
Researchers have spotted an apparent downside of smarter chatbots. Although AI models predictably become more accurate as they advance, theyre also more likely to (wrongly) answer questions beyond their capabilities rather than saying, I dont know. And the humans prompting them are more likely to take their confident hallucinations at face value, creating a trickle-down effect of confident misinformation. They are answering almost everything these days, José Hernández-Orallo, professor at the Universitat Politecnica de Valencia, Spain, told Nature. And that means more correct, but also more incorrect. Hernández-Orallo, the project lead, worked on the study with his colleagues at the Valencian Research Institute for Artificial Intelligence in Spain. The team studied three LLM families, including OpenAIs GPT series, Metas LLaMA and the open-source BLOOM. They tested early versions of each model and moved to larger, more advanced ones but not todays most advanced. For example, the team began with OpenAIs relatively primitive GPT-3 ada model and tested iterations leading up to GPT-4, which arrived in March 2023. The four-month-old GPT-4o wasnt included in the study, nor was the newer o1-preview. Id be curious if the trend still holds with the latest models. The researchers tested each model on thousands of questions about arithmetic, anagrams, geography and science. They also quizzed the AI models on their ability to transform information, such as alphabetizing a list. The team ranked their prompts by perceived difficulty. The data showed that the chatbots portion of wrong answers (instead of avoiding questions altogether) rose as the models grew. So, the AI is a bit like a professor who, as he masters more subjects, increasingly believes he has the golden answers on all of them. Further complicating things is the humans prompting the chatbots and reading their answers. The researchers tasked volunteers with rating the accuracy of the AI bots answers, and they found that they incorrectly classified inaccurate answers as being accurate surprisingly often. The range of wrong answers falsely perceived as right by the volunteers typically fell between 10 and 40 percent. Humans are not able to supervise these models, concluded Hernández-Orallo. The research team recommends AI developers begin boosting performance for easy questions and programming the chatbots to refuse to answer complex questions. We need humans to understand: I can use it in this area, and I shouldnt use it in that area, Hernández-Orallo told Nature. Its a well-intended suggestion that could make sense in an ideal world. But fat chance AI companies oblige. Chatbots that more often say I dont know would likely be perceived as less advanced or valuable, leading to less use and less money for the companies making and selling them. So, instead, we get fine-print warnings that ChatGPT can make mistakes and Gemini may display inaccurate info. That leaves it up to us to avoid believing and spreading hallucinated misinformation that could hurt ourselves or others. For accuracy, fact-check your damn chatbots answers, for crying out loud. You can read the teams full study in Nature.This article originally appeared on Engadget at https://www.engadget.com/ai/advanced-ai-chatbots-are-less-likely-to-admit-they-dont-have-all-the-answers-172012958.html?src=rss
Category:
Marketing and Advertising
In a surprise 30-minute event today that could have been an email, Samsung unveiled new additions to its portfolio of devices this year, including the Galaxy S24 FE and the Galaxy Watch FE LTE. The highlight of today's news has to be the new Galaxy Tab S10 tablets, though, since they've long been regarded as the best premium Android tablets around. The Galaxy Tab S10+ and Tab S10 Ultra start at $1,000 and $1,200 respectively (the same price as the iPhone 16 Pro and Pro Max) and are available for pre-order today before they retail on October 3. With the Tab S10 series, Samsung proclaims it has brought its Galaxy AI to the category, thus making AI available for all. Features introduced on its flagship S24 phones earlier this year like Circle to Search and Sketch to Image are now supported on the tablets, and those that worked with the S Pen on the S24 Ultra, like Handwriting Assist and Note Assist, are here too. I spent some time with the new hardware and, though it's too early to tell if these updates work well, I can still say these are probably going to remain the best Android tablets around. When I picked up a Galaxy Tab S10 Ultra at Samsung's event today, I once again marveled at how thin and light it was, despite having already experienced the same feelings with all of Samsung's previous tablets. To recap, the Tab S10 Ultra has a 14.6-inch screen, while the Tab S10+ comes in at 12.4 inches. Both these AMOLED panels have anti-reflective finishes, and the devices are rated IP68 for durability, despite being so satisfyingly slim. They feel like blades you could potentially use to slice very soft sponge cakes with. I was able to pick up a Tab S10 Ultra with very little effort or muscle strain, and though it's usually difficult to maneuver such a wide screen, the fact that I could easily wield it with one hand made things easier. Cherlynn Low for Engadget There's not much that's changed compared to the Galaxy Tab S9, other than that the S10 series uses MediaTek's Dimensity 9300+ processors, instead of Qualcomm's Snapdragon chips. I'm not convinced that these chips have the power or energy efficiency to multitask or execute AI tasks efficiently, but that's not something I can determine at a hands-on event. Samsung's AMOLED panels remain vibrant and bright, providing excellent media consumption experiences. It was hard to gauge how effective the anti-reflective treatment was under the harsh lights set up for the event, but for the most part I found things easy to see. And though I didn't linger too long on any of the Galaxy AI features on the Tab S10 series, I can tell you I've had fun playing with the very same tools on the S24 flagships we've reviewed throughout the year. Whether it's the S24 Ultra with an S Pen or the Z Fold 6 and Z Flip 6, Samsung's slate of hardware this year have all received the Galaxy AI suite of writing and photo editing tools. We've already had time to ruminate how useful any of these things really are in the real world, and in general our impressions have been a resounding "meh." I have been impressed with how Sketch to Image has been able to transform crappy drawings of animals into realistic looking beasts in photos, and Circle to Search is a Google tool that makes it easier to look up items by drawing a ring around them. Many of the other Galaxy AI features, like most generative AI tools today, are only moderately helpful. We'll need to spend more time with the Tab S10 Ultra, Tab S10+, Galaxy S24 FE and even the Galaxy Watch FE LTE to determine if they're worth spending your money on. But for now, I have to admit that it's nice to see Samsung roll out all its Galaxy AI features across its lineup, resulting in a sense of cohesion and parity even in its lower cost offerings. Apple Intelligence, meanwhile, will require an iPhone 15 Pro, iPhone 16 or iPhone 16 Pro, and won't work if you only have an iPhone 15. It's clear we're deep into the generative AI age, and will not be able to avoid them much longer, especially now that they're getting more prevalent across the Android ecosystem. This article originally appeared on Engadget at https://www.engadget.com/computing/galaxy-tab-s10-ultra-hands-on-ai-arrives-on-samsungs-premium-android-tablet-171105485.html?src=rss
Category:
Marketing and Advertising
StarCraft: Remastered and StarCraft II: Campaign Collection are coming to PC Game Pass, as announced by Xbox at Tokyo Game Show. Both titles will be available on November 5 to anyone with a PC Game Pass or Game Pass Ultimate subscription. The multiplayer components of both games are already free-to-play on PCs, but this will allow people to experience the single-player campaigns. Starcraft II: Campaign Collection, for instance, includes over 70 missions pulled from all of the various DLC, like Wings of Liberty and Heart of the Swarm, among others. StarCraft: Remastered adds some modern goodies to the original game, like 4K visuals, enhanced audio and newly-designed leaderboards. This update has been floating around since 2017, but Game Pass availability should introduce the iconic 1998 real-time strategy (RTS) title to a new audience. Despite getting a bit long in the tooth, both games still have active multiplayer communities. This also holds true in the world of professional competitive gaming. Many credit StarCraft II, which released back in 2010, with assisting in the rise of live streaming. This isnt the only Blizzard-centric news to come out of Tokyo Game Show. Overwatch 2 is getting (probably very expensive) skins based on the anime My Hero Academia. This promotion goes from October 17 to 30.This article originally appeared on Engadget at https://www.engadget.com/gaming/pc/starcraft-remastered-and-starcraft-ii-are-coming-to-pc-game-pass-170133814.html?src=rss
Category:
Marketing and Advertising
All news |
||||||||||||||||||
|
||||||||||||||||||