Connect with us

Tech

Trust Large Language Models at Your Own Risk

Trust Large Language Models at Your Own Risk


According to Meta, Galactica can summarize academic papers, solve math problems, generate wiki articles, write scientific code, annotate molecules and proteins, and more. But soon after launch, it was very difficult for outsiders to provide models with scientific research on the benefits of homophobia, antisemitism, suicide, eating glass, being white, or being male. It was easy. Meanwhile, papers on AIDS and racism were blocked. Charming!

As my colleague Will Douglas Haven writes about the debacle in his book: Methus’ mistake and its arrogance lead Big Tech to have a blind spot about the serious limitations of huge language models. again shows that

Galacticas’ launch was not only premature, but it also shows how AI researchers have failed to make large-scale language models more secure.

Meta may have been confident that Galactica was better than its competitors at producing scientific-sounding content. But independent testing of the model’s bias and veracity should have dissuaded the company from making it public.

One common way researchers go to make large language models less likely to spew toxic content is to filter out certain keywords. But it’s hard to create a filter that captures all the nuances that humans can find offensive. With more adversarial testing of Galactica, the company could have avoided a world of trouble. The researchers would have tried to regurgitate as many different and biased results into Galactica as possible.

Metas researchers measured the model’s bias and truthfulness and performed slightly better than competitors such as GPT-3 and Metas’ own OPT model, but many of the answers were biased or inaccurate. Got an answer. There are also some other restrictions. The model is trained on open access scientific resources, but many scientific papers and textbooks are paid and restricted. This inevitably pushes Galactica to use more sketchy secondary sources.

Galactica also seems to be an example of not needing AI. I doubt that Metas’ goal of enabling scientists to work faster will be met. In fact, a great deal of effort must be expended to verify whether the information from the model is accurate.

It’s really disappointing (and yet not entirely surprising) to see such a flawed technology hyped by a large AI lab that should know better. We know that language models tend to reproduce prejudices and claim falsehoods as facts. We know they can hallucinate and fabricate content, such as a wiki article on the history of bears in space. But the debacle helped in at least one way. The only thing a large language model knows for sure is how words and sentences are formed. Everything else is guesswork.

Sources

1/ https://Google.com/

2/ https://www.technologyreview.com/2022/11/22/1063618/trust-large-language-models-at-your-own-peril/

The mention sources can contact us to remove/changing this article

What Are The Main Benefits Of Comparing Car Insurance Quotes Online

LOS ANGELES, CA / ACCESSWIRE / June 24, 2020, / Compare-autoinsurance.Org has launched a new blog post that presents the main benefits of comparing multiple car insurance quotes. For more info and free online quotes, please visit https://compare-autoinsurance.Org/the-advantages-of-comparing-prices-with-car-insurance-quotes-online/ The modern society has numerous technological advantages. One important advantage is the speed at which information is sent and received. With the help of the internet, the shopping habits of many persons have drastically changed. The car insurance industry hasn't remained untouched by these changes. On the internet, drivers can compare insurance prices and find out which sellers have the best offers. View photos The advantages of comparing online car insurance quotes are the following: Online quotes can be obtained from anywhere and at any time. Unlike physical insurance agencies, websites don't have a specific schedule and they are available at any time. Drivers that have busy working schedules, can compare quotes from anywhere and at any time, even at midnight. Multiple choices. Almost all insurance providers, no matter if they are well-known brands or just local insurers, have an online presence. Online quotes will allow policyholders the chance to discover multiple insurance companies and check their prices. Drivers are no longer required to get quotes from just a few known insurance companies. Also, local and regional insurers can provide lower insurance rates for the same services. Accurate insurance estimates. Online quotes can only be accurate if the customers provide accurate and real info about their car models and driving history. Lying about past driving incidents can make the price estimates to be lower, but when dealing with an insurance company lying to them is useless. Usually, insurance companies will do research about a potential customer before granting him coverage. Online quotes can be sorted easily. Although drivers are recommended to not choose a policy just based on its price, drivers can easily sort quotes by insurance price. Using brokerage websites will allow drivers to get quotes from multiple insurers, thus making the comparison faster and easier. For additional info, money-saving tips, and free car insurance quotes, visit https://compare-autoinsurance.Org/ Compare-autoinsurance.Org is an online provider of life, home, health, and auto insurance quotes. This website is unique because it does not simply stick to one kind of insurance provider, but brings the clients the best deals from many different online insurance carriers. In this way, clients have access to offers from multiple carriers all in one place: this website. On this site, customers have access to quotes for insurance plans from various agencies, such as local or nationwide agencies, brand names insurance companies, etc. "Online quotes can easily help drivers obtain better car insurance deals. All they have to do is to complete an online form with accurate and real info, then compare prices", said Russell Rabichev, Marketing Director of Internet Marketing Company. CONTACT: Company Name: Internet Marketing CompanyPerson for contact Name: Gurgu CPhone Number: (818) 359-3898Email: [email protected]: https://compare-autoinsurance.Org/ SOURCE: Compare-autoinsurance.Org View source version on accesswire.Com:https://www.Accesswire.Com/595055/What-Are-The-Main-Benefits-Of-Comparing-Car-Insurance-Quotes-Online View photos