Google has released a new Pro model of its latest AI, Gemini, and company sources say it has outperformed GPT-3.5 (the free version of ChatGPT) in widespread testing. According to performance reports, Gemini Ultra exceeds current state-of-the-art results on 30 of the 32 widely-used academic benchmarks used in large language model (LLM) research and development. Google has been accused of lagging behind OpenAI’s ChatGPT, widely regarded as the most popular and powerful in the AI space. Google says Gemini was trained to be multimodal, meaning it can process different types of media such as text, pictures, video, and audio. Insider also reports that, with a score of 90.0%, Gemini Ultra is the first model to outperform human experts on MMLU (massive multitask language understanding), which uses a combination of 57 subjects such as math, physics, history, law, medicine and ethics for testing both world knowledge and problem-solving abilities. The Google-brd AI comes in three sizes, or stages, for the Gemini platform: Ultra, which is the flagship model, Pro and Nano (designed for mobile devices). According to reports from TechCrunch, the company says it’s making Gemini Pro available to enterprise customers through its Vertex AI program, and for developers in AI Studio, on December 13. Reports indicate that the Pro version can also be accessed via Bard, the company’s chatbot interface. Eli Collins, VP of product at DeepMind (the division of Google tasked with building out the AI platform), tells TechCrunch that Gemini Ultra can comprehend “nuanced” information in text, images, audio and code.
Full report : Google’s New AI, Gemini, Beats ChatGPT In 30 Of 32 Test Categories.
