article thumbnail

DIY LLM Evaluation, a Case Study of Rhyming in ABBA Schema

Xebia

DIY LLM Evaluation, a Case Study of Rhyming in ABBA Schema It’s becoming common knowledge: You should not choose your LLMs based on static benchmarks. Especially when combined with the auto-regressive architecture of most LLMs. My charts above show that LLM performance varies a lot by task.

article thumbnail

Beyond OpenAI in Commercial LLM Landscape

John Snow Labs

Exploring the Innovators and Challengers in the Commercial LLM Landscape beyond OpenAI: Anthropic, Cohere, Mosaic ML, Cerebras, Aleph Alpha, AI21 Labs and John Snow Labs. While OpenAI is well-known, these companies bring fresh ideas and tools to the LLM world. billion in funding, offers Dolly, an open-source model operating locally.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

The skills and traits of elite CTOs

CIO

Chief technology officers are key players in the enterprise C-suite, oftentimes working in collaboration with CIOs at the forefront of new and innovative technologies. They are among the most important hires organizations are making today due to the business value that successful technology deployments can bring.

article thumbnail

Nvidia points to the future of AI hardware

CIO

GPU powerhouse Nvidia has bet its future on AI, and a handful of recent announcements focus on pushing the technology’s capabilities forward while making it available to more organizations. As LLM AIs trained in 2023 are deployed, “CIOs will learn what works and what doesn’t, and so a retrain and redeployment cycle will begin,” Rau says.

Hardware 243
article thumbnail

Piramal CTO Saurabh Mittal on financial services innovation

CIO

The 36,000-square-foot innovation hub will be led by the company’s CTO, Saurabh Mittal, and Markandey Upadhyay, head of business intelligence unit for Piramal. CIO.com caught up with Mittal to know more about his plans for the innovation lab, as well as the technology strategy for the financial services company.

article thumbnail

SAP enhances Datasphere and SAC for AI-driven transformation

CIO

Jurgen Mueller, SAP CTO and executive board member, called the innovations, which includes an expanded partnership with data governance specialist Collibra, a “quantum leap” in the company’s ability to help customers drive intelligent business transformation through data. That hasn’t always been the case,” Menninger said.

article thumbnail

Tunstall’s CTO wants to build the Porsche 911 of telehealth

CIO

Gary Steen joined assistive technology provider Tunstall Healthcare as its group chief technology officer (CTO) in August 2021, having previously been managing director for technology at telecommunications provider TalkTalk. So Steen has a critical role to play.

CTO 144