Claude 3 Opus Dethrones GPT-4 in AI Chatbot Rankings

PLUS - Introducing DBRX: A New State-of-the-Art Open LLM by Databricks

DevThink.AI

Essential AI Content for Software Devs, Minus the Hype

Dear readers,

Thank you for your continued support! This week, we explore the mysteries of large language models, the power of chain-of-thought reasoning, and the rapid advancements in AI.

Don't miss our articles on the puzzling behaviors of models like GPT-4 and the exciting news about Anthropic's Claude 3 Opus and Amazon's record investment in the company.

Enjoy diving into the cutting-edge world of AI, and as always, we welcome your feedback.

Happy reading!

In this edition

📖 TUTORIALS & CASE STUDIES

Benchmarking Retrieval Augmented Generation on Tables

read time: 10 minutes

This article explores three strategies for semi-structured Retrieval Augmented Generation (RAG) over a mix of unstructured text and structured tables. It discusses the challenges and potential of each approach, including long context LLMs, targeted table extraction, and document chunking. The article also presents a public benchmark for testing these approaches.

Unraveling the Power of Chain-of-Thought Reasoning in Neural Networks

read time: 15 minutes
Researchers are exploring the power of chain-of-thought reasoning in large language models like ChatGPT. A technique called chain-of-thought prompting has enabled these models to solve complex problems previously considered beyond their reach. Theoretical studies using computational complexity theory are helping to understand the capabilities and limitations of these models. Read more about this fascinating research in this article.

Leveraging Azure OpenAI API for Efficient Retrieval Augmented Generation

read time: 15 minutes
Dr. Gerd Kortemeyer shares his experiences with Azure OpenAI API and embeddings for efficient implementation of Retrieval Augmented Generation (RAG) in this blog post. He discusses the workflow, differences between Azure and OpenAI APIs, and provides code examples for setting up and using Azure OpenAI API.

Revolutionizing User Research with Generative AI and Autonomous Agents

read time: 15 minutes

This article introduces a novel method of synthetic user research using generative AI and autonomous agents. It demonstrates how to create digital customer personas and simulate their interactions for in-depth market research, overcoming traditional limitations of scalability and diversity.

Master RAG Web Apps with JavaScript and LlamaIndex

read time: 1 hr course
This free short course by Laurie Voss, co-founder of npm, teaches how to build a full-stack Retrieval Augment Generation (RAG) web application using JavaScript and LlamaIndex. The course covers practical implementation, including data persistence, real-time chat, and streaming responses.

🧰 TOOLS

LeapingIO: A New Tool for Generative AI

read time: 2 minutes
LeapingIO, an LLM-based debugger with natural language is a new tool for generative AI, designed to help developers leverage AI in their applications. Check out the LeapingIO GitHub repository for more information.

Introducing Stable Code Instruct 3B: A New Instruction-Tuned Code Language Model

read time: 8 minutes

Stability AI introduces Stable Code Instruct 3B, an instruction-tuned Code Language Model that outperforms larger models in software development tasks. It supports natural language interactions, code completion, and handles a variety of tasks such as code generation and software development related queries. The model is now available for commercial use with a Stability AI Membership and on Hugging Face.

Torchtune: A Native-PyTorch Library for LLM Fine-tuning

read time: 2 minutes
PyTorch has introduced a new library, Torchtune, specifically designed for fine-tuning LLMs. This native-PyTorch library could be a valuable tool for developers looking to optimize their AI models.

Codel: A Fully Autonomous AI Agent for Complex Tasks

read time: 3 minutes

Explore Codel, a fully autonomous AI agent capable of performing complex tasks and projects using terminal, browser, and editor. This tool could revolutionize your development workflow and increase productivity.

Introducing DBRX: A New State-of-the-Art Open LLM by Databricks

read time: 20 minutes

Databricks has introduced DBRX, a new open, general-purpose Large Language Model (LLM) that sets a new standard for open LLMs. DBRX surpasses GPT-3.5 and is competitive with Gemini 1.0 Pro. It offers improved training and inference performance, and is available on Hugging Face under an open license.

 

📰 NEWS & EDITORIALS

The Enigma of Large Language Models: Powerful but Mysterious

read time: 20 minutes
Researchers are grappling with the mystery of why large language models like OpenAI's GPT-4 and Google DeepMind's Gemini are so powerful. These models exhibit unexpected behaviors such as 'grokking' and 'double descent', challenging traditional statistical theories. Understanding these phenomena could unlock the next generation of AI technology and help manage its risks. Read more about this intriguing scientific puzzle in this article.

Claude 3 Opus Dethrones GPT-4 in AI Chatbot Rankings

read time: 8 minutes
Anthropic's AI model, Claude 3 Opus, has claimed the top spot on the LMSYS Chatbot Arena leaderboard, pushing OpenAI's GPT-4 to second place. The Chatbot Arena ranks AI models based on human votes. All three versions of Claude 3 are in the top ten, demonstrating impressive performance even at smaller scales.

Preliminary Terms for Intel Support Announced by Biden-Harris Administration

read time: 2 minutes
The Biden-Harris administration has announced preliminary terms for supporting Intel's expansion efforts. This move is part of the government's strategy to strengthen domestic semiconductor manufacturing capabilities. More details can be found here.

AI and the Future of Work: A Deep Dive

read time: 20 minutes
This comprehensive article explores the future of AI, its potential to become self-aware, and its impact on various job sectors. It discusses the possibility of AI authoring best-sellers, replacing customer service agents, and even creating digital models. The article also highlights the potential for AI to AI communication and the implications of remote work.

Amazon's Record Investment in Generative AI Firm Anthropic

read time: 5 minutes
Amazon has finalized its largest venture investment yet, injecting an additional $2.75 billion into generative AI firm Anthropic, known for its powerful Claude 3 family of large language models (LLMs). This move strengthens Amazon's strategic collaboration with Anthropic, enhancing its AWS cloud services and Bedrock platform. Read more about this significant investment here.

 

Thanks for reading and we will see you next time

Follow me on twitter, DM me links you would like included in a future newsletters.