Wednesday, AI 101: What is KAN?

Friday: A new investigation into the world if AI Unicorns – xAI.

Website https://cambrian-mllm.github.io 

Code https://github.com/cambrian-mllm/cambrian 

Models https://huggingface.co/nyu-visionx/ 

Data https://huggingface.co/datasets/nyu-visionx/Cambrian-10M 

CV-Bench https://huggingface.co/datasets/nyu-visionx/CV-Bench 

Evaluation https://github.com/cambrian-mllm/cambrian”

97% cheaper, 11x faster, and 18% more accurate than GPT-3.5

No ground truth data set needed

Customizable for your specific evaluation requirements

Microsoft and Skeleton Key

• The company has identified a new AI jailbreak technique, Skeleton Key, which uses a multi-turn strategy to bypass AI model guardrails, allowing harmful content production. This attack affects various generative AI models. Microsoft has implemented mitigations, such as Prompt Shields and Azure AI Content Safety, to detect and block such attacks. Recommendations for developers include input filtering, output filtering, and abuse monitoring. The research was shared with other AI providers for broader industry mitigation efforts.

Hugging Face and new LLM leaderboard

LangChain: LangGraph v0.1 + LangGraph Cloud = scalable and reliable agent deployment

• LangGraph v0.1 offers precise control for building agentic applications, while LangGraph Cloud, now in beta, provides fault-tolerant infrastructure. Companies like Klarna and Replit are already leveraging these tools to enhance AI initiatives. LangGraph Cloud features integrated monitoring and streamlined deployment.

Amazon almost devours Adept

• Amazon is strengthening its AI capabilities by hiring executives from Adept, a startup specializing in automating enterprise workflows. Adept’s co-founder and CEO David Luan and his team will join Amazon’s AGI division, led by Rohit Prasad. Adept will continue operating independently, and Amazon will license some of its technology.

Google DeepMind makes Gemma 2 available

• Google’s high-performance AI model, is now available in 9B and 27B parameter sizes. It delivers superior performance and efficiency, even on a single NVIDIA H100 GPU. Gemma 2 integrates easily with major AI frameworks and supports budget-friendly deployments. Researchers can access Gemma 2 for free on Kaggle or via Colab notebooks, with academic credits available for cloud services.

Imbue on training a 70B parameter model

• This model outperforms GPT-4 on reasoning tasks. They detailed the end-to-end infrastructure setup process, shared scripts for health checks, and thanked partners for support. They emphasized reproducibility, automated solutions, and deep understanding of infrastructure, inviting interested individuals to join their team.

Anthropic introduces Claude Projects and “Build with Claude” contest

• Pro and Team users can now organize chats and share knowledge effectively. Projects include a 200K context window for comprehensive document integration. Features like custom instructions and Artifacts enhance productivity.

• Anthropic's "Build with Claude" contest invites developers to create innovative projects using the Claude API. The virtual hackathon runs from June 26th to July 10th, 2024. The top three projects will win $10,000 in API credits.

• Also, read the Time’s interview with Dario Amodei

Stability AI and the new CEO

• Prem Akkaraju becomes the new CEO. The company also secured a financial bailout from an investor group led by Sean Parker. This recapitalization, necessary due to financial troubles, will likely reduce the stakes of existing investors.

Baidu and upgraded Ernie 4.0

• Ernie 4.0 Turbo AI model, now with 300 million users, is aiming to maintain its competitive edge in China. Baidu also enhanced its PaddlePaddle AI ecosystem. In response to OpenAI blocking its API in China, Baidu and other domestic AI firms are offering migration services to attract affected users.

Different approaches by the leading AI researchers

• While Ilya Sutskever launches Safe Superintelligence Inc. to build – drumroll, please – safe superintelligence (SSI). Andrej Karpathy is fun and hands on: GitHub - karpathy/LLM101n: LLM101n: Let's build a Storyteller. It is a course teaching how to create a Storyteller AI LLM from scratch using Python, C, and CUDA. The practical approach seems to be a better way to understand the benefits and risks of fast-developing AI.

AI scaling myths by AI Snake Oil 

Why Your Generative AI Projects Are Failing by Gradient Flow

Interesting Content in AI, Software, Business, and Tech by Devansh

RLHF roundup by Nathan Lambert

An Interview with Marques Brownlee (MKBHD) About Being a YouTube Star by Stratechery 

LLM Critics Help Catch LLM Bugs OpenAI researchers developed CriticGPT, an LLM critic trained via RLHF, which outperformed human reviewers in finding bugs and providing accurate feedback. In tests, CriticGPT detected more errors than humans in 63% of cases. Combining it with human reviews enhanced overall reliability and reduced errors →read the paper

Meta Large Language Model Compiler: Foundation Models of Compiler Optimization Meta AI unveiled a suite of models called LLM Compiler, enhancing code optimization. Trained on extensive LLVM-IR and assembly code, these models predict and improve compiler optimizations. Available in multiple model sizes, LLM Compiler is pivotal for compiler R&D →read the paper
Also, watch a recent interview with Mark Zuckerberg

WARP: On the Benefits of Weight Averaged Rewarded Policies Google DeepMind's WARP merges LLMs using weight averaging to improve RLHF, addressing common issues like knowledge forgetting and reward hacking. This method balances reward optimization with alignment to human preferences, showing promise in real-world applications →read the paper

Can LLMs Learn by Teaching? A Preliminary Study tested whether LLMs can self-improve through teaching, using feedback from student interactions. Results indicate notable enhancements in model accuracy and capabilities, suggesting a viable path for LLMs to learn independently from human data →read the paper

The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale Hugging Face introduced FineWeb, a massive dataset derived from web crawls, optimized for LLM training through advanced filtering and deduplication. The FineWeb-Edu subset specifically boosts performance on educational benchmarks, with all resources publicly available to further LLM research →read the paper

STEP-DPO: Step-Wise Preference Optimization for Long-Chain Reasoning of LLMs – Optimizes each reasoning step individually in mathematical reasoning tasks, improving model accuracy by nearly 3% on MATH, outperforming several closed-source models. Read the paper

Adam-mini: Use Fewer Learning Rates To Gain More – Introduces an optimizer that matches or surpasses AdamW’s performance while reducing memory usage by 45-50%, improving efficiency and throughput in resource-constrained environments. Read the paper

LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs – Addresses the imbalance in Retrieval-Augmented Generation by processing entire Wikipedia articles into smaller units, improving retrieval scores and performance in open-domain question answering. Read the paper

Unlocking Continual Learning Abilities in Language Models – Proposes MIGU, a rehearsal-free and task-label-free method to combat catastrophic forgetting in LMs, enhancing continual finetuning and pretraining performance. Read the paper

Confidence Regulation Neurons in Language Models – Explores how LLMs handle uncertainty in token predictions, identifying "entropy neurons" that regulate output confidence and "token frequency neurons" that adjust token logits based on token frequency. Read the paper

LiveBench: A Challenging, Contamination-Free LLM Benchmark – Develops a benchmark for LLMs that updates frequently to prevent test set contamination, evaluating various tasks with objective ground-truth scoring. Read the paper

BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions – Evaluates LLMs on challenging programming tasks requiring diverse function calls from 139 libraries, highlighting the need for further advancements in code generation. Read the paper

LongIns: A Challenging Long-context Instruction-based Exam for Large Language Models – Assesses LLMs' understanding of long contexts, revealing that top models struggle with long sequences and perform poorly even at 16k context length. Read the paper

OlympicArena Medal Ranks: Who Is the Most Intelligent AI So Far? – Introduces a benchmark to evaluate AI models' intelligence across multiple disciplines, highlighting the need for further advancements to achieve superintelligence. Read the paper

CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs – Evaluates chart understanding in multimodal LLMs, revealing significant room for improvement in chart comprehension capabilities compared to human performance. Read the paper

Benchmarking Mental State Representations in Language Models – Assesses various LMs to determine their ability to represent mental states, finding that larger models and those fine-tuned with instruction-tuning or RLHF perform better. Read the paper

From Artificial Needles to Real Haystacks: Improving Retrieval Capabilities in LLMs by Finetuning on Synthetic Data – Enhances LLMs' retrieval and reasoning capabilities with long-context inputs by finetuning on synthetic datasets, mitigating hallucination issues found in other methods. Read the paper

APIGen: Automated Pipeline for Generating Verifiable and Diverse Function-Calling Datasets – Introduces a data generation pipeline for creating reliable function-calling datasets, resulting in state-of-the-art performance on the Berkeley Function-Calling Benchmark. Read the paper

Efficient Data Generation for Source-grounded Information-seeking Dialogs: A Use Case for Meeting Transcripts – Develops a semi-automatic approach for generating information-seeking dialog datasets using LLMs, improving response quality and reducing time and effort. Read the paper

How Well Do LLMs Represent Values Across Cultures? Empirical Analysis of LLM Responses Based on Hofstede Cultural Dimensions – Evaluates whether LLMs align their advice with the cultural values of different countries, highlighting the need for better training to ensure cultural sensitivity. Read the paper

Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judges – Evaluates the performance and biases of various LLMs as judges, revealing misalignments and biases that need to be addressed for more accurate evaluations. Read the paper

Symbolic Learning Enables Self-Evolving Agents – Introduces a framework that allows language agents to self-optimize using symbolic networks, enabling autonomous learning and evolution post-deployment. Read the paper

Cognitive Map for Language Models: Optimal Planning via Verbally Representing the World Model – Demonstrates that training language models to construct cognitive maps enhances their planning abilities, providing insights into developing more advanced AI systems. Read the paper

Segment Any Text: A Universal Approach for Robust, Efficient, and Adaptable Sentence Segmentation – Introduces SAT, a sentence segmentation model robust to missing punctuation, adaptable to new domains, and highly efficient, outperforming current models. Read the paper

Simulating Classroom Education with LLM-Empowered Agents –Presents SimClass, a multi-agent classroom simulation framework that enhances user experience by effectively simulating traditional classroom interactions. Read the paper

WILDTEAMING at Scale: From In-the-Wild Jailbreaks to (Adversarially) Safer Language Models – Introduces an automated red-teaming framework to discover and compose unique jailbreak tactics, enhancing LLM robustness against adversarial queries. Read the paper

AUTODETECT: Towards a Unified Framework for Automated Weakness Detection in Large Language Models – Introduces a framework with three LLM-powered agents to systematically uncover weaknesses in LLMs, demonstrating significant improvements in model performance. Read the paper

MemServe: Context Caching for Disaggregated LLM Serving with Elastic Memory Pool – Introduces MemServe, an LLM serving system integrating optimizations to enhance context caching and disaggregated inference, improving job completion time and response time. Read the paper