Highlights - State of AI Report 2023

Cherrypicked news from https://stateof.ai

Thought to Image decoding by Meta

Thoughts to image

Towards a Real-Time Decoding of Images from Brain Activity

Using magnetoencephalography (MEG), Meta showcases an AI system capable of decoding the unfolding of visual representations in the brain with an unprecedented temporal resolution.

Eureka Robotics Research

AI agent uses LLMs to automatically generate reward algorithms to train robots to accomplish complex tasks

Eureka! NVIDIA Research Breakthrough Puts New Spin on Robot Learning | NVIDIA Blog

AI agent uses LLMs to automatically generate reward algorithms to train robots to accomplish complex tasks.

NVIDIA BlogAngie Lee

PaLM-E: a foundation model for robotics

The model combines PaLM-540B and ViT-22B and enables as input text, images and robot states which are encoded into the same space as work token embeddings and then fed into language model to perform next token prediction.

PaLM-E: An Embodied Multimodal Language Model

Project page for PaLM-E: An Embodied Multimodal Language Model.

Swift AI Drone

Champion-level Autonomous Drone Racing using Deep Reinforcement Learning (Nature, 2023)

Music Generation

Various models made significant advancements in the quality of controllable music

Demo by Meta:

MusicGen - a Hugging Face Space by facebook

Discover amazing ML apps made by the community

a Hugging Face Space by facebook

Google's Med PaLM 2 language model

Google's Med PaLM 2 is an expert according to the USMLE (US Medical Licensing Examination),

Mathematical Theorem Proving via AI

• LLEMMA
• GPT-F

Teaching AI advanced mathematical reasoning

Meta AI has built an AI system that has solved 10 International Math Olympiad problems and beats the SOTA by 20 percent on the MiniF2F benchmark.

AlphaTensor - Discovering faster matrix multiplication algorithms with reinforcement learning

by treating algorithm discovery process as a single-player game.

Discovering novel algorithms with AlphaTensor

In our paper, published today in Nature, we introduce AlphaTensor, the first artificial intelligence (AI) system for discovering novel, efficient, and provably correct algorithms for fundamental tasks such as matrix multiplication. This sheds light on a 50-year-old open question in mathematics about…

Predictions for the next 12 months from stateof.ai

1. A Hollywood-grade production makes use of generative AI for visual effects.
2. A generative AI media company is investigated for its misuse during in the 2024 US election circuit.
3. Self-improving AI agents crush SOTA in a complex environment (e.g. AAA game, tool use, science).
4. Tech IPO markets unthaw and we see at least one major listing for an AI-focused company (e.g. Databricks).
5. The GenAI scaling craze sees a group spend >$1B to train a single large-scale model.
6. The US’s FTC or UK’s CMA investigate the Microsoft/OpenAI deal on competition grounds.
7. We see limited progress on global AI governance beyond high-level voluntary commitments.
8. Financial institutions launch GPU debt funds to replace VC equity dollars for compute funding.
9. An AI-generated song breaks into the Billboard Hot 100 Top 10 or the Spotify Top Hits 2024
10. As inference workloads and costs grow significantly, a large AI company (e.g. OpenAI) acquires an inference-focused AI chip company.