By Woosuk Kwon, Zhuohan Li, Siyuan Zhuang, Ying Sheng, Lianmin Zheng, Cody Yu, Joey Gonzalez, Hao Zhang and Ion Stoica introduce vLLM, an open-source library for fast LLM inference and serving. vLLM utilizes PagedAttention, a new attention algorithm that effectively manages attention keys and values.

Li Chen, Penghao Wu, Kashyap Chitta, Bernhard Jaeger, Andreas Geiger and Hongyang Li provide a comprehensive analysis of more than 250 papers, covering the motivation, roadmap, methodology, challenges, and future trends in end-to-end autonomous driving.

Positive Security showcase an attack which leverages indirect prompt injection to trick Auto-GPT (LLM-based agent) into executing arbitrary code when it is asked to perform a seemingly harmless task such as text summarization on an attacker controlled website

In the fourth part of "The Grid", Brian Potter discusses the challenges faced by the electrical grid and the potential solutions. Increasing use of variable sources of electricity, decreasing grid reliability, increasing delay in building electrical infrastructure, and increasing demand for electricity are all addressed.

Isaac Kauvar, Chris Doyle, Linqi Zhou and Nick Haber present Curious Replay - a form of prioritized experience replay tailored to model-based agents through use of a curiosity-based priority signal.

Manli Shu, Jiongxiao Wang, Chen Zhu, Jonas Geiping, Chaowei Xiao and Tom Goldstein investigate the exploitability of instruction tuning in large language models. They propose AutoPoison, an automated data poisoning pipeline, to achieve specific attack goals through intentionally changing the model's behavior. The study showca...

doubleagent.net look under the hood of a Bluetooth car battery monitor siphoning up location data

BOOK | Instead of trying to be exhaustive, Francois Fleuret's little book is limited to the background necessary to understand a few important models. And it works!

Earthweb propose a comprehensive overview of the OnlyFans userbase. And it is... surprising

VIDEO | How much of this math do you know?

Lilian Weng gives a comprehensive overview of Agent Systems, their opportunities and their challenges

Neel Jain, Khalid Saifullah, Yuxin Wen, John Kirchenbauer, Manli Shu, Aniruddha Saha, Micah Goldblum, Jonas Geiping and Tom Goldstein propose a framework for self-supervised evaluation of LLMs by analyzing their sensitivity or invariance to transformations on the input text.

Microsoft Research : Suriya Gunasekar, Yi Zhang, Jyoti Aneja, Caio César Teodoro Mendes, Allie Del Giorno, Sivakanth Gopi, Mojan Javaheripi, Piero Kauffmann, Gustavo de Rosa, Olli Saarikivi, Adil Salim, Shital Shah, Harkirat Singh Behl, Xin Wang, Sébastien Bubeck, Ronen Eldan, Adam Tauman Kalai, Yin Tat Lee and Yuanzhi Li int...

Maxime Labonne consolidates his articles and notebooks in a single GitHub repo to form an end-to-end LLM course

Elinas (Zeus Labs) shares a helpful blogpost on QLoRA training, detailing important steps in the process

Kai Lv, Yuqing Yang, Tengxiao Liu, Qinghui Gao, Qipeng Guo and Xipeng Qiu propose a new optimizer, LOw-Memory Optimization (LOMO), which fuses the gradient computation and the parameter update in one step to reduce memory usage.

Evaluation of human performance is notoriously difficult, even for an expert eye. The difficulty primarily lies in consistency of evaluations across subjects and over time. And, for all satisfactory solutions, a key challenge is then to communicate the output without losing valuable information.

Asterisk Magazine - A conversation about what happens to the economy when intelligence becomes too cheap to meter

Shirui Pan, Linhao Luo, Yufei Wang, Chen Chen, Jiapu Wang and Xindong Wu present a forward-looking roadmap for the unification of LLMs and Knowledge Graphs.

Nature - Jason Z. Kim and Dani S. Bassett provide low-level machine code along with a programming framework by using a recurrent neural network—a reservoir computer—to decompile, code and compile analogue computations.

Financial Times - Nearly 1.4mn kilometres of metal-encased fibre criss-crosses the world’s oceans, speeding internet traffic seamlessly around the globe. The supply and installation of these cables have been dominated by companies from France, the US and Japan.

Hongyang Yang, Xiao-Yang Liu and Christina Dan Wang present an open-source large language model, FinGPT, for the finance sector. Unlike proprietary models, FinGPT takes a data-centric approach, providing researchers and practitioners with accessible and transparent resources to develop their FinLLMs.

Anton Howes explores the origins of the steam engine. And it's not necessarily what you were taught.

Gustavo Deco, Yonatan Sanz Perl, Adrián Ponce-Alvarez, Enzo Tagliazucchi, Peter C Whybrow, Joaquín Fuster, Morten L. Kringelbach show the existence of a ‘ring’ of specific prefrontal cortex regions ruling over the orchestration of higher brain function.

Chris Cundy and Stefano Ermon formulate sequence generation as an imitation learning (IL) problem which allows to incorporate backtracking by introducing a backspace action into the generation process.