Links for September 2nd

02 Sep 2023

Here are some links I found interesting this week.

Achieve 23x LLM Inference Throughput & Reduce p50 Latency

Thoughts about what worked in math circles • Buttondown

huggingface/text-generation-inference: Large Language Model Text Generation Inference

Augustine of Hippo - Wikipedia

mancer

To de-risk AI, the government must accelerate knowledge production | by Greg Fodor | Medium

DNA teleportation - Wikipedia

Lockheedmartin apparel | 록히드마틴 어패럴

Nomad [E] by Work Louder by Work Louder Inc. — Kickstarter

Normcore LLM Reads

My Way killings - Wikipedia

New LLM Foundation Models - by Sebastian Raschka, PhD

Fully Sharded Data Parallel: faster AI training with fewer GPUs Engineering at Meta -

Understanding Encoder And Decoder LLMs

SpikeySpheres

Musings on typicality – Sander Dieleman

My Blog - My WordPress Blog

What Is the Longhouse? | L0m3z | First Things

Meltwater pulse 1B - Wikipedia

[2302.00196] An Axiomatic Characterization of CFMMs and Equivalence to Prediction Markets

Under the Hood of the Ethereum Gossip Protocol | SpringerLink

Manichaeism - Wikipedia

Idoru - Wikipedia

How Discord achieves native iOS performance with React Native

A Perfect Spy - Wikipedia

Drake - Fake Love (Madden UKG Remix) [FREE DOWNLOAD] by Madden

All The Things She Said (Extension 119 Club Edit) - YouTube

One Pace | The Definitive One Piece Viewing Experience

(1) Natural immunity wins - YouTube

'JAZZEANS pt.III' | Newjeans Jazz Playlist pt.III [playlist] - YouTube

Book Review: The Hungry Brain | Slate Star Codex

SF Privately Owned Public Open Spaces

A Framework for Evaluating Crypto VC Funds | by BrainGenius | Medium

Contracts - Basin

FEDE LNG - XX (AXT 003) - YouTube

A Theory for Emergence of Complex Skills in Language Models - YouTube

NEW JEANS - ETA (COVER) - YouTube

Online normalizer calculation for softmax

Dynasty Mindset — Charlotte Fang

Links for August 26th

26 Aug 2023

Here are some links I found interesting this week.

Uni Foraging in the Bay Area

1-click chatbot | ora.ai

jzhao.xyz

Accelerando - Wikipedia

(3) Stardust ‘Music Sounds Better With You’ | The Making of a Dance Classic - YouTube

ricklamers/shell-ai: LangChain powered shell command generate and run CLI

Stop Swiping. Start Settling. | The Free Press

[2308.08708] Consciousness in Artificial Intelligence: Insights from the Science of Consciousness

A better explanation of "Top P"? - Prompting - OpenAI Developer Forum

How to generate text: using different decoding methods for language generation with Transformers

Visualizing the mysterious dance: Quantum entanglement of photons captured in real-time

How to make an unreal roasted tomato soup - YouTube

Remilia Corporation Onboarding Package — Charlotte Fang

Ruby Ridge - Wikipedia

Acquired

Close to the Machine: Technophilia and its discontents | manu

War as the Truest Form of Divination: On Cormac McCarthy's Blood Meridian

Akin's Laws of Spacecraft Design - Matt Rickard

A Closer Look at "Cut Your Losses Early; Let Your Profits Run" Elm Partners

mimetic

(1) megablob friend group - by Ava - bookbear express

FUFU Kawaguchiko | Small Luxury Resort [Official]

EigenLayer: The Restaking Collective

Fundamental MPC Protocols

Pragmatic MPC

Influence of various intensities of 528 Hz sound-wave in production of testosterone in rat's brain and analysis of behavioral changes - PubMed

AI and the Structure of Reasoning | Reaction Wheel

An Armchair Psychoanalysis of Albert Camus

FANGED NOUMENA

Judgement of Solomon - Wikipedia

Bataillean - Wiktionary, the free dictionary

A Newcomer's Guide to "The Natural Theologian"

Ray Peat: Where to Start - by Yago - Polytropic

Maxwell's demon - Wikipedia

Links for August 19th

19 Aug 2023

Here are some links I found interesting this week.

[2308.03825] "Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Models

KL-divergence as an objective function — Graduate Descent

In Plain Sight: Ross Coulthart, 12/08 Discussion : UFOs

Julie W. Design on Twitter: "fun fact: creating consistent characters in midjourney doesn't have to be complicated 🔥 no image links, no seeds, no weird parameters – just a prompt + some patience 🫶 it's a short tutorial (I promise) – ready set go

Amazon.com: Technology and Strategy: Conceptual Models and Diagnostics: 8580000033540: Goodman, Richard A., Lawless, Michael W.: Books

Inside MH370's cargo theory that links the United States Air Force to the missing plane

1561 celestial phenomenon over Nuremberg - Wikipedia

normal-computing/outlines: Generative Model Programming

Real-Time Research Walkthrough: Mover Heads Part 1/2 - YouTube

Richard Rhodes - Making of Atomic Bomb, AI, WW2, Oppenheimer, & Abolishing Nukes - YouTube

Antimetal | Save up to 75% on AWS

Coordination as a Scarce Resource — LessWrong

American Pravda: Why the Media Fears RFK Jr., by Ron Unz - The Unz Review

How is LLaMa.cpp possible?

George Hotz vs Eliezer Yudkowsky AI Safety Debate - YouTube

mindrage/Manticore-13B-Chat-Pyg-Guanaco-GGML · Hugging Face

graphql-python/gql: A GraphQL client in Python

oobabooga/text-generation-webui: A Gradio web UI for Large Language Models. Supports transformers, GPTQ, llama.cpp (ggml), Llama models.

Huber loss - Wikipedia

[2104.09864] RoFormer: Enhanced Transformer with Rotary Position Embedding

wallets - How the centralized exchanges handle deposits? - Ethereum Stack Exchange

Jim Fan on X: "There're few who can deliver both great AI research and charismatic talks. OpenAI Chief Scientist @ilyasut is one of them. I watched Ilya's lecture at Simons Institute, where he delved into why unsupervised learning works through the lens o

An observation on Generalization - YouTube

Fairmint/c-org: Smart-contracts for continuous organizations

Making Amazing Recreational Drug Cocktails | Qualia Computing

[2305.18654] Faith and Fate: Limits of Transformers on Compositionality

Bay of Pigs Invasion - Wikipedia

Life insurers confirm excess young deaths - YouTube

vLLM: Easy, Fast, and Cheap LLM Serving with PagedAttention

shadcn/ui

Cameron R. Wolfe, Ph.D. on X: "Have you ever played with the topP parameter on chat/text completion APIs? This parameter, based upon a technique called nucleus sampling, is a great way to control the randomness of a language model’s output. Here’s how

Competing Theories of Grokking

Building transformers from neurons and astrocytes | PNAS

(1) [ 40Hz ] GAMMA Binaural Beats, Ambient Study Music for Focus and Concentration - YouTube

National IQ dataset – View on IQ

Elite overproduction - Wikipedia

Uap_Timeline_Prepared_By_Anon.pdf | PDF Host

Aerodynamic Interactions and Turbulence Mitigation by Unidentified Aerospace- Undersea Phenomena

[2301.03728] Scaling Laws for Generative Mixed-Modal Language Models

Links for August 12th

12 Aug 2023

Here are some links I found interesting this week.

We Are All Animals at Night | Hazlitt

NVIDIA's CUDA Monopoly

Zach Mueller on Twitter: "You may know that @huggingface Accelerate has big-model inference capabilities, but how does that work? With the help of #manim, let's dig in! Step 1: Load an empty model into memory using @PyTorch's `meta` device, so it uses a *

Speeding up the GPT - KV cache | Becoming The Unbeatable

[2308.03296] Studying Large Language Model Generalization with Influence Functions

Leviathan and the Air-Pump - Wikipedia

Michelson–Morley experiment - Wikipedia

Michelin-Starred Ramen in Tokyo for $8 - no reservations - YouTube

From the late 2000s to the mid-2010s, I worked as a molecular biologist for a national security contractor in a program to study Exo-Biospheric-Organisms (EBO). I will share with you a lot of information on this subject. Feel free to ask questions or ask

vllm-project/vllm: A high-throughput and memory-efficient inference and serving engine for LLMs

Million.js

Moscovium - Wikipedia

/x/ - Paranormal » Thread #34629564

All-domain Anomaly Resolution Office - Wikipedia

AGI Introduction

Database Animals, Financialized

Re: Add ability to lock relationships to never be culled - Answer HQ

Four Notes on Reading Remilia Collective [gp] — Charlotte Fang

"I'm cute I'm punk rock" - by Noah Smith - Noahpinion

The Novice's LLM Training Guide

Current Best Practices for Training LLMs from Scratch

Links for August 5th

05 Aug 2023

Here are some links I found interesting this week.

(1) The Linguistics Iceberg Explained - YouTube

AI Research Blog - The Transformer Blueprint: A Holistic Guide to the Transformer Neural Network Architecture

Giles Corey " Deconstructionist" - YouTube

Cybernetic Culture Research Unit - Wikipedia

Dharma Seed - Dharma Talks from Retreats

HANNI (NewJeans) - Seven (AI COVER) - YouTube

Et Annet Sted (Axel Boman Remix) - YouTube

Computers Are Bad

Zero HP Lovecraft 🦅🐍 on Twitter: "When people who lack a common language live and communicate in the same place, they develop a broken, hybrid language called a pidgin. (This word is derived from the Chinese pronunciation of the English word busines

LK-99: The Live Online Race for a Room-Temperature Superconductor (Summary) – Eiri Sanada

Stablecoin 101: The Case for LSD-backed Stablecoins | by Ben Wee | Jul, 2023 | Medium

x86 is dead, long live x86! | Mercari Engineering

My Beautiful Friend | The Point Magazine

Lymphadenopathy following COVID-19 vaccination: a wake-up call from case reports | British Journal of General Practice

[2307.06962] Copy Is All You Need

Shamir Secret Sharing - too long to tweet

Superdiamagnetism - Wikipedia

Computers Are Overrated – Ben Landau-Taylor

Miilkbone - Keep It Real [HD] - YouTube

Patterns for Building LLM-based Systems & Products

Ethics of AI-based invention: a personal inquiry | Andy Matuschak

Nvidia H100 GPUs: Supply and Demand · GPU Utils ⚡️

Beijing Weather Modification Office - Wikipedia

Finetuning Llama 2 in your own cloud environment, privately | SkyPilot Blog

CoWoS® - Taiwan Semiconductor Manufacturing Company Limited

[2307.08701] AlpaGasus: Training A Better Alpaca with Fewer Data

Telemarketers | Official Trailer | HBO - YouTube

Avenging Polanyi's Revenge (Exploiting the Approximate Omniscience of LLMs in Planning..) - YouTube

A U/Acc Primer – xenogothic

nerijs/pixel-art-xl · Hugging Face

David Samuels Interviews MLK Biographer David Garrow on Barack Obama - Tablet Magazine

[2308.00951] From Sparse to Soft Mixtures of Experts

Cooper pair - Wikipedia

Anisotropy - Wikipedia

Straussian Reading

Trash Radio on Twitter: "What the hell is going on in Canada? A thread: https://t.co/cCH10hikEe" / X

The AI Organization, part I - by Omar Shams - mutable.ai

I Only Fly First Class

Live Near Friends

Non-determinism in GPT-4 is caused by Sparse MoE - 152334H

Sebastian Raschka on Twitter: "What happens if we train LLMs for multiple epochs? The question I asked multiple times in the past finally got answered in this new preprint, "To Repeat or Not To Repeat: Insights from Scaling LLM under Token-Crisis". 1/6 ht

Introducing MK-1 — MK-1

Previous Next