hypnopump's picture

1 1 1

hypnopump

hypnopump

·

https://hypnopump.github.io

AI & ML interests

Universe, Life, Intelligence

Recent Activity

upvoted a paper 4 days ago

Huxley-Gödel Machine: Human-Level Coding Agent Development by an Approximation of the Optimal Self-Improving Machine

updated a model 17 days ago

hypnopump/flash-attention-3

published a model 17 days ago

hypnopump/flash-attention-3

View all activity

Organizations

authored 2 papers over 1 year ago

GoldFinch: High Performance RWKV/Transformer Hybrid with Linear Pre-Fill and Extreme KV-Cache Compression

Paper • 2407.12077 • Published Jul 16, 2024 • 57

Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence

Paper • 2404.05892 • Published Apr 8, 2024 • 39

authored a paper over 2 years ago

RWKV: Reinventing RNNs for the Transformer Era

Paper • 2305.13048 • Published May 22, 2023 • 19