Flash Forward is a show about possible (and not so possible) future scenarios. What would the warranty on a sex robot look like? How would diplomacy work if we couldn’t lie? Could there ever be a fecal transplant black market? (Complicated, it wouldn’t, and yes, respectively, in case you’re curious.) Hosted and produced by award winning science journalist Rose Eveleth, each episode combines audio drama and journalism to go deep on potential tomorrows, and uncovers what those futures might re ...
…
continue reading
Player FM - Internet Radio Done Right
Checked 5d ago
Added two years ago
Content provided by Igor Melnyk. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Igor Melnyk or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.
Similar to Arxiv Papers
Come dive into one of the curiously delightful conversations overheard at National Geographic’s headquarters, as we follow explorers, photographers, and scientists to the edges of our big, weird, beautiful world. Hosted by Peter Gwin and Amy Briggs.
…
continue reading
DNA science. Artificial intelligence. Smartphones and 3D printers. Science and technology have transformed the world we live in. But how did we get here? It wasn’t by accident. Well, sometimes it was. It was also the result of hard work, teamwork, and competition. And incredibly surprising moments. Hosted by bestselling author Steven Johnson (“How We Got To Now”), American Innovations uses immersive scenes to tell the stories of the scientists, engineers, and ordinary people behind the great ...
…
continue reading
The Skeptics' Guide to the Universe is a weekly science podcast discussing the latest science news, critical thinking, bad science, conspiracies and controversies. -The Skeptics' Guide to the Universe: Your escape to reality - Produced by SGU Productions, LLC: https://www.theskepticsguide.org
…
continue reading
Welcome to Curiosity Weekly from Discovery, hosted by Dr. Samantha Yammine. Once a week, we’ll bring you the latest and greatest in scientific discoveries and break down the details so that you don’t need a PhD to understand it. From neuroscience to climate tech to AI and genetics, no subject is off-limits. Join Sam as she interviews expert guests and investigates the research guiding some of the most exciting scientific breakthroughs affecting our world today. Hosted on Acast. See acast.com ...
…
continue reading
We humans could have a bright future ahead of us that lasts billions of years. But we have to survive the next 200 years first. Join Josh Clark of Stuff You Should Know for a 10-episode deep dive that explores the future of humanity and finds dangers we have never encountered before lurking just ahead. And if we humans are alone in the universe, if we don't survive intelligent life dies out with us too.
…
continue reading
The kickass science and technology radio show that delivers an irreverent look at the week in science and technology.
…
continue reading
Whether the topic is popcorn or particle physics, you can count on BrainStuff to explore -- and explain -- the everyday science in the world around us.
…
continue reading
Science Friction's latest series is: Brain Rot. We're looking at what being chronically online is doing to our brains. What's really going on with our attention spans and tech addiction? Is data-dumping your entire life into ChatGPT helpful? Can going internet free help you escape the doomscroll? And what's it like to be in love ... with an AI? National technology reporter Ange Lavoipierre tackles the wildest ways people are using tech and the big questions about our own use. That's Brain Ro ...
…
continue reading
Join Dr Karl Kruszelnicki, Lucy Smith and their scientific guests, with a bunch of curious triple j listeners for a weekly injection of science, myth-bashing and answers!
…
continue reading
Player FM - Podcast App
Go offline with the Player FM app!
Go offline with the Player FM app!
))
Podcasts Worth a Listen
SPONSORED
<
<div class="span index">1</div> <span><a class="" data-remote="true" data-type="html" href="/series/squid-game-the-official-podcast">Squid Game: The Official Podcast</a></span>
The final season is here—and Squid Game: The Official Podcast is your ultimate companion to the end of the Game. Hosts Phil Yu and Kiera Please return once more to break down every shocking twist and betrayal, and the choices that will determine who, if anyone, makes it out alive. Will Player 456 and the cast of characters we’ve grown to love finally be able to dismantle the games for good? Or will the cycle continue? Alongside creators, cultural critics, and viral internet voices, Phil and Kiera provide their own theories for how the season ends, and what Squid Game ultimately reveals about power, sacrifice, and the systems that shape us. The biggest question isn’t who wins—it’s what it means to be human. Squid Game: The Official Podcast returns Friday, June 27th.
Accelerating Diffusion LLMs via Adaptive Parallel Decoding
Manage episode 486840926 series 3524393
Content provided by Igor Melnyk. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Igor Melnyk or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.
The paper introduces adaptive parallel decoding (APD), enhancing diffusion large language models' speed by dynamically adjusting token sampling, improving throughput while maintaining quality compared to autoregressive models.
https://arxiv.org/abs//2506.00413
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
2381 episodes
Share
Manage episode 486840926 series 3524393
Content provided by Igor Melnyk. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Igor Melnyk or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.
The paper introduces adaptive parallel decoding (APD), enhancing diffusion large language models' speed by dynamically adjusting token sampling, improving throughput while maintaining quality compared to autoregressive models.
https://arxiv.org/abs//2506.00413
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
2381 episodes
All episodes
×
1 [QA] Does Math Reasoning Improve General LLM Capabilities? Understanding Transferability of LLM Reasoning 7:21
7:21 
Play Later 
Play Later 
Lists 
Like 
Liked7:21
Play Later Play Later Lists Like Likedhttps://arxiv.org/abs//2507.00432 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
1 Does Math Reasoning Improve General LLM Capabilities? Understanding Transferability of LLM Reasoning 15:33
15:33 Play Later Play Later Lists Like Liked15:33
Play Later Play Later Lists Like Likedhttps://arxiv.org/abs//2507.00432 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
1 [QA] DABstep: Data Agent Benchmark for Multi-step Reasoning 7:54
7:54 Play Later Play Later Lists Like Liked7:54
Play Later Play Later Lists Like LikedDABstep is a benchmark for evaluating AI agents on multi-step data analysis tasks, featuring 450 real-world challenges that test data processing and contextual reasoning capabilities. https://arxiv.org/abs//2506.23719 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
1 DABstep: Data Agent Benchmark for Multi-step Reasoning 16:50
16:50 Play Later Play Later Lists Like Liked16:50
Play Later Play Later Lists Like LikedDABstep is a benchmark for evaluating AI agents on multi-step data analysis tasks, featuring 450 real-world challenges that test data processing and contextual reasoning capabilities. https://arxiv.org/abs//2506.23719 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
1 [QA] Aha Moment Revisited: Are VLMs Truly Capable of Self Verification in Inference-time Scaling? 8:16
8:16 Play Later Play Later Lists Like Liked8:16
Play Later Play Later Lists Like LikedThis paper explores the effectiveness of inference-time techniques in vision-language models, finding that generation-based methods enhance reasoning more than verification methods, while self-correction in RL models shows limited benefits. https://arxiv.org/abs//2506.17417 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
1 Aha Moment Revisited: Are VLMs Truly Capable of Self Verification in Inference-time Scaling? 16:52
16:52 Play Later Play Later Lists Like Liked16:52
Play Later Play Later Lists Like LikedThis paper explores the effectiveness of inference-time techniques in vision-language models, finding that generation-based methods enhance reasoning more than verification methods, while self-correction in RL models shows limited benefits. https://arxiv.org/abs//2506.17417 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
1 [QA] LLaVA-Scissor: Token Compression with Semantic Connected Components for Video LLMs 8:19
8:19 Play Later Play Later Lists Like Liked8:19
Play Later Play Later Lists Like LikedLLaVA-Scissor introduces a training-free token compression method for video multimodal models, utilizing Semantic Connected Components for effective, non-redundant semantic coverage, outperforming existing methods in various benchmarks. https://arxiv.org/abs//2506.21862 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
1 LLaVA-Scissor: Token Compression with Semantic Connected Components for Video LLMs 14:25
14:25 Play Later Play Later Lists Like Liked14:25
Play Later Play Later Lists Like LikedLLaVA-Scissor introduces a training-free token compression method for video multimodal models, utilizing Semantic Connected Components for effective, non-redundant semantic coverage, outperforming existing methods in various benchmarks. https://arxiv.org/abs//2506.21862 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
1 [QA] Performance Prediction for Large Systems via Text-to-Text Regression 8:40
8:40 Play Later Play Later Lists Like Liked8:40
Play Later Play Later Lists Like Likedhttps://arxiv.org/abs//2506.21718 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
1 Performance Prediction for Large Systems via Text-to-Text Regression 20:32
20:32 Play Later Play Later Lists Like Liked20:32
Play Later Play Later Lists Like Likedhttps://arxiv.org/abs//2506.21718 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
1 [QA] From Memories to Maps: Mechanisms of In-Context Reinforcement Learning in Transformers 7:47
7:47 Play Later Play Later Lists Like Liked7:47
Play Later Play Later Lists Like LikedThis study explores how transformers can model rapid adaptation in learning, highlighting the role of episodic memory and caching in decision-making, paralleling cognitive processes in the brain. https://arxiv.org/abs//2506.19686 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
1 From Memories to Maps: Mechanisms of In-Context Reinforcement Learning in Transformers 20:44
20:44 Play Later Play Later Lists Like Liked20:44
Play Later Play Later Lists Like LikedThis study explores how transformers can model rapid adaptation in learning, highlighting the role of episodic memory and caching in decision-making, paralleling cognitive processes in the brain. https://arxiv.org/abs//2506.19686 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
1 [QA] OmniGen2: Exploration to Advanced Multimodal Generation 7:44
7:44 Play Later Play Later Lists Like Liked7:44
Play Later Play Later Lists Like LikedOmniGen2 is an open-source generative model for diverse tasks like text-to-image and image editing, featuring distinct decoding pathways and achieving competitive results with modest parameters. https://arxiv.org/abs//2506.18871 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
1 OmniGen2: Exploration to Advanced Multimodal Generation 32:16
32:16 Play Later Play Later Lists Like Liked32:16
Play Later Play Later Lists Like LikedOmniGen2 is an open-source generative model for diverse tasks like text-to-image and image editing, featuring distinct decoding pathways and achieving competitive results with modest parameters. https://arxiv.org/abs//2506.18871 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
1 [QA] OctoThinker: Mid-training Incentivizes Reinforcement Learning Scaling 7:28
7:28 Play Later Play Later Lists Like Liked7:28
Play Later Play Later Lists Like Likedhttps://arxiv.org/abs//2506.20512 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
A
Arxiv Papers
1 OctoThinker: Mid-training Incentivizes Reinforcement Learning Scaling 25:52
25:52 Play Later Play Later Lists Like Liked25:52
Play Later Play Later Lists Like Likedhttps://arxiv.org/abs//2506.20512 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
A
Arxiv Papers
1 [QA] Potemkin Understanding in Large Language Models 8:04
8:04 Play Later Play Later Lists Like Liked8:04
Play Later Play Later Lists Like LikedThis paper introduces a framework to evaluate large language models, revealing that their benchmark success often reflects superficial understanding, with pervasive internal incoherence in concept representations. https://arxiv.org/abs//2506.21521 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Potemkin Understanding in Large Language Models 17:20
17:20 Play Later Play Later Lists Like Liked17:20
Play Later Play Later Lists Like LikedThis paper introduces a framework to evaluate large language models, revealing that their benchmark success often reflects superficial understanding, with pervasive internal incoherence in concept representations. https://arxiv.org/abs//2506.21521 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Where to find Grokking in LLM Pretraining? Monitor Memorization-to-Generalization without Test 7:49
7:49 Play Later Play Later Lists Like Liked7:49
Play Later Play Later Lists Like LikedThis study explores grokking in large language models during pretraining, revealing how training pathways evolve from random to structured, enhancing generalization despite converged loss. https://arxiv.org/abs//2506.21551 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Where to find Grokking in LLM Pretraining? Monitor Memorization-to-Generalization without Test 18:35
18:35 Play Later Play Later Lists Like Liked18:35
Play Later Play Later Lists Like LikedThis study explores grokking in large language models during pretraining, revealing how training pathways evolve from random to structured, enhancing generalization despite converged loss. https://arxiv.org/abs//2506.21551 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] MMSearch-R1: Incentivizing LMMs to Search 8:11
8:11 Play Later Play Later Lists Like Liked8:11
Play Later Play Later Lists Like LikedMMSearch-R1 is a reinforcement learning framework for large multimodal models, enabling efficient, on-demand multi-turn search in real-world environments, outperforming existing methods while reducing search calls by over 30%. https://arxiv.org/abs//2506.20670 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
MMSearch-R1 is a reinforcement learning framework for large multimodal models, enabling efficient, on-demand multi-turn search in real-world environments, outperforming existing methods while reducing search calls by over 30%. https://arxiv.org/abs//2506.20670 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Thought Anchors: Which LLM Reasoning Steps Matter? 7:51
7:51 Play Later Play Later Lists Like Liked7:51
Play Later Play Later Lists Like LikedThe paper explores sentence-level analysis of reasoning in large language models, presenting three methods to identify influential "thought anchors" that shape multi-step reasoning processes. An open-source tool is provided. https://arxiv.org/abs//2506.19143 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Thought Anchors: Which LLM Reasoning Steps Matter? 15:41
15:41 Play Later Play Later Lists Like Liked15:41
Play Later Play Later Lists Like LikedThe paper explores sentence-level analysis of reasoning in large language models, presenting three methods to identify influential "thought anchors" that shape multi-step reasoning processes. An open-source tool is provided. https://arxiv.org/abs//2506.19143 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Scaling Speculative Decoding with LOOKAHEAD REASONING 8:06
8:06 Play Later Play Later Lists Like Liked8:06
Play Later Play Later Lists Like LikedLOOKAHEAD REASONING enhances token-level speculative decoding by introducing step-level parallelism, improving speedup from 1.4x to 2.1x while maintaining answer quality across various benchmarks. https://arxiv.org/abs//2506.19830 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Scaling Speculative Decoding with LOOKAHEAD REASONING 22:49
22:49 Play Later Play Later Lists Like Liked22:49
Play Later Play Later Lists Like LikedLOOKAHEAD REASONING enhances token-level speculative decoding by introducing step-level parallelism, improving speedup from 1.4x to 2.1x while maintaining answer quality across various benchmarks. https://arxiv.org/abs//2506.19830 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Vision as a Dialect: Unifying Visual Understanding and Generation via Text-Aligned Representations 7:55
7:55 Play Later Play Later Lists Like Liked7:55
Play Later Play Later Lists Like LikedThis paper introduces Tar, a multimodal framework integrating visual understanding and generation through a shared semantic representation, enhancing efficiency and performance in cross-modal tasks. https://arxiv.org/abs//2506.18898 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Vision as a Dialect: Unifying Visual Understanding and Generation via Text-Aligned Representations 16:59
16:59 Play Later Play Later Lists Like Liked16:59
Play Later Play Later Lists Like LikedThis paper introduces Tar, a multimodal framework integrating visual understanding and generation through a shared semantic representation, enhancing efficiency and performance in cross-modal tasks. https://arxiv.org/abs//2506.18898 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Watermarking Autoregressive Image Generation 7:39
7:39 Play Later Play Later Lists Like Liked7:39
Play Later Play Later Lists Like Likedhttps://arxiv.org/abs//2506.16349 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
A
Arxiv Papers
1 Watermarking Autoregressive Image Generation 27:33
27:33 Play Later Play Later Lists Like Liked27:33
Play Later Play Later Lists Like Likedhttps://arxiv.org/abs//2506.16349 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
A
Arxiv Papers
1 [QA] Drag-and-Drop LLMs: Zero-Shot Prompt-to-Weights 6:43
6:43 Play Later Play Later Lists Like Liked6:43
Play Later Play Later Lists Like LikedDnD introduces a prompt-conditioned parameter generator for LLMs, enabling rapid task-specific customization without separate training, achieving significant performance gains and lower overhead compared to traditional methods. https://arxiv.org/abs//2506.16406 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Drag-and-Drop LLMs: Zero-Shot Prompt-to-Weights 11:26
11:26 Play Later Play Later Lists Like Liked11:26
Play Later Play Later Lists Like LikedDnD introduces a prompt-conditioned parameter generator for LLMs, enabling rapid task-specific customization without separate training, achieving significant performance gains and lower overhead compared to traditional methods. https://arxiv.org/abs//2506.16406 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Flat Channels to Infinity in Neural Loss Landscapes 7:16
7:16 Play Later Play Later Lists Like Liked7:16
Play Later Play Later Lists Like LikedThe paper characterizes special channels in neural network loss landscapes where slow loss decrease occurs, leading to gated linear units, enhancing understanding of gradient dynamics and optimization methods. https://arxiv.org/abs//2506.14951 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Flat Channels to Infinity in Neural Loss Landscapes 15:03
15:03 Play Later Play Later Lists Like Liked15:03
Play Later Play Later Lists Like LikedThe paper characterizes special channels in neural network loss landscapes where slow loss decrease occurs, leading to gated linear units, enhancing understanding of gradient dynamics and optimization methods. https://arxiv.org/abs//2506.14951 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Approximating Language Model Training Data from Weights 7:34
7:34 Play Later Play Later Lists Like Liked7:34
Play Later Play Later Lists Like LikedThe paper presents a method for approximating training data from model weights, improving performance significantly on classification tasks using a gradient-based approach to select relevant public documents. https://arxiv.org/abs//2506.15553 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Approximating Language Model Training Data from Weights 21:37
21:37 Play Later Play Later Lists Like Liked21:37
Play Later Play Later Lists Like LikedThe paper presents a method for approximating training data from model weights, improving performance significantly on classification tasks using a gradient-based approach to select relevant public documents. https://arxiv.org/abs//2506.15553 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] GenRecal: Generation after Recalibration from Large to Small Vision-Language Models 7:40
7:40 Play Later Play Later Lists Like Liked7:40
Play Later Play Later Lists Like LikedGenRecal is a novel distillation framework for vision-language models that enhances knowledge transfer across diverse architectures, improving performance on resource-constrained devices while outperforming large-scale VLMs. https://arxiv.org/abs//2506.15681 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 GenRecal: Generation after Recalibration from Large to Small Vision-Language Models 17:19
17:19 Play Later Play Later Lists Like Liked17:19
Play Later Play Later Lists Like LikedGenRecal is a novel distillation framework for vision-language models that enhances knowledge transfer across diverse architectures, improving performance on resource-constrained devices while outperforming large-scale VLMs. https://arxiv.org/abs//2506.15681 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] ProtoReasoning: Prototypes as the Foundation for Generalizable Reasoning in LLMs 8:30
8:30 Play Later Play Later Lists Like Liked8:30
Play Later Play Later Lists Like Likedhttps://arxiv.org/abs//2506.15211 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
A
Arxiv Papers
1 ProtoReasoning: Prototypes as the Foundation for Generalizable Reasoning in LLMs 12:10
12:10 Play Later Play Later Lists Like Liked12:10
Play Later Play Later Lists Like Likedhttps://arxiv.org/abs//2506.15211 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
A
Arxiv Papers
1 [QA] Sampling from Your Language Model One Byte at a Time 7:05
7:05 Play Later Play Later Lists Like Liked7:05
Play Later Play Later Lists Like LikedThis paper presents a method to convert autoregressive language models with BPE tokenizers into character-level models, addressing tokenization issues and enabling model interoperability and improved performance through ensemble and proxy-tuning. https://arxiv.org/abs//2506.14123 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Sampling from Your Language Model One Byte at a Time 13:35
13:35 Play Later Play Later Lists Like Liked13:35
Play Later Play Later Lists Like LikedThis paper presents a method to convert autoregressive language models with BPE tokenizers into character-level models, addressing tokenization issues and enabling model interoperability and improved performance through ensemble and proxy-tuning. https://arxiv.org/abs//2506.14123 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Don't throw the baby out with the bathwater: How and why deep learning for ARC 7:44
7:44 Play Later Play Later Lists Like Liked7:44
Play Later Play Later Lists Like LikedThis paper demonstrates that deep learning, through on-the-fly training and innovative techniques, significantly enhances performance on the Abstraction and Reasoning Corpus, achieving state-of-the-art results. https://arxiv.org/abs//2506.14276 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Don't throw the baby out with the bathwater: How and why deep learning for ARC 32:30
32:30 Play Later Play Later Lists Like Liked32:30
Play Later Play Later Lists Like LikedThis paper demonstrates that deep learning, through on-the-fly training and innovative techniques, significantly enhances performance on the Abstraction and Reasoning Corpus, achieving state-of-the-art results. https://arxiv.org/abs//2506.14276 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] What Happens During the Loss Plateau? Understanding Abrupt Learning in Transformers 7:18
7:18 Play Later Play Later Lists Like Liked7:18
Play Later Play Later Lists Like LikedThis study explores abrupt learning in shallow Transformers, revealing a performance plateau characterized by repetition bias and representation collapse, with attention map learning as a critical bottleneck. https://arxiv.org/abs//2506.13688 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 What Happens During the Loss Plateau? Understanding Abrupt Learning in Transformers 19:43
19:43 Play Later Play Later Lists Like Liked19:43
Play Later Play Later Lists Like LikedThis study explores abrupt learning in shallow Transformers, revealing a performance plateau characterized by repetition bias and representation collapse, with attention map learning as a critical bottleneck. https://arxiv.org/abs//2506.13688 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning Attention 8:28
8:28 Play Later Play Later Lists Like Liked8:28
Play Later Play Later Lists Like Likedhttps://arxiv.org/abs//2506.13585 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
A
Arxiv Papers
1 MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning Attention 25:05
25:05 Play Later Play Later Lists Like Liked25:05
Play Later Play Later Lists Like Likedhttps://arxiv.org/abs//2506.13585 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
A
Arxiv Papers
1 [QA] Aligned Novel View Image and Geometry Synthesis via Cross-modal Attention Instillation 8:10
8:10 Play Later Play Later Lists Like Liked8:10
Play Later Play Later Lists Like LikedWe present a diffusion-based framework for aligned novel view image and geometry generation, utilizing warping, inpainting, and cross-modal attention distillation for enhanced synthesis and prediction accuracy. https://arxiv.org/abs//2506.11924 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Aligned Novel View Image and Geometry Synthesis via Cross-modal Attention Instillation 16:59
16:59 Play Later Play Later Lists Like Liked16:59
Play Later Play Later Lists Like LikedWe present a diffusion-based framework for aligned novel view image and geometry generation, utilizing warping, inpainting, and cross-modal attention distillation for enhanced synthesis and prediction accuracy. https://arxiv.org/abs//2506.11924 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] TreeRL: LLM Reinforcement Learning with On-Policy Tree Search 7:17
7:17 Play Later Play Later Lists Like Liked7:17
Play Later Play Later Lists Like LikedTreeRL is a novel reinforcement learning framework that integrates on-policy tree search, improving exploration and efficiency in reasoning tasks, outperforming traditional methods in benchmarks. https://arxiv.org/abs//2506.11902 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 TreeRL: LLM Reinforcement Learning with On-Policy Tree Search 19:00
19:00 Play Later Play Later Lists Like Liked19:00
Play Later Play Later Lists Like LikedTreeRL is a novel reinforcement learning framework that integrates on-policy tree search, improving exploration and efficiency in reasoning tasks, outperforming traditional methods in benchmarks. https://arxiv.org/abs//2506.11902 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Solving Inequality Proofs with Large Language Models 8:20
8:20 Play Later Play Later Lists Like Liked8:20
Play Later Play Later Lists Like LikedThe paper addresses challenges in inequality proving for LLMs, introducing the INEQMATH dataset and a novel evaluation framework, revealing significant gaps in reasoning accuracy among leading models. https://arxiv.org/abs//2506.07927 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Solving Inequality Proofs with Large Language Models 23:49
23:49 Play Later Play Later Lists Like Liked23:49
Play Later Play Later Lists Like LikedThe paper addresses challenges in inequality proving for LLMs, introducing the INEQMATH dataset and a novel evaluation framework, revealing significant gaps in reasoning accuracy among leading models. https://arxiv.org/abs//2506.07927 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Reinforcement Learning Teachers of Test Time Scaling 7:54
7:54 Play Later Play Later Lists Like Liked7:54
Play Later Play Later Lists Like LikedThe paper introduces Reinforcement-Learned Teachers (RLTs) that enhance distillation efficiency by providing detailed explanations, outperforming larger models in reasoning tasks without requiring extensive exploration. https://arxiv.org/abs//2506.08388 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Reinforcement Learning Teachers of Test Time Scaling 22:37
22:37 Play Later Play Later Lists Like Liked22:37
Play Later Play Later Lists Like LikedThe paper introduces Reinforcement-Learned Teachers (RLTs) that enhance distillation efficiency by providing detailed explanations, outperforming larger models in reasoning tasks without requiring extensive exploration. https://arxiv.org/abs//2506.08388 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Generalization or Hallucination? Understanding Out-of-Context Reasoning in Transformers 7:05
7:05 Play Later Play Later Lists Like Liked7:05
Play Later Play Later Lists Like LikedThis study explores out-of-context reasoning in large language models, linking generalization and hallucination to a single mechanism, and formalizes it as a synthetic factual recall task. https://arxiv.org/abs//2506.10887 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Generalization or Hallucination? Understanding Out-of-Context Reasoning in Transformers 18:28
18:28 Play Later Play Later Lists Like Liked18:28
Play Later Play Later Lists Like LikedThis study explores out-of-context reasoning in large language models, linking generalization and hallucination to a single mechanism, and formalizes it as a synthetic factual recall task. https://arxiv.org/abs//2506.10887 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Spurious Rewards: Rethinking Training Signals in RLVR 7:41
7:41 Play Later Play Later Lists Like Liked7:41
Play Later Play Later Lists Like LikedReinforcement learning with verifiable rewards (RLVR) enhances mathematical reasoning in Qwen2.5-Math, achieving notable performance improvements, but spurious rewards may not benefit other models like Llama3 or OLMo2. https://arxiv.org/abs//2506.10947 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Spurious Rewards: Rethinking Training Signals in RLVR 30:13
30:13 Play Later Play Later Lists Like Liked30:13
Play Later Play Later Lists Like LikedReinforcement learning with verifiable rewards (RLVR) enhances mathematical reasoning in Qwen2.5-Math, achieving notable performance improvements, but spurious rewards may not benefit other models like Llama3 or OLMo2. https://arxiv.org/abs//2506.10947 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Multiverse: Your Language Models Secretly Decide How to Parallelize and Merge Generation 8:08
8:08 Play Later Play Later Lists Like Liked8:08
Play Later Play Later Lists Like Likedhttps://arxiv.org/abs//2506.09991 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
A
Arxiv Papers
1 Multiverse: Your Language Models Secretly Decide How to Parallelize and Merge Generation 24:30
24:30 Play Later Play Later Lists Like Liked24:30
Play Later Play Later Lists Like Likedhttps://arxiv.org/abs//2506.09991 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
Reinforcement Pre-Training (RPT) enhances language models by using reinforcement learning for next-token prediction, improving accuracy and providing a strong foundation for further fine-tuning. https://arxiv.org/abs//2506.08007 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
Reinforcement Pre-Training (RPT) enhances language models by using reinforcement learning for next-token prediction, improving accuracy and providing a strong foundation for further fine-tuning. https://arxiv.org/abs//2506.08007 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
https://arxiv.org/abs//2506.06215 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
A
Arxiv Papers
https://arxiv.org/abs//2506.06215 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
A
Arxiv Papers
The paper presents UNDO, a method that enhances unlearning in LLMs through distillation, achieving robust capability removal with reduced compute and data requirements compared to traditional retraining methods. https://arxiv.org/abs//2506.06278 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
The paper presents UNDO, a method that enhances unlearning in LLMs through distillation, achieving robust capability removal with reduced compute and data requirements compared to traditional retraining methods. https://arxiv.org/abs//2506.06278 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
This paper introduces log-linear attention, enhancing linear attention's efficiency by using a logarithmically growing set of hidden states, improving sequence modeling while maintaining computational efficiency. https://arxiv.org/abs//2506.04761 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
This paper introduces log-linear attention, enhancing linear attention's efficiency by using a logarithmically growing set of hidden states, improving sequence modeling while maintaining computational efficiency. https://arxiv.org/abs//2506.04761 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Rewarding the Unlikely: Lifting GRPO Beyond Distribution Sharpening 7:45
7:45 Play Later Play Later Lists Like Liked7:45
Play Later Play Later Lists Like LikedThis paper critiques GRPO's bias in training language models for theorem proving and introduces the unlikeliness reward to enhance performance and sample diversity, achieving competitive results. https://arxiv.org/abs//2506.02355 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Rewarding the Unlikely: Lifting GRPO Beyond Distribution Sharpening 16:56
16:56 Play Later Play Later Lists Like Liked16:56
Play Later Play Later Lists Like LikedThis paper critiques GRPO's bias in training language models for theorem proving and introduces the unlikeliness reward to enhance performance and sample diversity, achieving competitive results. https://arxiv.org/abs//2506.02355 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
The Self-Challenging framework enables agents to generate and train on high-quality tasks autonomously, achieving significant performance improvements using self-generated data in tool-use benchmarks. https://arxiv.org/abs//2506.01716 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
The Self-Challenging framework enables agents to generate and train on high-quality tasks autonomously, achieving significant performance improvements using self-generated data in tool-use benchmarks. https://arxiv.org/abs//2506.01716 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Why Gradients Rapidly Increase Near the End of Training 7:00
7:00 Play Later Play Later Lists Like Liked7:00
Play Later Play Later Lists Like Likedhttps://arxiv.org/abs//2506.02285 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
A
Arxiv Papers
1 Why Gradients Rapidly Increase Near the End of Training 11:24
11:24 Play Later Play Later Lists Like Liked11:24
Play Later Play Later Lists Like Likedhttps://arxiv.org/abs//2506.02285 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
A
Arxiv Papers
1 [QA] GEM: Empowering LLM for both Embedding Generation and Language Understanding 7:41
7:41 Play Later Play Later Lists Like Liked7:41
Play Later Play Later Lists Like LikedThe paper introduces GEM, a self-supervised method enabling decoder-only LLMs to generate high-quality text embeddings, enhancing performance on embedding benchmarks while preserving original text generation capabilities. https://arxiv.org/abs//2506.04344 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 GEM: Empowering LLM for both Embedding Generation and Language Understanding 20:38
20:38 Play Later Play Later Lists Like Liked20:38
Play Later Play Later Lists Like LikedThe paper introduces GEM, a self-supervised method enabling decoder-only LLMs to generate high-quality text embeddings, enhancing performance on embedding benchmarks while preserving original text generation capabilities. https://arxiv.org/abs//2506.04344 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] HYPERSTEER: Activation Steering at Scale with Hypernetworks 7:49
7:49 Play Later Play Later Lists Like Liked7:49
Play Later Play Later Lists Like LikedHYPERSTEER introduces hypernetwork architectures for generating effective steering vectors in language models, outperforming existing methods and achieving strong performance on unseen prompts. Code available at GitHub. https://arxiv.org/abs//2506.03292 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 HYPERSTEER: Activation Steering at Scale with Hypernetworks 9:15
9:15 Play Later Play Later Lists Like Liked9:15
Play Later Play Later Lists Like LikedHYPERSTEER introduces hypernetwork architectures for generating effective steering vectors in language models, outperforming existing methods and achieving strong performance on unseen prompts. Code available at GitHub. https://arxiv.org/abs//2506.03292 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
The OpenThoughts project creates open-source datasets for reasoning models, achieving state-of-the-art results with OpenThinker3-7B, trained on 1.2M examples, available at openthoughts.ai. https://arxiv.org/abs//2506.04178 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
The OpenThoughts project creates open-source datasets for reasoning models, achieving state-of-the-art results with OpenThinker3-7B, trained on 1.2M examples, available at openthoughts.ai. https://arxiv.org/abs//2506.04178 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Accelerating Diffusion LLMs via Adaptive Parallel Decoding 8:08
8:08 Play Later Play Later Lists Like Liked8:08
Play Later Play Later Lists Like LikedThe paper introduces adaptive parallel decoding (APD), enhancing diffusion large language models' speed by dynamically adjusting token sampling, improving throughput while maintaining quality compared to autoregressive models. https://arxiv.org/abs//2506.00413 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Accelerating Diffusion LLMs via Adaptive Parallel Decoding 21:09
21:09 Play Later Play Later Lists Like Liked21:09
Play Later Play Later Lists Like LikedThe paper introduces adaptive parallel decoding (APD), enhancing diffusion large language models' speed by dynamically adjusting token sampling, improving throughput while maintaining quality compared to autoregressive models. https://arxiv.org/abs//2506.00413 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Reflect, Retry, Reward: Self-Improving LLMs via Reinforcement Learning 7:34
7:34 Play Later Play Later Lists Like Liked7:34
Play Later Play Later Lists Like LikedThis paper presents a self-reflection and reinforcement learning method that enhances large language models' performance on complex tasks, achieving significant improvements even with limited feedback. https://arxiv.org/abs//2505.24726 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Reflect, Retry, Reward: Self-Improving LLMs via Reinforcement Learning 16:44
16:44 Play Later Play Later Lists Like Liked16:44
Play Later Play Later Lists Like LikedThis paper presents a self-reflection and reinforcement learning method that enhances large language models' performance on complex tasks, achieving significant improvements even with limited feedback. https://arxiv.org/abs//2505.24726 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
Eso-LMs combine autoregressive and masked diffusion models, improving perplexity and inference efficiency with KV caching, achieving state-of-the-art performance and significantly faster inference rates. Code and checkpoints available online. https://arxiv.org/abs//2506.01928 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
Eso-LMs combine autoregressive and masked diffusion models, improving perplexity and inference efficiency with KV caching, achieving state-of-the-art performance and significantly faster inference rates. Code and checkpoints available online. https://arxiv.org/abs//2506.01928 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Beyond the 80/20 Rule: High-Entropy Minority Tokens Drive Effective Reinforcement Learning for LLM Reasoning 8:08
8:08 Play Later Play Later Lists Like Liked8:08
Play Later Play Later Lists Like LikedThis study explores Reinforcement Learning with Verifiable Rewards (RLVR) through token entropy patterns, revealing that high-entropy tokens significantly enhance reasoning performance in Large Language Models. https://arxiv.org/abs//2506.01939 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Beyond the 80/20 Rule: High-Entropy Minority Tokens Drive Effective Reinforcement Learning for LLM Reasoning 23:02
23:02 Play Later Play Later Lists Like Liked23:02
Play Later Play Later Lists Like LikedThis study explores Reinforcement Learning with Verifiable Rewards (RLVR) through token entropy patterns, revealing that high-entropy tokens significantly enhance reasoning performance in Large Language Models. https://arxiv.org/abs//2506.01939 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.
Daily Deals
Daily Deals
Similar to Arxiv Papers
Flash Forward is a show about possible (and not so possible) future scenarios. What would the warranty on a sex robot look like? How would diplomacy work if we couldn’t lie? Could there ever be a fecal transplant black market? (Complicated, it wouldn’t, and yes, respectively, in case you’re curious.) Hosted and produced by award winning science journalist Rose Eveleth, each episode combines audio drama and journalism to go deep on potential tomorrows, and uncovers what those futures might re ...
…
continue reading
Come dive into one of the curiously delightful conversations overheard at National Geographic’s headquarters, as we follow explorers, photographers, and scientists to the edges of our big, weird, beautiful world. Hosted by Peter Gwin and Amy Briggs.
…
continue reading
DNA science. Artificial intelligence. Smartphones and 3D printers. Science and technology have transformed the world we live in. But how did we get here? It wasn’t by accident. Well, sometimes it was. It was also the result of hard work, teamwork, and competition. And incredibly surprising moments. Hosted by bestselling author Steven Johnson (“How We Got To Now”), American Innovations uses immersive scenes to tell the stories of the scientists, engineers, and ordinary people behind the great ...
…
continue reading
The Skeptics' Guide to the Universe is a weekly science podcast discussing the latest science news, critical thinking, bad science, conspiracies and controversies. -The Skeptics' Guide to the Universe: Your escape to reality - Produced by SGU Productions, LLC: https://www.theskepticsguide.org
…
continue reading
Welcome to Curiosity Weekly from Discovery, hosted by Dr. Samantha Yammine. Once a week, we’ll bring you the latest and greatest in scientific discoveries and break down the details so that you don’t need a PhD to understand it. From neuroscience to climate tech to AI and genetics, no subject is off-limits. Join Sam as she interviews expert guests and investigates the research guiding some of the most exciting scientific breakthroughs affecting our world today. Hosted on Acast. See acast.com ...
…
continue reading
We humans could have a bright future ahead of us that lasts billions of years. But we have to survive the next 200 years first. Join Josh Clark of Stuff You Should Know for a 10-episode deep dive that explores the future of humanity and finds dangers we have never encountered before lurking just ahead. And if we humans are alone in the universe, if we don't survive intelligent life dies out with us too.
…
continue reading
The kickass science and technology radio show that delivers an irreverent look at the week in science and technology.
…
continue reading
Whether the topic is popcorn or particle physics, you can count on BrainStuff to explore -- and explain -- the everyday science in the world around us.
…
continue reading
Science Friction's latest series is: Brain Rot. We're looking at what being chronically online is doing to our brains. What's really going on with our attention spans and tech addiction? Is data-dumping your entire life into ChatGPT helpful? Can going internet free help you escape the doomscroll? And what's it like to be in love ... with an AI? National technology reporter Ange Lavoipierre tackles the wildest ways people are using tech and the big questions about our own use. That's Brain Ro ...
…
continue reading
Join Dr Karl Kruszelnicki, Lucy Smith and their scientific guests, with a bunch of curious triple j listeners for a weekly injection of science, myth-bashing and answers!
…
continue reading
Player FM - Podcast App
Go offline with the Player FM app!
Go offline with the Player FM app!
