Flash Forward is a show about possible (and not so possible) future scenarios. What would the warranty on a sex robot look like? How would diplomacy work if we couldn’t lie? Could there ever be a fecal transplant black market? (Complicated, it wouldn’t, and yes, respectively, in case you’re curious.) Hosted and produced by award winning science journalist Rose Eveleth, each episode combines audio drama and journalism to go deep on potential tomorrows, and uncovers what those futures might re ...
…
continue reading
Player FM - Internet Radio Done Right
Checked 2h ago
Added two years ago
Content provided by Igor Melnyk. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Igor Melnyk or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.
Similar to Arxiv Papers
Come dive into one of the curiously delightful conversations overheard at National Geographic’s headquarters, as we follow explorers, photographers, and scientists to the edges of our big, weird, beautiful world. Hosted by Peter Gwin and Amy Briggs.
…
continue reading
DNA science. Artificial intelligence. Smartphones and 3D printers. Science and technology have transformed the world we live in. But how did we get here? It wasn’t by accident. Well, sometimes it was. It was also the result of hard work, teamwork, and competition. And incredibly surprising moments. Hosted by bestselling author Steven Johnson (“How We Got To Now”), American Innovations uses immersive scenes to tell the stories of the scientists, engineers, and ordinary people behind the great ...
…
continue reading
Unseeable forces control human behavior and shape our ideas, beliefs, and assumptions. Invisibilia—Latin for invisible things—fuses narrative storytelling with science that will make you see your own life differently.
…
continue reading
Science Friction's latest series is: Brain Rot. We're looking at what being chronically online is doing to our brains. What's really going on with our attention spans and tech addiction? Is data-dumping your entire life into ChatGPT helpful? Can going internet free help you escape the doomscroll? And what's it like to be in love ... with an AI? National technology reporter Ange Lavoipierre tackles the wildest ways people are using tech and the big questions about our own use. That's Brain Ro ...
…
continue reading
We humans could have a bright future ahead of us that lasts billions of years. But we have to survive the next 200 years first. Join Josh Clark of Stuff You Should Know for a 10-episode deep dive that explores the future of humanity and finds dangers we have never encountered before lurking just ahead. And if we humans are alone in the universe, if we don't survive intelligent life dies out with us too.
…
continue reading
Join Dr Karl Kruszelnicki, Lucy Smith and their scientific guests, with a bunch of curious triple j listeners for a weekly injection of science, myth-bashing and answers!
…
continue reading
Interviews with Anthropologists about their New Books Support our show by becoming a premium member! https://newbooksnetwork.supportingcast.fm/anthropology
…
continue reading
Welcome to Curiosity Weekly from Discovery, hosted by Dr. Samantha Yammine. Once a week, we’ll bring you the latest and greatest in scientific discoveries and break down the details so that you don’t need a PhD to understand it. From neuroscience to climate tech to AI and genetics, no subject is off-limits. Join Sam as she interviews expert guests and investigates the research guiding some of the most exciting scientific breakthroughs affecting our world today. Hosted on Acast. See acast.com ...
…
continue reading
The Skeptics' Guide to the Universe is a weekly science podcast discussing the latest science news, critical thinking, bad science, conspiracies and controversies. -The Skeptics' Guide to the Universe: Your escape to reality - Produced by SGU Productions, LLC: https://www.theskepticsguide.org
…
continue reading
Player FM - Podcast App
Go offline with the Player FM app!
Go offline with the Player FM app!
))
Daily Deals
Podcasts Worth a Listen
SPONSORED
T
The Big Pitch with Jimmy Carr
1 Phil Wang Pitches Psychological Thriller Starring WHO?! 24:35
24:35 
Play Later 
Play Later 
Lists 
Like 
Liked24:35
Play Later
Play Later
Lists
Like
LikedIt’s the very first episode of The Big Pitch with Jimmy Carr and our first guest is Phil Wang! And Phil’s subgenre is…This Place is Evil. We’re talking psychological torture, we’re talking gory death scenes, we’re talking Lorraine Kelly?! The Big Pitch with Jimmy Carr is a brand new comedy podcast where each week a different celebrity guest pitches an idea for a film based on one of the SUPER niche sub-genres on Netflix. From ‘Steamy Crime Movies from the 1970s’ to ‘Australian Dysfunctional Family Comedies Starring A Strong Female Lead’, our celebrity guests will pitch their wacky plot, their dream cast, the marketing stunts, and everything in between. By the end of every episode, Jimmy Carr, Comedian by night / “Netflix Executive” by day, will decide whether the pitch is greenlit or condemned to development hell! Listen on all podcast platforms and watch on the Netflix Is A Joke YouTube Channel . The Big Pitch is a co-production by Netflix and BBC Studios Audio. Jimmy Carr is an award-winning stand-up comedian and writer, touring his brand-new show JIMMY CARR: LAUGHS FUNNY throughout the USA from May to November this year, as well as across the UK and Europe, before hitting Australia and New Zealand in early 2026. All info and tickets for the tour are available at JIMMYCARR.COM Production Coordinator: Becky Carewe-Jeffries Production Manager: Mabel Finnegan-Wright Editor: Stuart Reid Producer: Pete Strauss Executive Producer: Richard Morris Executive Producers for Netflix: Kathryn Huyghue, Erica Brady, and David Markowitz Set Design: Helen Coyston Studios: Tower Bridge Studios Make Up: Samantha Coughlan Cameras: Daniel Spencer Sound: Charlie Emery Branding: Tim Lane Photography: James Hole…
Practical Efficiency of Muon for Pretraining
Manage episode 480828231 series 3524393
Content provided by Igor Melnyk. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Igor Melnyk or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.
Muon outperforms AdamW in expanding the Pareto frontier for compute-time tradeoff, enhancing data efficiency at large batch sizes while enabling economical training through effective hyperparameter transfer.
https://arxiv.org/abs//2505.02222
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
2313 episodes
ShareManage episode 480828231 series 3524393
Content provided by Igor Melnyk. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Igor Melnyk or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.
Muon outperforms AdamW in expanding the Pareto frontier for compute-time tradeoff, enhancing data efficiency at large batch sizes while enabling economical training through effective hyperparameter transfer.
https://arxiv.org/abs//2505.02222
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
2313 episodes
All episodes
×
This paper introduces log-linear attention, enhancing linear attention's efficiency by using a logarithmically growing set of hidden states, improving sequence modeling while maintaining computational efficiency. https://arxiv.org/abs//2506.04761 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
This paper introduces log-linear attention, enhancing linear attention's efficiency by using a logarithmically growing set of hidden states, improving sequence modeling while maintaining computational efficiency. https://arxiv.org/abs//2506.04761 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Rewarding the Unlikely: Lifting GRPO Beyond Distribution Sharpening 7:45
7:45 Play Later Play Later Lists Like Liked7:45
Play Later Play Later Lists Like LikedThis paper critiques GRPO's bias in training language models for theorem proving and introduces the unlikeliness reward to enhance performance and sample diversity, achieving competitive results. https://arxiv.org/abs//2506.02355 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Rewarding the Unlikely: Lifting GRPO Beyond Distribution Sharpening 16:56
16:56 Play Later Play Later Lists Like Liked16:56
Play Later Play Later Lists Like LikedThis paper critiques GRPO's bias in training language models for theorem proving and introduces the unlikeliness reward to enhance performance and sample diversity, achieving competitive results. https://arxiv.org/abs//2506.02355 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
The Self-Challenging framework enables agents to generate and train on high-quality tasks autonomously, achieving significant performance improvements using self-generated data in tool-use benchmarks. https://arxiv.org/abs//2506.01716 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
The Self-Challenging framework enables agents to generate and train on high-quality tasks autonomously, achieving significant performance improvements using self-generated data in tool-use benchmarks. https://arxiv.org/abs//2506.01716 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Why Gradients Rapidly Increase Near the End of Training 7:00
7:00 Play Later Play Later Lists Like Liked7:00
Play Later Play Later Lists Like Likedhttps://arxiv.org/abs//2506.02285 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
A
Arxiv Papers
1 Why Gradients Rapidly Increase Near the End of Training 11:24
11:24 Play Later Play Later Lists Like Liked11:24
Play Later Play Later Lists Like Likedhttps://arxiv.org/abs//2506.02285 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
A
Arxiv Papers
1 [QA] GEM: Empowering LLM for both Embedding Generation and Language Understanding 7:41
7:41 Play Later Play Later Lists Like Liked7:41
Play Later Play Later Lists Like LikedThe paper introduces GEM, a self-supervised method enabling decoder-only LLMs to generate high-quality text embeddings, enhancing performance on embedding benchmarks while preserving original text generation capabilities. https://arxiv.org/abs//2506.04344 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 GEM: Empowering LLM for both Embedding Generation and Language Understanding 20:38
20:38 Play Later Play Later Lists Like Liked20:38
Play Later Play Later Lists Like LikedThe paper introduces GEM, a self-supervised method enabling decoder-only LLMs to generate high-quality text embeddings, enhancing performance on embedding benchmarks while preserving original text generation capabilities. https://arxiv.org/abs//2506.04344 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] HYPERSTEER: Activation Steering at Scale with Hypernetworks 7:49
7:49 Play Later Play Later Lists Like Liked7:49
Play Later Play Later Lists Like LikedHYPERSTEER introduces hypernetwork architectures for generating effective steering vectors in language models, outperforming existing methods and achieving strong performance on unseen prompts. Code available at GitHub. https://arxiv.org/abs//2506.03292 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 HYPERSTEER: Activation Steering at Scale with Hypernetworks 9:15
9:15 Play Later Play Later Lists Like Liked9:15
Play Later Play Later Lists Like LikedHYPERSTEER introduces hypernetwork architectures for generating effective steering vectors in language models, outperforming existing methods and achieving strong performance on unseen prompts. Code available at GitHub. https://arxiv.org/abs//2506.03292 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
The OpenThoughts project creates open-source datasets for reasoning models, achieving state-of-the-art results with OpenThinker3-7B, trained on 1.2M examples, available at openthoughts.ai. https://arxiv.org/abs//2506.04178 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
The OpenThoughts project creates open-source datasets for reasoning models, achieving state-of-the-art results with OpenThinker3-7B, trained on 1.2M examples, available at openthoughts.ai. https://arxiv.org/abs//2506.04178 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Accelerating Diffusion LLMs via Adaptive Parallel Decoding 8:08
8:08 Play Later Play Later Lists Like Liked8:08
Play Later Play Later Lists Like LikedThe paper introduces adaptive parallel decoding (APD), enhancing diffusion large language models' speed by dynamically adjusting token sampling, improving throughput while maintaining quality compared to autoregressive models. https://arxiv.org/abs//2506.00413 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Accelerating Diffusion LLMs via Adaptive Parallel Decoding 21:09
21:09 Play Later Play Later Lists Like Liked21:09
Play Later Play Later Lists Like LikedThe paper introduces adaptive parallel decoding (APD), enhancing diffusion large language models' speed by dynamically adjusting token sampling, improving throughput while maintaining quality compared to autoregressive models. https://arxiv.org/abs//2506.00413 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Reflect, Retry, Reward: Self-Improving LLMs via Reinforcement Learning 7:34
7:34 Play Later Play Later Lists Like Liked7:34
Play Later Play Later Lists Like LikedThis paper presents a self-reflection and reinforcement learning method that enhances large language models' performance on complex tasks, achieving significant improvements even with limited feedback. https://arxiv.org/abs//2505.24726 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Reflect, Retry, Reward: Self-Improving LLMs via Reinforcement Learning 16:44
16:44 Play Later Play Later Lists Like Liked16:44
Play Later Play Later Lists Like LikedThis paper presents a self-reflection and reinforcement learning method that enhances large language models' performance on complex tasks, achieving significant improvements even with limited feedback. https://arxiv.org/abs//2505.24726 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
Eso-LMs combine autoregressive and masked diffusion models, improving perplexity and inference efficiency with KV caching, achieving state-of-the-art performance and significantly faster inference rates. Code and checkpoints available online. https://arxiv.org/abs//2506.01928 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
Eso-LMs combine autoregressive and masked diffusion models, improving perplexity and inference efficiency with KV caching, achieving state-of-the-art performance and significantly faster inference rates. Code and checkpoints available online. https://arxiv.org/abs//2506.01928 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Beyond the 80/20 Rule: High-Entropy Minority Tokens Drive Effective Reinforcement Learning for LLM Reasoning 8:08
8:08 Play Later Play Later Lists Like Liked8:08
Play Later Play Later Lists Like LikedThis study explores Reinforcement Learning with Verifiable Rewards (RLVR) through token entropy patterns, revealing that high-entropy tokens significantly enhance reasoning performance in Large Language Models. https://arxiv.org/abs//2506.01939 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Beyond the 80/20 Rule: High-Entropy Minority Tokens Drive Effective Reinforcement Learning for LLM Reasoning 23:02
23:02 Play Later Play Later Lists Like Liked23:02
Play Later Play Later Lists Like LikedThis study explores Reinforcement Learning with Verifiable Rewards (RLVR) through token entropy patterns, revealing that high-entropy tokens significantly enhance reasoning performance in Large Language Models. https://arxiv.org/abs//2506.01939 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] ALPHAONE: Reasoning Models Thinking Slow and Fast at Test Time 7:21
7:21 Play Later Play Later Lists Like Liked7:21
Play Later Play Later Lists Like LikedALPHAONE is a framework that enhances reasoning in large models by dynamically modulating thinking phases, improving efficiency and performance across various challenging benchmarks. https://arxiv.org/abs//2505.24863 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 ALPHAONE: Reasoning Models Thinking Slow and Fast at Test Time 17:12
17:12 Play Later Play Later Lists Like Liked17:12
Play Later Play Later Lists Like LikedALPHAONE is a framework that enhances reasoning in large models by dynamically modulating thinking phases, improving efficiency and performance across various challenging benchmarks. https://arxiv.org/abs//2505.24863 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] ProRL: Prolonged Reinforcement Learning Expands Reasoning Boundaries in Large Language Models 7:40
7:40 Play Later Play Later Lists Like Liked7:40
Play Later Play Later Lists Like LikedThis paper introduces ProRL, a training method that enhances reasoning in language models through reinforcement learning, revealing novel strategies and outperforming base models in various evaluations. https://arxiv.org/abs//2505.24864 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 ProRL: Prolonged Reinforcement Learning Expands Reasoning Boundaries in Large Language Models 23:32
23:32 Play Later Play Later Lists Like Liked23:32
Play Later Play Later Lists Like LikedThis paper introduces ProRL, a training method that enhances reasoning in language models through reinforcement learning, revealing novel strategies and outperforming base models in various evaluations. https://arxiv.org/abs//2505.24864 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Are Reasoning Models More Prone to Hallucination? 7:52
7:52 Play Later Play Later Lists Like Liked7:52
Play Later Play Later Lists Like LikedThis paper investigates hallucination in large reasoning models, analyzing post-training effects, cognitive behaviors, and model uncertainty, revealing insights into their impact on factual accuracy. https://arxiv.org/abs//2505.23646 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Are Reasoning Models More Prone to Hallucination? 20:24
20:24 Play Later Play Later Lists Like Liked20:24
Play Later Play Later Lists Like LikedThis paper investigates hallucination in large reasoning models, analyzing post-training effects, cognitive behaviors, and model uncertainty, revealing insights into their impact on factual accuracy. https://arxiv.org/abs//2505.23646 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] How does Transformer Learn Implicit Reasoning? 8:56
8:56 Play Later Play Later Lists Like Liked8:56
Play Later Play Later Lists Like LikedThis paper explores implicit multi-hop reasoning in large language models, revealing a developmental trajectory and introducing diagnostic tools to enhance interpretability and understanding of reasoning processes. https://arxiv.org/abs//2505.23653 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 How does Transformer Learn Implicit Reasoning? 23:21
23:21 Play Later Play Later Lists Like Liked23:21
Play Later Play Later Lists Like LikedThis paper explores implicit multi-hop reasoning in large language models, revealing a developmental trajectory and introducing diagnostic tools to enhance interpretability and understanding of reasoning processes. https://arxiv.org/abs//2505.23653 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Let Me Think! A Long Chain-of-Thought Can Be Worth Exponentially Many Short Ones 7:26
7:26 Play Later Play Later Lists Like Liked7:26
Play Later Play Later Lists Like LikedThis paper explores optimal inference-time computation for large language models, revealing scenarios where sequential scaling significantly outperforms parallel scaling, particularly in graph connectivity problems. https://arxiv.org/abs//2505.21825 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Let Me Think! A Long Chain-of-Thought Can Be Worth Exponentially Many Short Ones 24:00
24:00 Play Later Play Later Lists Like Liked24:00
Play Later Play Later Lists Like LikedThis paper explores optimal inference-time computation for large language models, revealing scenarios where sequential scaling significantly outperforms parallel scaling, particularly in graph connectivity problems. https://arxiv.org/abs//2505.21825 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Maximizing Confidence Alone Improves Reasoning 7:08
7:08 Play Later Play Later Lists Like Liked7:08
Play Later Play Later Lists Like LikedThe paper introduces RENT, an unsupervised reinforcement learning method using entropy minimization as intrinsic reward, enhancing reasoning abilities in language models without external supervision across various benchmarks. https://arxiv.org/abs//2505.22660 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Maximizing Confidence Alone Improves Reasoning 13:21
13:21 Play Later Play Later Lists Like Liked13:21
Play Later Play Later Lists Like LikedThe paper introduces RENT, an unsupervised reinforcement learning method using entropy minimization as intrinsic reward, enhancing reasoning abilities in language models without external supervision across various benchmarks. https://arxiv.org/abs//2505.22660 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Hardware-Efficient Attention for Fast Decoding 7:57
7:57 Play Later Play Later Lists Like Liked7:57
Play Later Play Later Lists Like LikedThis paper presents Grouped-Tied Attention and Grouped Latent Attention to enhance LLM decoding efficiency, reducing memory transfers and latency while maintaining model quality and improving throughput. https://arxiv.org/abs//2505.21487 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Hardware-Efficient Attention for Fast Decoding 30:59
30:59 Play Later Play Later Lists Like Liked30:59
Play Later Play Later Lists Like LikedThis paper presents Grouped-Tied Attention and Grouped Latent Attention to enhance LLM decoding efficiency, reducing memory transfers and latency while maintaining model quality and improving throughput. https://arxiv.org/abs//2505.21487 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Reinforcing General Reasoning without Verifiers 7:08
7:08 Play Later Play Later Lists Like Liked7:08
Play Later Play Later Lists Like LikedThe paper introduces VeriFree, a verifier-free reinforcement learning method that enhances large language models' reasoning capabilities, outperforming verifier-based methods while reducing computational demands. https://arxiv.org/abs//2505.21493 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Reinforcing General Reasoning without Verifiers 17:11
17:11 Play Later Play Later Lists Like Liked17:11
Play Later Play Later Lists Like LikedThe paper introduces VeriFree, a verifier-free reinforcement learning method that enhances large language models' reasoning capabilities, outperforming verifier-based methods while reducing computational demands. https://arxiv.org/abs//2505.21493 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] ENIGMATA: Scaling Logical Reasoning in Large Language Models with Synthetic Verifiable Puzzles 8:16
8:16 Play Later Play Later Lists Like Liked8:16
Play Later Play Later Lists Like Likedhttps://arxiv.org/abs//2505.19914 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
A
Arxiv Papers
1 ENIGMATA: Scaling Logical Reasoning in Large Language Models with Synthetic Verifiable Puzzles 23:54
23:54 Play Later Play Later Lists Like Liked23:54
Play Later Play Later Lists Like Likedhttps://arxiv.org/abs//2505.19914 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
A
Arxiv Papers
1 [QA] Temporal Sampling for Forgotten Reasoning in LLMs 7:04
7:04 Play Later Play Later Lists Like Liked7:04
Play Later Play Later Lists Like LikedThe paper introduces "Temporal Forgetting," where LLMs lose previously learned problem-solving skills, and proposes "Temporal Sampling" to recover these abilities, enhancing reasoning performance without retraining. https://arxiv.org/abs//2505.20196 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Temporal Sampling for Forgotten Reasoning in LLMs 10:43
10:43 Play Later Play Later Lists Like Liked10:43
Play Later Play Later Lists Like LikedThe paper introduces "Temporal Forgetting," where LLMs lose previously learned problem-solving skills, and proposes "Temporal Sampling" to recover these abilities, enhancing reasoning performance without retraining. https://arxiv.org/abs//2505.20196 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Are Large Language Models Reliable AI Scientists? Assessing Reverse-Engineering of Black-Box Systems 10:15
10:15 Play Later Play Later Lists Like Liked10:15
Play Later Play Later Lists Like LikedThis paper examines how large language models (LLMs) can better identify black-box functions through active data collection, improving their reverse-engineering capabilities and aiding scientific discovery. https://arxiv.org/abs//2505.17968 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Are Large Language Models Reliable AI Scientists? Assessing Reverse-Engineering of Black-Box Systems 17:21
17:21 Play Later Play Later Lists Like Liked17:21
Play Later Play Later Lists Like LikedThis paper examines how large language models (LLMs) can better identify black-box functions through active data collection, improving their reverse-engineering capabilities and aiding scientific discovery. https://arxiv.org/abs//2505.17968 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
The paper introduces generative distribution embeddings (GDE), a framework for learning representations of distributions, demonstrating superior performance in various computational biology applications. https://arxiv.org/abs//2505.18150 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.
Daily Deals
Similar to Arxiv Papers
Flash Forward is a show about possible (and not so possible) future scenarios. What would the warranty on a sex robot look like? How would diplomacy work if we couldn’t lie? Could there ever be a fecal transplant black market? (Complicated, it wouldn’t, and yes, respectively, in case you’re curious.) Hosted and produced by award winning science journalist Rose Eveleth, each episode combines audio drama and journalism to go deep on potential tomorrows, and uncovers what those futures might re ...
…
continue reading
Come dive into one of the curiously delightful conversations overheard at National Geographic’s headquarters, as we follow explorers, photographers, and scientists to the edges of our big, weird, beautiful world. Hosted by Peter Gwin and Amy Briggs.
…
continue reading
DNA science. Artificial intelligence. Smartphones and 3D printers. Science and technology have transformed the world we live in. But how did we get here? It wasn’t by accident. Well, sometimes it was. It was also the result of hard work, teamwork, and competition. And incredibly surprising moments. Hosted by bestselling author Steven Johnson (“How We Got To Now”), American Innovations uses immersive scenes to tell the stories of the scientists, engineers, and ordinary people behind the great ...
…
continue reading
Unseeable forces control human behavior and shape our ideas, beliefs, and assumptions. Invisibilia—Latin for invisible things—fuses narrative storytelling with science that will make you see your own life differently.
…
continue reading
Science Friction's latest series is: Brain Rot. We're looking at what being chronically online is doing to our brains. What's really going on with our attention spans and tech addiction? Is data-dumping your entire life into ChatGPT helpful? Can going internet free help you escape the doomscroll? And what's it like to be in love ... with an AI? National technology reporter Ange Lavoipierre tackles the wildest ways people are using tech and the big questions about our own use. That's Brain Ro ...
…
continue reading
We humans could have a bright future ahead of us that lasts billions of years. But we have to survive the next 200 years first. Join Josh Clark of Stuff You Should Know for a 10-episode deep dive that explores the future of humanity and finds dangers we have never encountered before lurking just ahead. And if we humans are alone in the universe, if we don't survive intelligent life dies out with us too.
…
continue reading
Join Dr Karl Kruszelnicki, Lucy Smith and their scientific guests, with a bunch of curious triple j listeners for a weekly injection of science, myth-bashing and answers!
…
continue reading
Interviews with Anthropologists about their New Books Support our show by becoming a premium member! https://newbooksnetwork.supportingcast.fm/anthropology
…
continue reading
Welcome to Curiosity Weekly from Discovery, hosted by Dr. Samantha Yammine. Once a week, we’ll bring you the latest and greatest in scientific discoveries and break down the details so that you don’t need a PhD to understand it. From neuroscience to climate tech to AI and genetics, no subject is off-limits. Join Sam as she interviews expert guests and investigates the research guiding some of the most exciting scientific breakthroughs affecting our world today. Hosted on Acast. See acast.com ...
…
continue reading
The Skeptics' Guide to the Universe is a weekly science podcast discussing the latest science news, critical thinking, bad science, conspiracies and controversies. -The Skeptics' Guide to the Universe: Your escape to reality - Produced by SGU Productions, LLC: https://www.theskepticsguide.org
…
continue reading
Player FM - Podcast App
Go offline with the Player FM app!
Go offline with the Player FM app!
