Flash Forward is a show about possible (and not so possible) future scenarios. What would the warranty on a sex robot look like? How would diplomacy work if we couldn’t lie? Could there ever be a fecal transplant black market? (Complicated, it wouldn’t, and yes, respectively, in case you’re curious.) Hosted and produced by award winning science journalist Rose Eveleth, each episode combines audio drama and journalism to go deep on potential tomorrows, and uncovers what those futures might re ...
…
continue reading
Content provided by Igor Melnyk. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Igor Melnyk or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.
Similar to Arxiv Papers
Come dive into one of the curiously delightful conversations overheard at National Geographic’s headquarters, as we follow explorers, photographers, and scientists to the edges of our big, weird, beautiful world. Hosted by Peter Gwin and Amy Briggs.
…
continue reading
Unseeable forces control human behavior and shape our ideas, beliefs, and assumptions. Invisibilia—Latin for invisible things—fuses narrative storytelling with science that will make you see your own life differently.
…
continue reading
Science Friction's latest series is: Cooked. We dig into food science pickles. Why are studies showing that ice cream could be good for you? Do we really need as many electrolytes as the internet says? And why are people feeling good on the carnivore diet? Nutrition and food scientist Dr Emma Beckett takes us through what the evidence says about foods like meat, ice cream and potatoes — and unpicks why nutrition studies can be so conflicting and confusing. All six episodes of Cooked are avai ...
…
continue reading
DNA science. Artificial intelligence. Smartphones and 3D printers. Science and technology have transformed the world we live in. But how did we get here? It wasn’t by accident. Well, sometimes it was. It was also the result of hard work, teamwork, and competition. And incredibly surprising moments. Hosted by bestselling author Steven Johnson (“How We Got To Now”), American Innovations uses immersive scenes to tell the stories of the scientists, engineers, and ordinary people behind the great ...
…
continue reading
We humans could have a bright future ahead of us that lasts billions of years. But we have to survive the next 200 years first. Join Josh Clark of Stuff You Should Know for a 10-episode deep dive that explores the future of humanity and finds dangers we have never encountered before lurking just ahead. And if we humans are alone in the universe, if we don't survive intelligent life dies out with us too.
…
continue reading
Professor Jim Al-Khalili talks to leading scientists about their life and work, finding out what inspires and motivates them and asking what their discoveries might do for us in the future
…
continue reading
Join Dr Karl Kruszelnicki, Lucy Smith and their scientific guests, with a bunch of curious triple j listeners for a weekly injection of science, myth-bashing and answers!
…
continue reading
Interviews with Anthropologists about their New Books Support our show by becoming a premium member! https://newbooksnetwork.supportingcast.fm/anthropology
…
continue reading
Welcome to Curiosity Weekly from Discovery, hosted by Dr. Samantha Yammine. Once a week, we’ll bring you the latest and greatest in scientific discoveries and break down the details so that you don’t need a PhD to understand it. From neuroscience to climate tech to AI and genetics, no subject is off-limits. Join Sam as she interviews expert guests and investigates the research guiding some of the most exciting scientific breakthroughs affecting our world today. Hosted on Acast. See acast.com ...
…
continue reading
Player FM - Podcast App
Go offline with the Player FM app!
Go offline with the Player FM app!
))
Daily Deals
Activated LoRA: Fine-tuned LLMs for Intrinsics
Manage episode 477636509 series 3524393
Content provided by Igor Melnyk. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Igor Melnyk or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.
Activated LoRA (aLoRA) enhances LoRA by adapting weights only for relevant tokens, allowing instant activation without recomputing the KV cache, improving efficiency in multiturn settings.
https://arxiv.org/abs//2504.12397
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
2255 episodes
Share
Manage episode 477636509 series 3524393
Content provided by Igor Melnyk. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Igor Melnyk or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.
Activated LoRA (aLoRA) enhances LoRA by adapting weights only for relevant tokens, allowing instant activation without recomputing the KV cache, improving efficiency in multiturn settings.
https://arxiv.org/abs//2504.12397
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
2255 episodes
All episodes
×
A
Arxiv Papers
This paper presents Set-LLM, an architectural adaptation for large language models that ensures permutation invariance, addressing order sensitivity and improving performance in various applications. https://arxiv.org/abs//2505.15433 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
This paper presents Set-LLM, an architectural adaptation for large language models that ensures permutation invariance, addressing order sensitivity and improving performance in various applications. https://arxiv.org/abs//2505.15433 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] On the creation of narrow AI: hierarchy and nonlocality of neural network skills 7:21
7:21 
Play Later 
Play Later 
Lists 
Like 
Liked7:21
Play Later Play Later Lists Like LikedThis paper explores creating efficient narrow AI systems, addressing challenges in training from scratch and skill transfer from large models, highlighting pruning methods and regularization for improved performance. https://arxiv.org/abs//2505.15811 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 On the creation of narrow AI: hierarchy and nonlocality of neural network skills 18:01
18:01 Play Later Play Later Lists Like Liked18:01
Play Later Play Later Lists Like LikedThis paper explores creating efficient narrow AI systems, addressing challenges in training from scratch and skill transfer from large models, highlighting pruning methods and regularization for improved performance. https://arxiv.org/abs//2505.15811 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Do Language Models Use Their Depth Efficiently? 7:25
7:25 Play Later Play Later Lists Like Liked7:25
Play Later Play Later Lists Like LikedThe study analyzes Llama 3.1 and Qwen 3 models, finding deeper layers contribute less and do not perform new computations, explaining diminishing returns in stacked Transformer architectures. https://arxiv.org/abs//2505.13898 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Do Language Models Use Their Depth Efficiently? 20:25
20:25 Play Later Play Later Lists Like Liked20:25
Play Later Play Later Lists Like LikedThe study analyzes Llama 3.1 and Qwen 3 models, finding deeper layers contribute less and do not perform new computations, explaining diminishing returns in stacked Transformer architectures. https://arxiv.org/abs//2505.13898 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
The Latent Flow Transformer (LFT) compresses layers in language models using a learned transport operator, improving efficiency and performance while addressing limitations of existing flow-based methods. https://arxiv.org/abs//2505.14513 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
The Latent Flow Transformer (LFT) compresses layers in language models using a learned transport operator, improving efficiency and performance while addressing limitations of existing flow-based methods. https://arxiv.org/abs//2505.14513 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Enhancing Latent Computation in Transformers with Latent Tokens 8:42
8:42 Play Later Play Later Lists Like Liked8:42
Play Later Play Later Lists Like LikedThis paper presents latent tokens, a lightweight method to enhance Transformer-based LLMs' performance and adaptability, particularly in out-of-distribution scenarios, with minimal complexity added. https://arxiv.org/abs//2505.12629 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Enhancing Latent Computation in Transformers with Latent Tokens 21:54
21:54 Play Later Play Later Lists Like Liked21:54
Play Later Play Later Lists Like LikedThis paper presents latent tokens, a lightweight method to enhance Transformer-based LLMs' performance and adaptability, particularly in out-of-distribution scenarios, with minimal complexity added. https://arxiv.org/abs//2505.12629 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Why Knowledge Distillation Works in Generative Models: A Minimal Working Explanation 8:11
8:11 Play Later Play Later Lists Like Liked8:11
Play Later Play Later Lists Like LikedThis paper explains knowledge distillation's impact on generative models, revealing a precision-recall trade-off that enhances sample quality while managing distributional coverage, validated through simulations and large-scale language modeling. https://arxiv.org/abs//2505.13111 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Why Knowledge Distillation Works in Generative Models: A Minimal Working Explanation 20:20
20:20 Play Later Play Later Lists Like Liked20:20
Play Later Play Later Lists Like LikedThis paper explains knowledge distillation's impact on generative models, revealing a precision-recall trade-off that enhances sample quality while managing distributional coverage, validated through simulations and large-scale language modeling. https://arxiv.org/abs//2505.13111 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 [QA] Visual Planning: Let's Think Only with Images 7:43
7:43 Play Later Play Later Lists Like Liked7:43
Play Later Play Later Lists Like LikedThis paper introduces Visual Planning, a novel approach using visual representations for reasoning, enhancing planning in navigation tasks and outperforming text-based reasoning methods. Code is available online. https://arxiv.org/abs//2505.11409 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
1 Visual Planning: Let's Think Only with Images 18:55
18:55 Play Later Play Later Lists Like Liked18:55
Play Later Play Later Lists Like LikedThis paper introduces Visual Planning, a novel approach using visual representations for reasoning, enhancing planning in navigation tasks and outperforming text-based reasoning methods. Code is available online. https://arxiv.org/abs//2505.11409 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
A
Arxiv Papers
The Relational Graph Transformer (RELGT) enhances predictive modeling on relational data by addressing GNN limitations, using a novel tokenization strategy and outperforming GNNs in various tasks. https://arxiv.org/abs//2505.10960 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…
Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.
Daily Deals
Daily Deals
Similar to Arxiv Papers
Flash Forward is a show about possible (and not so possible) future scenarios. What would the warranty on a sex robot look like? How would diplomacy work if we couldn’t lie? Could there ever be a fecal transplant black market? (Complicated, it wouldn’t, and yes, respectively, in case you’re curious.) Hosted and produced by award winning science journalist Rose Eveleth, each episode combines audio drama and journalism to go deep on potential tomorrows, and uncovers what those futures might re ...
…
continue reading
Come dive into one of the curiously delightful conversations overheard at National Geographic’s headquarters, as we follow explorers, photographers, and scientists to the edges of our big, weird, beautiful world. Hosted by Peter Gwin and Amy Briggs.
…
continue reading
Unseeable forces control human behavior and shape our ideas, beliefs, and assumptions. Invisibilia—Latin for invisible things—fuses narrative storytelling with science that will make you see your own life differently.
…
continue reading
Science Friction's latest series is: Cooked. We dig into food science pickles. Why are studies showing that ice cream could be good for you? Do we really need as many electrolytes as the internet says? And why are people feeling good on the carnivore diet? Nutrition and food scientist Dr Emma Beckett takes us through what the evidence says about foods like meat, ice cream and potatoes — and unpicks why nutrition studies can be so conflicting and confusing. All six episodes of Cooked are avai ...
…
continue reading
DNA science. Artificial intelligence. Smartphones and 3D printers. Science and technology have transformed the world we live in. But how did we get here? It wasn’t by accident. Well, sometimes it was. It was also the result of hard work, teamwork, and competition. And incredibly surprising moments. Hosted by bestselling author Steven Johnson (“How We Got To Now”), American Innovations uses immersive scenes to tell the stories of the scientists, engineers, and ordinary people behind the great ...
…
continue reading
We humans could have a bright future ahead of us that lasts billions of years. But we have to survive the next 200 years first. Join Josh Clark of Stuff You Should Know for a 10-episode deep dive that explores the future of humanity and finds dangers we have never encountered before lurking just ahead. And if we humans are alone in the universe, if we don't survive intelligent life dies out with us too.
…
continue reading
Professor Jim Al-Khalili talks to leading scientists about their life and work, finding out what inspires and motivates them and asking what their discoveries might do for us in the future
…
continue reading
Join Dr Karl Kruszelnicki, Lucy Smith and their scientific guests, with a bunch of curious triple j listeners for a weekly injection of science, myth-bashing and answers!
…
continue reading
Interviews with Anthropologists about their New Books Support our show by becoming a premium member! https://newbooksnetwork.supportingcast.fm/anthropology
…
continue reading
Welcome to Curiosity Weekly from Discovery, hosted by Dr. Samantha Yammine. Once a week, we’ll bring you the latest and greatest in scientific discoveries and break down the details so that you don’t need a PhD to understand it. From neuroscience to climate tech to AI and genetics, no subject is off-limits. Join Sam as she interviews expert guests and investigates the research guiding some of the most exciting scientific breakthroughs affecting our world today. Hosted on Acast. See acast.com ...
…
continue reading
Player FM - Podcast App
Go offline with the Player FM app!
Go offline with the Player FM app!
