Postgres, Performance and Rails

SaaS for Developers

30:20

Eli Beer is a pioneer, social entrepreneur, President and Founder of United Hatzalah of Israel. In thirty years, the organization has grown to more than 6,500 volunteers who unite together to provide immediate, life-saving care to anyone in need - regardless of race or religion. This community EMS force network treats over 730,000 incidents per year, in Israel, as they wait for ambulances and medical attention. Eli’s vision is to bring this life-saving model across the world. In 2015, Beer expanded internationally with the establishment of branches in South America and other countries, including “United Rescue” in Jersey City, USA, where the response time was reduced to just two minutes and thirty-five seconds. Episode Chapters (0:00) intro (1:04) Hatzalah’s reputation for speed (4:48) Hatzalah’s volunteer EMTs and ambucycles (5:50) Entrepreneurism at Hatzalah (8:09) Chutzpah (14:15) Hatzalah’s recruitment (18:31) Volunteers from all walks of life (22:51) Having COVID changed Eli’s perspective (26:00) operating around the world amid antisemitism (28:06) goodbye For video episodes, watch on www.youtube.com/@therudermanfamilyfoundation Stay in touch: X: @JayRuderman | @RudermanFdn LinkedIn: Jay Ruderman | Ruderman Family Foundation Instagram: All About Change Podcast | Ruderman Family Foundation To learn more about the podcast, visit https://allaboutchangepodcast.com/ Looking for more insights into the world of activism? Be sure to check out Jay’s brand new book, Find Your Fight , in which Jay teaches the next generation of activists and advocates how to step up and bring about lasting change. You can find Find Your Fight wherever you buy your books, and you can learn more about it at www.jayruderman.com .…

2 years ago 57:58

MP3•Episode home

Andrew Atkinson took a Rails web application that was struggling with load, and optimized it to handle over 9000 HTTP requests per second with an average latency of 35ms end to end. Handling a much higher load, on a smaller RDS instance, with lower latencies. He then shared his expertise by writing a book: "High-Performance Postgres with Rails." Andrew and I discussed Postgres performance, scalability, design patterns, valuable tools, his career, and some Rails. I tackled Andrew with many of the biggest challenges SaaS developers encounter with Postgres, and Andrew had an answer to everything. For me, the highlights were his explanation of the N+1 problem, sharding patterns, the use of pgcopydb project to move a noisy neighbor to another DB, and the secret for scaling on a single instance. Useful links: - The book: https://pgrailsbook.com - SaaS Developer Slack - where Andrew answers Postgres questions and will share a discount for his book: http://launchpass.com/all-about-saas

Tools we mentioned: - Easier multi-tenancy for Rails: https://github.com/ErwinM/acts_as_tenant - For read replicas prior to Rails 6.0: https://github.com/OutOfOrder/multidb - The fastest way to copy a DB or part of: https://github.com/dimitri/pgcopydb

42 episodes

#Tech #Gwen✨️

Postgres, Performance and Rails

SaaS for Developers

published 2 years ago

MP3•Episode home

42 episodes

#Tech #Gwen✨️

All episodes

1
Optimizing Cloud Costs for SaaS Startups 29:35

1 year ago29:35

29:35

You can't manage what you don't measure, and this includes your cloud costs. But how detailed should this measurement be? And how will the data translate into impact? I sat down with Adam Shugar, co-founder and CTO of Dashdive, to discuss his approach to cloud costs. He shared his advice, not only on cost cutting but also technology, growing a startup, the importance of community and more.…

1
SaaS: More than just a business model 52:04

1 year ago52:04

52:04

Bill Tarr has the most interesting job in the world. He and his team of SaaS Evangelists at the AWS SaaS Factory work with companies large and small to help them build SaaS on AWS. In this conversation, we discuss the different ways technology and business interact when building SaaS - from cool technical options available only to SaaS companies to the importance of knowing the cost of a tenant. This hour is packed with advice for both the technical and the business side of building a viable SaaS. Links mentioned in the show: Prime Day team on observability: https://www.youtube.com/watch?v=fOYOvp6X10g Bill Tarr on SaaS Architecture Pitfalls: https://www.youtube.com/watch?v=fOYOvp6X10g WrapStream's architecture: https://youtu.be/ceWOw8rxDOM?si=uECCtW0SJ1Sffqn_ Alcion's zero cost multi-region architecture: https://youtu.be/kJECSpVwM7Q?si=_j9LZWdoA5xpFC3g…

1
Building Streaming on S3 58:11

1 year ago58:11

58:11

Ryan Worl, co-founder and CTO of WarpStream, is on a mission to re-engineer fundamental infrastructure on top of S3. Starting with metrics at Uber, continuing with Husky - DataDog's platform for events, logs and everything except metrics and then... Ryan thought "it will be cool to re-build Kafka on S3", reached out to other developers to hear their thoughts... and ended up building WarpStream. In this episode we talk about Ryan's journey, how S3 can fundamentally change the way we design our infrastructure, and why it is a good idea to go in that direction. We talk about S3 vs S3 express. What will be the perfect serverless experience for streams. And finally, tune in at minute 50:00 to get excellent advice on how a SaaS provider should use logs.…

1
Kora: Cloud Native Platform for Kafka 42:49

1 year ago42:49

42:49

We invited Anna Povzner, director of engineering at Confluent, to the show to discuss Kora. Kora is a Cloud Native platform based on Apache Kafka, which her team at Confluent built. Anna and her team recently published a paper about Kora in VLDB 2023, and it won the industry's best paper award. Kora VLDB paper: https://www.vldb.org/pvldb/vol16/p3822-povzner.pdf In our conversation, we discussed: - Capacity abstractions for serverless Kafka - Reconciling design constraints into a cohesive architecture - Key components of the architecture: Rebalances, quotas, cells. - How to drive deep technical innovation at a fast-growing company - Delivering low and predictable latency with Apache Kafka…

1
Cell Based Architecture for Early Stage SaaS 55:12

1 year ago55:12

55:12

In the last year or two I started hearing a lot about cell-based architectures. Usually in the form of “We had a lot of issues scaling our infrastructure, but then we moved to cell-based architectures” and “I wish I’ve learned about cell based architectures earlier, it would have saved me a lot of pain”. As a result, I’ve wanted to share knowledge about cell-based architectures with this community for a while now. I was lucky that Eno Thereska called me and suggested to do just that! Eno, currently at Alcion, is one of the most impressive technical leaders I’ve head the pleasure of working with. He has deep theoretical knowledge that he knows how to use for very practical technical solutions. And in this presentation and discussion, he shares both theory and practical advice. We discussed everything from the basics of cell based architectures, their benefits all the way to different heuristics for assigning tenants to cells. Papers and talks we discussed: AWS Fargate under the hood: https://www.youtube.com/watch?v=Hr-zOaBGyEA Doordash - Journey to cell-based micro services architecture: https://www.youtube.com/watch?v=ReRrhU-yRjg Slack’s Migration to Cellular Architecture: https://slack.engineering/slacks-migration-to-a-cellular-architecture/ Kora: A cloud-native event streaming platform for Kafka: https://www.vldb.org/pvldb/vol16/p3822-povzner.pdf…

1
Building a Serverless Streaming Platform 42:23

2 years ago42:23

42:23

Krishna Raman has many years of experience building platforms for developers. Now he's applying this experience at Delta Streams to build a serverless platform for stream processing in SQL. In our conversation, we discussed the serverless developer experience, some of the secret sauce behind Delta Stream's Flink Operator, how to deliver a bring-your-own-account SaaS, K8s network policies and why they matter and when you shouldn't use K8s at all.…

1
Never Rewrite! And other advice for SaaS Developers 36:31

2 years ago36:31

36:31

You are a founding engineer at a SaaS startup. You built the MVP, and to everyone's great delight - usage is picking up. What's next? In this episode, Jeffrey shares how a messy MVP can gradually evolve into a scalable SaaS product. We discuss the critical design decisions engineers have to make in the early days of building the product: Tabs or spaces, pooled tenants or siloed, Micro-services or monolith... And who makes these decisions. Jeffrey Sherman is a staff engineer, scalability, and performance lead at Active Campaign - and was recently recognized as SaaS Developer Hero for his contributions to this community. Jeffery has his own podcast, @NeverRewrite , where you can find him with more good advice and funny stories every single week. P.S. I had a bit of construction going on while recording. I tried my best, but you'll hear hammers in the background. So sorry!…

1
The Wonders of Postgres Logical Decoding Messages 40:38

2 years ago40:38

40:38

Did you know that Postgres that lets you write data that you can’t query? Events that will show up in the write-ahead log (WAL) of the database but not in any table. Gunnar Morling, senior staff engineer at Decodable and world expert on change data capture, walks us through data capture basics, this not-new but little-known feature, and dives into three key use cases (my favorite is the audit log) plus a bonus example that goes deeper into Postgres internals. We discuss these blogs and examples in the video: - https://www.infoq.com/articles/wonder... - https://www.morling.dev/blog/insatiab... - https://github.com/decodableco/exampl...…

1
Postgres, Performance and Rails 57:58

2 years ago57:58

57:58

Andrew Atkinson took a Rails web application that was struggling with load, and optimized it to handle over 9000 HTTP requests per second with an average latency of 35ms end to end. Handling a much higher load, on a smaller RDS instance, with lower latencies. He then shared his expertise by writing a book: "High-Performance Postgres with Rails." Andrew and I discussed Postgres performance, scalability, design patterns, valuable tools, his career, and some Rails. I tackled Andrew with many of the biggest challenges SaaS developers encounter with Postgres, and Andrew had an answer to everything. For me, the highlights were his explanation of the N+1 problem, sharding patterns, the use of pgcopydb project to move a noisy neighbor to another DB, and the secret for scaling on a single instance. Useful links: - The book: https://pgrailsbook.com - SaaS Developer Slack - where Andrew answers Postgres questions and will share a discount for his book: http://launchpass.com/all-about-saas Tools we mentioned: - Easier multi-tenancy for Rails: https://github.com/ErwinM/acts_as_tenant - For read replicas prior to Rails 6.0: https://github.com/OutOfOrder/multidb - The fastest way to copy a DB or part of: https://github.com/dimitri/pgcopydb…

1
Trends in Observability and Alerting 36:44

2 years ago36:44

36:44

Ensuring your production system is well-behaved is table stakes for any SaaS. The space around monitoring and alerting is complex and moving fast, so it is too easy to end up with results that are worse than useless. Alert fatigue is real, and developers must learn to avoid this. Shahar and Tal, founders of Keep and active SaaS Developer community members, joined me to discuss - why observability is so complicated, how alerts fit in, and many best practices for alerting. If you feel like you have a good handle on your alerts today, you should skip to minute 23:40, where we talk about the future. CI/CD for alerts, semantic layer for alerts, and how AI will recommend alerts + ways to resolve them.…

1
Cloudflare: Performance isolation in multi-tenant DB 36:14

2 years ago36:14

36:14

Cloudflare is no longer "just" a CDN serving 55M HTTP requests/sec; they now offer a wide range of cloud services on the edge. These services run on a data layer with 15 Postgres clusters running hundreds of databases. Vignesh Ravichandran, engineering manager of Cloudflare's database team, joined us to discuss the challenges of running this large-scale multi-tenant environment - dealing with network partitions, noisy neighbors, floods of connections, and even global warming. We talk about the importance of having a good toolset, of practicing incidents, and of internally advocating database best practices to a large engineering organization. The blog: https://blog.cloudflare.com/performan... The Scale presentation: https://www.socallinuxexpo.org/scale/...…

1
Real-time Data Infrastructure - At Uber and Beyond 38:10

2 years ago38:10

38:10

Pinot team at Uber wrote an excellent paper about the real-time analytics platform they built. Chinmay, formerly a principal engineer at Uber and now head of product at StarTree, joined me for a conversation. We discussed the challenges they encountered at Uber, the solutions they came up with, the platform they built, and how to best apply their experience to companies much smaller than Uber. The paper: https://arxiv.org/pdf/2104.00087.pdf…

1
Scalable Multi-tenant Platforms at Loom and at Times 47:03

2 years ago47:03

47:03

Shayon wrote a great blog post on the guiding principles he and his team at Loom used to guide them as they evolved Loom's data platform through a period of hypergrowth. I invited Shayon to the show to discuss the challenges he encountered and how he solved them - and I learned that he is now at Tines - solving an entirely new set of challenges with a very different set of solutions. We discuss the fundamental principles that help Shayon make critical decisions when building and scaling his platforms. We also discuss what happens when JSON columns become too large, how to prioritize performance improvement projects, what to do when a tenant gets noisy, and how his team performs zero downtime upgrades. Shayon's blog: https://www.loom.com/blog/scale-engin... Shayon's personal site: https://www.shayon.dev/about/…

1
Building SaaS on Kafka Streams 53:48

2 years ago53:48

53:48

Colt McNealy is re-imagining the future of microservices orchestration and he decided to build it entirely on Kafka Streams. In this conversation we discuss how Kafka Streams provides the low latency, reliability, availability and elasticity that is needed for the next generation of microservices orchestration. Colt also shares the most exciting up and coming improvements in Kafka Streams community and the roadmap he'd dictate if he was the benevolent dictator of Kafka Streams.…

1
Transaction Isolation - Demystified! 31:11

2 years ago31:11

31:11

If you used a relational database at all, you probably heard of transaction isolation levels. Transaction isolation levels have a massive impact on the behavior of your application - correctness, performance, and error rates. Your database may be distributed these days, so you may have to reason about distributed transactions too. In this video, I explain transaction isolation levels with simple examples and why these levels barely make any sense. I conclude with a few examples of the complications involved in distributed transactions - and bad news about 2 phase commits. ---- For more in-depth reading: Transaction isolation in a few popular DBs: https://asktom.oracle.com/Misc/oramag... https://dev.mysql.com/doc/refman/8.0/... https://www.postgresql.org/docs/curre... The paper where Microsoft Research absolutely burns ANSI SQL 92 transaction isolation: https://arxiv.org/pdf/cs/0701157.pdf Why transactions matter: http://www.bailis.org/blog/understand... Super clear explanation of serialization anomalies: https://justinjaffray.com/what-does-w... Daniel Abadi on distributed transaction anomalies (I borrowed heavily from this in the second part of the video): https://dbmsmusings.blogspot.com/2019... Jepsen putting together isolation and distributed consistency: https://jepsen.io/consistency…

SaaS for Developers

1
Giving and Receiving Actually Useful Advice 17:16

2 years ago17:16

17:16

YouTube and Twitter are full of “things developers should never do”. There's an endless demand for simple advice that applies in all situations. And that's not a bad thing. If there's a simple solution that works 80% of the time, this is valuable information. More practical than just "it depends." But advice-givers and advice-getters can do better. The best advice doesn't just solve an immediate problem. It tells you when to ignore this advice, and what to do if the problem isn't solved. I share a very old story about when I needed help sizing a connection pool, the advice I got, and the advice I now wish someone had given me. P.S Sorry about the audio quality. I had to record outside, and my lav mic wasn't as good as my desk mic.…

SaaS for Developers

1
The Promise of Serverless 1:06:30

2 years ago1:06:30

1:06:30

When developers talk about Serverless, they often focus on FaaS. But the best Serverless experience, by far, is delivered by a data store. S3. Why? Because it "just works" and lets developers focus on their code. Serverless databases help you focus on your queries and workload. They abstract the compute. Which also means - usage based pricing. In this video, Ram Subramanian, Nile's CEO, joins us to discuss his vision of the perfect Serverless database experience. We talk about: - What makes S3 so amazing? - What would the S3 experience look like if we apply it to RDBMS? - Development cycle: Serverless requirements when coding, testing and finally in production. - Performance of Serverless databases, and what will make performance tuning a better experience - Elasticity and scalability. We agreed that "scale to zero" doesn't mean what everyone thinks it means. - Cost of Serverless. Is it actually worth it? - Architectures: Compute-storage separation, disaggregation, sharding and gateways. - Multi-regions concerns And of course: Do Serverless DBs make sense for SaaS developers?…

SaaS for Developers

1
Airtable - Migrating a Multitenant Architecture to MySQL 8.0 38:34

2 years ago38:34

38:34

The storage team at Airtable published a blog post describing, in detail, the migration of their petabyte-scale storage layer from MySQL 5.6 to MySQL 8.0. Andrew Wang, the lead of Airtable's storage team, joined us to discuss the migration, Airtable's storage architecture, data isolation levels, engineering culture, and more. The blog: https://medium.com/airtable-eng/migrating-airtable-to-mysql-8-0-809f0398a493 Github's gh-ost, recommended by Andrew: https://github.com/github/gh-ost Andrew's LinkedIn (he's hiring): https://www.linkedin.com/in/aawang/…

SaaS for Developers

1
The Multitenant journey - From 0 to 500M ARR 55:16

2 years ago55:16

55:16

SaaS applications are multi-tenant, so whether you are writing the first line of code in a new app or worried about scaling your successful SaaS fast enough - you need to be aware of multi-tenant requirements. Isolation, access control, perfornance, operations, scale and compliance In this video, Ram Subramanian, Nile CEO and SaaS Community founder, shares what he learned about building multi-tenant applications, based on 20+ years of experience and 100+ customer conversations. Starting from the first decision about the data model all the way to operating large scale deployments across multiple geographies. Blogs we refer to in this video: https://www.notion.so/blog/sharding-postgres-at-notion https://www.atlassian.com/engineering/scaling-rearchitecting-and-decomposing-confluence-cloud https://www.atlassian.com/engineering/april-2022-outage-update https://slack.engineering/scaling-datastores-at-slack-with-vitess/ And few other good blogs: https://blog.gotenzo.com/tech/database-sharding-solving-performance-in-a-multi-tenant-restaurant-data-analytics-system https://blog.sentry.io/2015/07/23/transaction-id-wraparound-in-postgres/ https://blog.cloudflare.com/performance-isolation-in-a-multi-tenant-database-environment/ https://www.lighttag.io/blog/database-multi-tenancy/…

SaaS for Developers

1
Compute-Storage Separation Explained 18:01

2 years ago18:01

18:01

Gunnar Morling asked a great querstion on Twitter: ""Separating storage and compute" vs. "Predicate push-down" -- I can't quite square these two with each other. Is there a world where they co-exist, or is it just two opposing patterns/trends in DB tech. ?" Those are complimentary patterns and you definitely want them together. They appear contradictory because "separating storage and compute" can mean different things to different people. In this episode, I explain the various meanings of compute-storage separation, the problems it solves, the new problem it can create, and how predicate pushdown saves the day. Gunnar's tweet: https://twitter.com/gunnarmorling/status/1610203324963516417 Aurora paper: https://web.stanford.edu/class/cs245/readings/aurora.pdf…

SaaS for Developers

1
SaaS Developer Trends - 2022 and 2023 17:24

2 years ago17:24

17:24

The last SaaS Developer video for 2022! Gwen talks about trends in the SaaS development space, and celebrates the growth of this community. Enjoy the holidays and we'll see you back with more SaaSy content in 2023! https://launchpass.com/all-about-saas

SaaS for Developers

1
Data Contracts for SaaS Developers with Benn Stancil 42:37

2 years ago42:37

42:37

When you want to introduce new "Premium" pricing for your SaaS, it may look easy to add a field in the product. But are you sure it won't break the billing system? what about business reports? The last few weeks, my twitter feed was all about data contracts, and it was hard to see the real value behind the hype. Benn Stancil, Chief Analytics Officer at Mode and one of my favorite thought leaders in the data space, agreed to join us and explain what are data contracts and how to use them for good rather than evil when building SaaS products. He highlighted what data contracts can actually achieve for an organization vs what we'd like them to achieve. Benn's blog with interesting opinions on data, culture, businesses and the world: https://benn.substack.com/ Our community newsletter: https://hackingsaas.substack.com/ Our community slack: https://launchpass.com/all-about-saas…

SaaS for Developers

1
SLO - Best Practices for Reliable SaaS 56:48

3 years ago56:48

56:48

A common challenge for SaaS products that got user adoption is balancing operational investments with a high speed of shipping new features. In the B2B world, moving fast and breaking things isn't an option. We need to move deliberately and reliably. SLO, service level objectives, is a way to align the product requirements for availability with the engineering investment in operations. Ken Finnigan is a senior principal engineer at Workday, where he leads the SLO practice and aligns their engineering organization around the industry's best practices. He joined us to share these best practices.…

SaaS for Developers

1
Shifting Left of API Security 49:20

3 years ago49:20

49:20

SaaS applications typically have public APIs, and must be concerned with securing these APIs. Buchi Reddy answered many security questions on the SaaS Developer slack community, and we invited him to chat about his approach to API Security and how he sees the future of secure SaaS products. Buchi and Gwen followed up and shared resources on the SaaS Developer Slack - secure container images and opinions on JWT tokens. Join us in the community to continue the discussion: https://launchpass.com/all-about-saas And maybe you'll want to take Buchi on his offer to find all your API security issues in 5 minutes?…

SaaS for Developers

1
Access Control: a customer-centric approach 49:15

3 years ago49:15

49:15

Access control is a vast and complex space. Dan Norwood will be our expert guide and take us from first steps all the way to advanced scenarios. We start with overview of the popular approaches, match them with customer requirements, learned how to integrate access control in existing architectures and then explore how a good product design can take access control from "must have" to a delightful customer experience.…

SaaS for Developers

1
My Job is to Predict the Future 1:15:22

3 years ago1:15:22

1:15:22

Sam Ramji is an odd duck. He is full of curiosity, insights and ideas. He is also is the Chief Strategy Officer of Datastax. In the most wide-ranging conversation I've ever recorded, we discussed the most interesting ideas in computing. From the 1980s - all the way to 2032. Along the way you'll learn how to craft a career as an odd duck with talent for strategy, how to transform an organization, how to create a strategy, and you'll hear 3 future predictions and 3 big data trends that are happening right now. Related links: - The data architecture video: https://www.youtube.com/watch?v=ovWiOD6AG78 - Sam's Podcast: https://www.datastax.com/resources/podcast/open-source-data - Hacking SaaS, the latest and greatest of everything developers need to know when building SaaS: https://hackingsaas.substack.com/ - SaaS Community Slack, join the conversation! https://launchpass.com/all-about-saas 00:00 - Intro: Ducks and curiosity 2:43 - Brief history of computing 6:00 - Career as an odd duck 8:00 - Product Management 12:20 - Microsoft, you have a SaaS problem 20:00 - Clouds, APIs and scale 28:45 - How do we think together 29:53 - APIs are eating the world 33:00 - Advice for engineers in a transforming company 43:40 - The Developer Experience Architect 45:00 - How to Strategy 56:10 - 3 Futuristic Predictions 01:02:47 - 3 Trends in Data 1:14:37 - D&D 5th Edition…

SaaS for Developers

1
Infra SaaS Architecture - the hard parts 41:59

3 years ago41:59

41:59

In a recent blog post ( https://docs.thenile.dev/blog/saas-is... ) we gave a long list of reasons why building a control plane for Infra SaaS is tricky. In this video, we walk through an example - from requirements to design, and illustrate why things are always harder than they first appear.

SaaS for Developers

1
Building Data Products in 9 Minutes 8:55

3 years ago8:55

8:55

Building Infra SaaS? Love control planes? - Ping me by email: gwen@thenile.dev or join the community and continue the conversation https://launchpass.com/all-about-saas . Data Products are trendy, and all tech trends lead to a mess around what it even means and how different products fit in. This is a "highlights" version of my YOW! Data 2022 keynote. I included some of the key insights here, and the longer version includes all the details on the data architectures you need for each type of data product.…

SaaS for Developers

1
Reverse ETL - Why is it a big deal? 21:01

3 years ago21:01

21:01

Reverse ETL is a bit of a buzzword these days. But why? In this video Gwen Shapira discusses the new capabilities that reverse ETL introduces to businesses, and especially B2B SaaS with product-lead growth strategy. She also discusses why reverse ETL is more challenging to implement than you may imagine and why stream processing platforms may be a key part of solving these challenges. Reverse ETL is not for everyone - but after watching this video, you'll know why everyone is talking about it.…

SaaS for Developers

1
SaaS Growth Teams - Hack Your Way to Success 30:10

3 years ago30:10