Sentra’s Post

Shout out to the Bitrise Data team 👏👏 Data Analyst, Krisztina Nagy, and Staff Data Engineer, Balázs Francsics led a great discussion at the Compass Data Meetup! They tackled the important topic of "Finding the Balance of Cost and Performance in Caching," addressing key questions and sharing practical solutions. We love seeing Bitrisers representing us at industry events, sharing their expertise, and contributing to the tech community. Keep up the fantastic work! 🌟🤖🐱🚀 #DataEngineering #Caching #TechCommunity

🌟 Shoutout to Brian Meeker for rocking Stir Trek this year! 🌟 We’re super proud of Brian, who gave an awesome talk sharing how our team tackled a big scaling problem with some clever tech solutions, breaking down our new data processing pipeline and how we made our system more flexible for the future. Even if you don’t have a software development background, Brian’s insights are super interesting and definitely worth a watch! You can see the full session title, description, and link below. Messaging With Limits: Concurrent, Multi-Stage Data Processing in the Real World -- Our team at GetThru found ourselves with a scaling problem. Working with our existing infrastructure for sending text messages was becoming increasingly complex. Years of bewildering external requirements had led us to the point where the existing system was both incorrect and difficult to reason about. In this session, we'll go over a case study of our new concurrent, multi-stage data processing pipeline. Starting from the fundamentals, we'll see how our team efficiently handled our existing external requirements and built in flexibility for the future. Finally, we'll look at how we did all of this in our existing monolith, avoiding the complexity of microservices.

Learn how Starburst supports exabytes of data and replicates metadata globally: https://cockroa.ch/3IKyALx “We have to assume that at some point, some of the regions will go down. We can’t have central gravity for this storage – it’s not possible. So even if our primary control plane goes down and a failover hasn’t happened, the customers can still get access to their data.” - Ken Pickering, VP of Engineering 📸 Pictured: Starburst's setup designed to minimize latency and survive regional failures

Menlo Park Trino meetup.. Starburst Trino Software Foundation And don't miss an opp to see Martin Traverso Co Creator of Trnio. JP Reilly Ethel Anderson Jay Lockwood Anil Maddiboina John Bell We will then be joined by Trino experts to discuss Trino’s power as a data lakehouse query engine. Trino works hand in hand with modern table formats like Apache Iceberg, Delta Lake, and Hudi, which are very powerful data technologies independently, but together is where they truly shine. Table formats were built to bring data-warehouse functionality to the data lake, and handle huge data tables while enabling data engines to safely query those tables. 

The Nashville Data Engineering Group is hosting a special meetup with Fivetran and dbt Labs next week on Thursday, June 27th! This event is totally free and will be in-person at the Vaco offices in Brentwood from 5:30 to 7:30pm. This is an exciting opportunity to meet other local data professionals and learn more about a couple of the most popular tools in data engineering right now and the problems they are solving. For more info and to register please check out the comments! #NashDataEng #DataEngineering #NashvilleTech

Who's joining our Dagster Deep dive on reliable data platforms tomorrow? ✋ Even if you aren't currently leveraging Dagster+, Sandy's insights will be beneficial for any data-driven organization https://lnkd.in/g4UPV3S5

We’re ready to dive into all things FinOps Observability at PASS Data Community Summit! Stop by our booth to meet the team, learn more about Fortified, and grab a signed copy of Ben D.’s book. See you soon! #FinOps #Observability #PASSDataCommunitySummit

What the heck is a Lockbox? In sixty seconds, Ryan Haughey, Abett's Director of Data Science & Engineering, describes the product.

Tech Tips Tuesday This week, hear from Muhammad Bilal, our Senior Solution Architect at Kavtech Solutions, as he shares his thoughts on the essential skills every data engineer must have to excel in the tech world. With years of hands-on experience and a proven track record in designing innovative solutions, Bilal’s insights are a must-hear for anyone looking to thrive in data engineering. Watch the video and take your first step toward mastering these critical skills!

For Skylark, Fauna’s document-relational model provided the ideal mix of data model flexibility and relational power they needed to deliver personalized content at scale. With Fauna’s intuitive & powerful query language, FQL, Skylark’s development team condensed critical data logic from 300 to 26 lines of code and reduced their overall codebase by 80%; this enabled Skylark to not only simplify their stack but also deliver features faster and more efficiently. Read more about Skylark's story here: https://lnkd.in/gEuw8WGk