LinkedIn and 3rd parties use essential and non-essential cookies to provide, secure, analyze and improve our Services, and to show you relevant ads (including professional and job ads) on and off LinkedIn. Learn more in our Cookie Policy.

Select Accept to consent or Reject to decline non-essential cookies for this use. You can update your choices at any time in your settings.

Databricks’ Post

View organization page for Databricks, graphic

806,702 followers

1d

Apache Spark’s new Python Data Source API simplifies data ingestion from custom sources. Now, data engineers can efficiently integrate a broader array of data sources and sinks into their Spark pipelines. "The fact that we can now build, test, and surface reusable Spark data sources across the org will help our teams move faster and have more confidence in their work." - Bryce Bartmann, Chief Digital Technology Advisor, Shell https://dbricks.co/3ZYofE1

9 Comments

Nicholas Iannone

Nicholas Iannone

Software Engineer in Glendale, WI

1d

Awesome! I was looking at using Databricks for ingestion of weather condition data for a snow removal app I'm developing, and this makes it much easier!

Gourav Sengupta

Gourav Sengupta

Head - Data Engineering, Quality, Operations, and Knowledge

1d

Been using it for API sources for some time and excel file - makes things a lot better

Doing what I love most - Data Engineering

1d

Finally ….

Hari Srinivasa Reddy

Hari Srinivasa Reddy

Engagement Lead - Data Platforms & Engineering | Data & Analytics | Data Governance | Generative AI | Big Data | AI/ML | AWS I Azure I SAP I Digital Transformation I Blockchain

1d

Fantastic update

Anestis Pontikakis

Anestis Pontikakis

building trust, driving Data and AI transformations

1d

Great to see this making it into production Bryce Bartmann !!

Microsoft Certified Data Engineer

1d

Well done

Ammurani Ramesh Kumar

Ammurani Ramesh Kumar

Junior Software Engineer at Databricks

1d

Congratulations!

Luiggi Silva Atto

Luiggi Silva Atto

Machine Learning |MLOPS| Data Scientist | MITx MicroMasters Data Science|Master Big data and Data Science

1d

Jose Alonso Medina Donayre

See more comments

To view or add a comment, sign in

Databricks

806,702 followers

View Profile Follow

Explore topics