From the course: Generative AI and Predictive AI in the Cloud: Foundational Concepts and Scenarios
Unlock the full course today
Join today to access over 24,100 courses taught by industry experts.
AI and big data
From the course: Generative AI and Predictive AI in the Cloud: Foundational Concepts and Scenarios
AI and big data
A typical business will often need to collect, store, and process huge amounts of data in order to extract the different types of data that an AI system is looking for. Some of this data may have been generated internally, while other data may need to be collected from external sources. A big data system is used to manage and process all of this data. For example, data we acquire from different sources or different vendors will almost always have different formats and characteristics. A customer record in one data set might look completely different in another data set. We can use a big data system to combine and synthesize different data, so that we produce data suitable as input into the AI system. The big data environment basically allows us to store and organize the data we feed into the AI system, so that it can then carry out the processing it needs to. When we use big data platforms for this purpose, they can demand large storage capacity that will likely only continue to grow…