Open Sourcing Vespa, Yahoo’s Big Data Processing and Serving Engine

Oath, parent company of Yahoo, has announced that it has released Vespa as an open source project on GitHub. "Building applications increasingly means dealing with huge amounts of data. While developers can use the the Hadoop stack to store and batch process big data, and Storm to stream-process data, these technologies do not help with serving results to end users. Serving is challenging at large scale, especially when it is necessary to make computations quickly over data while a user is waiting, as with applications that feature search, recommendation, and personalization. By releasing Vespa, we are making it easy for anyone to build applications that can compute responses to user requests, over large datasets, at real time and at internet scale – capabilities that up until now, have been within reach of only a few large companies." (Thanks to Paul Wise)

Comments (1 posted)