A Higher-Order Data Flow Model for Heterogeneous Big Data
Citation
Price, S & Flach, PA, 2013, ‘A Higher-Order Data Flow Model for Heterogeneous Big Data’. in: IEEE International Conference on Big Data. IEEE Computer Society, Santa Clara, CA, pp. 569-573
Abstract
We introduce a data flow model that supports highly parallelisable design patterns, but which also has useful properties for analysing data serially over extended time periods without requiring traditional Big Data computing facilities. The model ranges over a class of higher-order relations which are sufficiently expressive to represent a wide variety of unstructured, semi-structured and structured data. Using JSONMatch, our web service implementation of the model, we show that the combination of this model and higher-order representation provides a powerful and extensible framework that is particularly well suited to analysing Big Variety data in a web application context.
Full details in the University publications repository