Data processing : small, big, batch & stream

Data formats

Text Vs. Binary

Data Readiness

  1. Basically a “TRL for data”
  2. Started by Neil Lawrence at Amazon his blog and paper.
  3. Our take with examples from Swedish industry.

Cleaning and wrangling, A classic Pareto rule

Batch data processing

A set of our slides from the BADA project, processing

Stream processing

By Ahmad