Big data on GCP: dataflow, bigquery and spark cost comparison
mgaiduk.substack.com
I work in a typical big tech social network organization. Our task is to produce ML for our tiktok-like feed. We store a lot of data generated by users: clicks, likes, video plays, server events with specific info. We aggregate it, join with each other, transform into datasets to then train our models.
Big data on GCP: dataflow, bigquery and spark cost comparison
Big data on GCP: dataflow, bigquery and spark…
Big data on GCP: dataflow, bigquery and spark cost comparison
I work in a typical big tech social network organization. Our task is to produce ML for our tiktok-like feed. We store a lot of data generated by users: clicks, likes, video plays, server events with specific info. We aggregate it, join with each other, transform into datasets to then train our models.