The technology choice in this layer was really tough for us. Apache Spark was initially our choice, but Apache Flink had something in it that made us think over and at the time of writing this book, the industry did have some pointers favoring Flink and this made us do the final choice as Flink. However, we could have implemented this layer using Spark and it would have worked well for sure.
This section tries to give the reader reasons for why Flink was chosen. Obviously we have a subsection that gives detail advantages of Flink and those are these primary reasons for the choice.
But before going to the advantages and disadvantages of Flink, lets see how Flink started its journey and what were the advantages it had when it started. Some aspects is definitely its learning from existing similar technologies and that itself is an advantage. Other aspect is new things get developed when there is such a requirement (necessity is the mother of all inventions as stated by the famous...
