In those days, we are generating enormous amount of data. Biggest challenge is hidden in transformation of raw data to knowledge. We would like to take you on a short travel and show our approach for conversion from non-structured world of microservices to the world with Avro schemas inside our data pipelines.
Avro is well known format for storing and online processing information of any kind. What are key features of this format? What are the common problems? Where you can meet pitfails? How this influences our Big Data ecosystem?
Whole story will be covered by examples from real life implementation.
Senior Data Platform Engineer, Grupa Allegro Sp. z o.o.
Mainly interested in:
- big data platform architecture
- data governance
Enthusiast of scalable distributed solutions, processing large amounts of data and continuous improvement.
Works in Allegro Group as a senior data engineer. From the beginning he is related with building and maintaining of Hadoop infrastructure within Allegro Group. Previously he was responsible for maintaining large scale database systems. Passionate about new technologies and cyclin... Read More →
Tuesday November 15, 2016 16:30 - 17:20 CET
Carmona
