Within IBM, I work on a product called Aspera. Aspera is a high speed data transfer service used by companies like Netflix, Disney and Amazon. For every millisecond that a transfer is active, we record data about the status of a transfer. We first tried Redis; however, it could not keep up with the high volume of writes and complex queries. We decided to try out Cassandra, since its strength is writing quickly and growing efficiently. We implemented a Kafka service to receive data from our daemon. With the use of Kafka, we were able to stream data about active transfers in realtime. We modified the Ruby on Rails application to interface with Kafka and Cassandra. For realtime tables on the frontend, we create a websocket and pass streaming data in JSON format from Kafka. For historical data, we make Cassandra queries, and again send responses to the frontend in JSON format. Link to deck: https://docs.google.com/presentation/d/11ftwifsmHXvoYtGYHlNc5ThTNHXfuPtdWERxZtrmw10/edit?usp=sharing
Scheduled on Tuesday from 12:15 to 12:40 in Apollo
I am a passionate software engineer. In my spare time, I can be found volunteering for Bridge Foundry, a non-profit which aims to increase diversity in tech. When I’m not programming, I’m practicing tumbling at a local gymnastics center or hosting board game nights. I love working with others and sharing information about process optimization and technological implementation.