Loading…
This event has ended. Create your own event → Check it out
This event has ended. Create your own
View analytic
Monday, June 20 • 2:00pm - 2:45pm
Using the SDACK Architecture on Security Event Inspection
The SDACK architecture stands for Spark, Docker, Akka, Cassandra, and Kafka. At TrendMicro, we adopted the SDACK architecture to implement a security event inspection platform for APT attack analysis. In this talk, we will introduce SDACK stack with Spark lambda architecture, Akka and Kafka for streaming data pipeline, Cassandra for time series data, and Docker for microservices. Specifically, we will show you how we Dockerize each SDACK component to facilitate the RD team of algorithms development, help the QA team test the product easily, and use the Docker as a Service strategy to ship our products to customers. Next, we will show you how we monitor each Docker container and adjust the resource usage based on monitoring metrics. And then, we will share our Docker security policy which ensures our products are safety before shipping to customers. After that, we'll show you how we develop an all-in-one Docker based data product and scale it out to multi-host Docker cluster to solve the big data problem. Finally, we will share some challenges we faced during the product development and some lesson learned.

Speakers
avatar for Yu-Lun Chen

Yu-Lun Chen

Sr. Software Engineer, Trend Micro
Darren Chen(Yu-Lun Chen) is Sr. software engineer of Trend Micro. He is enthusiast in big data and cloud computing technologies such as Docker, Kafka, Spark, Flume, Fluentd and Akka. Aside engineering stuff, he is also an enthusiast in giving talks to share software innovations and cutting edge technologies.
avatar for Evans Ye

Evans Ye

Sr. Software Engineer, Trend Micro
Yu-hsin Yeh(Evans Ye) is currently PMC member of Apache Bigtop. He integrated Docker into Apache Bigtop and created a tool to dynamically spins up fully distributed Hadoop cluster with just one click of button. He is now working at Trend Micro developing big data infra and applications. He loves to code, automate things, and develop big data solutions. Evans is also speaker of Apache Big Data Europe 2015 and Apache Big Data North... Read More →


Monday June 20, 2016 2:00pm - 2:45pm
Ballroom 6B

Attendees (2)