Case Study

Making the Impossible Possible with Alluxio: Accelerate Spark Jobs from Hours to Seconds

Making the Impossible Possible with Alluxio: Accelerate Spark Jobs from Hours to Seconds

Pages 6 Pages

© Copyright Alluxio, Inc. All rights reserved. Alluxio is a trademark of Alluxio, Inc. Making the Impossible Possible with Alluxio: Accelerate Spark Jobs from Hours to Seconds CASE STUDY What’s Inside 1 / Introduction 2 / Previous Architecture 3 / Issues with Existing Architecture 4 / Alluxio as the Key Enabling Technology 5 / Making the Impossible Possible Gianmario Spacagna, Harry Powell Barclays/ 2 Cluster computing and Big Data technologies have enabled analysis on and insights into data. For example, a big data application might process data in HDFS, a disk-based, distributed file system. However, there are many reasons to avoid storing your on data disk, such as for data regulations, or for reducing latency. Therefore, if you need to avoid disk read/writes, you can use Spa

Join for free to read