Optimizing Apache Spark Throughput Using Intel Optane and Intel Memory Drive TechnologyRavikanth Durgavajhala (Intel) from ssd storage capacity Watch Video

⏲ Duration: 19 min 84 sec
✓ Published: 12-Jun-2018

Description:
Apache Spark is a popular data processing engine designed to execute advanced analytics on very large data sets which are common in today’s enterprise use cases. To enable Spark’s high performance for different workloads (e.g. machine-learning applications), in-memory data storage capabilities are built right in.nnHowever, Spark’s in-memory capabilities are limited by the memory available in the server; it is common for computing resources to be idle during the execution of a Spark job, ev