Spark Resource Allocation

Note: This post is specifically for my learning on the topic and to get warm-up at the time of interviews. Everything in the post I gathered from various books and websites, this is specifically for my understanding and to not for any business use. Resource Allocation is an important aspect during the execution of any spark

Spark Notes

Note: This post is specifically for my learning on the topic and to get warm-up at the time of interviews. Everything in the post I gathered from various books and websites, this is specifically for my understanding and to not for any business use. Import Points: RDD can be created in 2 ways: Parallelize a collection