Steps to install Apache Spark on Ubuntu
Step 1: Download Apache Spark distribution
Use the link to download the spark distribution ==> http://spark.apache.org/downloads.html
Download from terminal using below command:
wget http://www-eu.apache.org/dist/spark/spark-2.3.0/spark-2.3.0-bin-hadoop2.7.tgz
Step 2: Untar the Spark distribution
tar xzf spark-1.6.1-bin-hadoop2.6.tgz
Step 3: Setup the environment variable:
Follow below steps to set spark environment variables in
nano .bashrc
Step 1: Download Apache Spark distribution
Use the link to download the spark distribution ==> http://spark.apache.org/downloads.html
Download from terminal using below command:
wget http://www-eu.apache.org/dist/spark/spark-2.3.0/spark-2.3.0-bin-hadoop2.7.tgz
Step 2: Untar the Spark distribution
tar xzf spark-1.6.1-bin-hadoop2.6.tgz
Step 3: Setup the environment variable:
set SPARK_HOME=/usr/local/spark
Follow below steps to set spark environment variables in
.bashrc
file.
nano .bashrc
Step 4: Launch Spark shell /pyspark context:
scala API command line:
run spark-shell to enter into scala context.
Python API command line:
run pyspark to enter into python context.
R API command line:
run sparkR to enter into R context.
Step 5: Spark UI:
Enter the below url in the browser to check spark execution or DAG information to debug etc.
URL ==> http://localhost:4040
Done, it's great step to proceed further data processing using Apache Spark.
Thank you for providing useful content Big data hadoop online Course India
ReplyDeleteNice and good article. It is very useful for me to learn and understand easily. Thanks for sharing your valuable information and time. Please keep updating big data online training
ReplyDeleteUsually I never comment on blogs but your article is so convincing that I never stop myself to say something about it. You’re doing a great job Man. If you are in the real estate industry and are looking for the best real estate auction software then I would like to introduce RisingMax. Thank you very much and good luck for the upcoming articles.
ReplyDeleteHi, I enjoyed your article. if your Looking to supply your liquor, beer, or wine supply on the occasion but don't want to leave the house?
ReplyDeleteIf that's the case, an Ready made Alcohol delivery app is a great option for you!
With an on-demand alcohol delivery app, you can get your favored liquors, beers, or drinks delivered to your door with a single finger of your finger.
Once again you provide several doses of reality which explore the complete explanation of packing and moving companies in Bangalore . This article don't have to be that long. I simply couldn't leave your web site before suggesting that I actually loved the usual info on packing and movers services in Bangalore. I just want to know what is the best way to get real service
ReplyDeleteThank you so much for sharing this valuable information and here I just want to introduce about App Cost Calculator which can help you determine how much it will cost to build an app and how long it will take to launch. The cost varies depending on the device, functionality, UI/UX, and many other factors that will be discussed in detail.
ReplyDeleteThe ADA's digital marketing course contains exceptionally compelling digital marketing training that will assist you with finding modern strategies for brand advancement. We are satisfied to acquaint you with a legitimate computerized advertising school that offers online business courses to assist you with propelling your vocation and business. We've set up a norm for giving the best Digital Marketing Company in Amritsar. We need to direct your vocation in the appropriate way, in light of our set up history of various fruitful voyages. The methods we instruct are altogether founded on true undertakings. We work with students to assist them with further developing their reasoning abilities and widen their inventiveness.
ReplyDeletePython-dictionary tutorial for beginners Free Learn By CodeExampler
ReplyDeleteC# for Loop Statement Learn Free for Beginners by CodeExampler website
ReplyDelete