Question Description
Spark Lab (Use the Databricks Community Edition, a free version)
==================================================================
Download the movilens dataset for "education and development" from this URL:
https://grouplens.org/datasets/movielens/
Upload it to Databricks using either wget command or manually uploading.
Read the files into different RDDs.
Answer the following questions:
1. Join the movies and ratings tables, and give the names of the top 10 movies with the highest ratings
Hint: use join function
2. Now join the movies and tags tables, and output the NAMES all movies with the tag 'mathematics'
3. What is the average ratings of movies that contain the tag 'artificial intelligence'
4. What is the average rating of movies that have the genre 'Crime'
5. Which is the most popular tag?
Answer the attached questions and submit the public URL of your notebook
====================================================================
Please provide me with the commands that you ran.
Provide the URL for the Published Notebook
Our website has a team of professional writers who can help you write any of your homework. They will write your papers from scratch. We also have a team of editors just to make sure all papers are of HIGH QUALITY & PLAGIARISM FREE. To make an Order you only need to click Ask A Question and we will direct you to our Order Page at WriteDemy. Then fill Our Order Form with all your assignment instructions. Select your deadline and pay for your paper. You will get it few hours before your set deadline.
Fill in all the assignment paper details that are required in the order form with the standard information being the page count, deadline, academic level and type of paper. It is advisable to have this information at hand so that you can quickly fill in the necessary information needed in the form for the essay writer to be immediately assigned to your writing project. Make payment for the custom essay order to enable us to assign a suitable writer to your order. Payments are made through Paypal on a secured billing page. Finally, sit back and relax.
About Writedemy
We are a professional paper writing website. If you have searched a question and bumped into our website just know you are in the right place to get help in your coursework. We offer HIGH QUALITY & PLAGIARISM FREE Papers.
How It Works
To make an Order you only need to click on “Place Order” and we will direct you to our Order Page. Fill Our Order Form with all your assignment instructions. Select your deadline and pay for your paper. You will get it few hours before your set deadline.
Are there Discounts?
All new clients are eligible for 20% off in their first Order. Our payment method is safe and secure.