R Brain Dump

My initial thoughts on the R portion of this assignment are that it should be pretty straightforward. I'll import the Film collection from Mongo into R. Turn it into a data.frame (all cleaning of na values would've been handled by the Python portion). I'll then try backward fitting a model.

To test it, I will do a couple random splits to create test and training data then comparing. I will also try to take a real film that is upcoming and predict the revenue then wait and see.

Once I get a model working, I will train it on all of the data and then create a function to predict. At this point, I will have to find a way to have Python call this function and return a result, but I will cross this bridge when I make the Python interface.

Comments

  1. Sumeet ChopraJune 2, 2025 at 3:31 AM

    Thank you for sharing your thoughts on this. I found myself nodding along as I read, and it sparked some interesting ideas in my own mind. A truly valuable contribution to the online conversation

    How to Reach Dharamshala Himachal Pradesh

    ReplyDelete
  2. HousiifyAugust 18, 2025 at 3:53 AM

    Excellent read! You've presented this information in a very clear and engaging way. I'm glad I stumbled upon your blog today. Keep up the great work!

    Birthday Party Venues in Gurgaon
    Farmhouse in Gurgaon for Party

    ReplyDelete
  3. Sumeet ChopraNovember 13, 2025 at 9:49 PM

    This is an excellent post with thoughtful details and great clarity. It’s refreshing to read content that is both engaging and valuable. Thanks for sharing such helpful information.

    Event Management Companies in Delhi
    Event Management Companies in Gurgaon
    Event Management Companies in Bangalore
    Mice Companies in Delhi

    ReplyDelete

Post a Comment

Popular posts from this blog

Video Demo General Script

Video Demo Rough Transcript Introduction to the Problem Gather Film and Actor data from IMDb and Box Office Mojo Following Features: FILM SPECIFIC weekday (1-7) day month budget length mpaa_num (converted from strings to ints) ACTOR SPECIFIC  avg_actor_age max_actor_film_revenue avg_actor_film_revenue max_actor_film_votes avg_actor_film_votes max_actor_film_stars avg_actor_film_stars max_actor_film_appearances avg_actor_film_appearances max_actor_film_metascore avg_actor_film_metascore DIRECTOR SPECIFIC director_age director_number_of_films max_director_film_revenue avg_director_film_revenue max_director_film_votes avg_director_film_votes max_director_film_stars avg_director_film_stars max_director_film_metascore avg_director_film_metascore Use Python to scrape the data Broken into two steps Scraping Aggregation Use MongoDb to save the objects (films and actors) Use R to build the multiple regression model Scraping...
Read more

Python Scraper Brain Dump

Here's what I gotta do. I need to create a web scraper that crawls IMDb to get films to be used in the model. I'm probably going to start with this URL (IMDb Most Popular)  followed by the lists sorted by IMDb rating and Number of Votes. The scraper will store a set of seen movie ID's to avoid repeats. Once the three initial lists are parsed, the ID's will be put into a Queue so the program can be multi-threaded. The scraper will then take an item from the queue and start pulling out the needed data. I plan on creating a Python class called Film that knows how to gather information from IMDb. Pulling out fields like budget, runtime etc. will be pretty straightforward. It's actors that will be the doozy. If an actor has already been processed (check a set of actor ID's), then that actor is skipped. If an actor hasn't been seen, I'll create an Actor class to handle scraping that info. Any film an actor has been in will be added to the Queue of films to...
Read more