r/learnpython • • May 10 '20

Beginner Python data analysis project - critique greatly welcome!

Hi everyone,

I just finished my first Python data analysis project, and being a total beginner, I could really use some other perspectives as to the quality of my final product. I plan on building a portfolio of similar projects and using it for applying to social science research assistant jobs where some programming and analysis ability is highly preferred. Since I am entirely self-taught, I need some concrete examples of what I can do to share with potential employers.

With that said, while I'm sure there are areas that could be improved, would my project be worth sharing with some edits? Or is it actually just a total flaming trash heap that should be scrapped entirely? Positive critique and helpful suggestions appreciated!

Project

Edit: Wow, I did not expect to wake up to so many comments and upvotes! I really needed this boost, to be honest. I'm so grateful for everyone's kindness and suggestions, and I'm definitely going to go back and try and tweak some things! I hope I can pay it forward one day, but for now, to fellow noobs who are trying to set up their first project - just go do it! I basically just forced myself to create something after learning the basics, and it really helps the learning process to break things down and figure out how they work outside of a guided tutorial. Keep coding!

Edit 2: I've uploaded a new version of the project since this was posted, taking into account some of the suggestions everyone has made. It's still not perfect, but I think it's time to move onto learning with new projects.

361 Upvotes

68 comments sorted by

View all comments

1

u/[deleted] May 10 '20

Great project. I am not an expert in ML or data science but when I looked at the Liner Regression graph, I did feel that the data would better fit a Polynomial Regression? Just something I noticed and I could very well be wrong. I apologise for lack of knowledge if that's the case.

2

u/chaoticneutral May 10 '20

I would recommend everyone stay away from polynomial regression unless you have a specific reason to believe they are useful. Otherwise it can be as rigorous as a Rorschach test. What you are seeing is more likely an outlier rather than a trend.

Also see this case study:
https://twitter.com/NateSilver538/status/1257476755574718470
https://twitter.com/mattyglesias/status/1257483264383758336
https://twitter.com/NateSilver538/status/1258137098298839041

1

u/andycyca May 10 '20

Saving this for whenever I need to teach statistics.