r/learnpython • • May 10 '20

Beginner Python data analysis project - critique greatly welcome!

Hi everyone,

I just finished my first Python data analysis project, and being a total beginner, I could really use some other perspectives as to the quality of my final product. I plan on building a portfolio of similar projects and using it for applying to social science research assistant jobs where some programming and analysis ability is highly preferred. Since I am entirely self-taught, I need some concrete examples of what I can do to share with potential employers.

With that said, while I'm sure there are areas that could be improved, would my project be worth sharing with some edits? Or is it actually just a total flaming trash heap that should be scrapped entirely? Positive critique and helpful suggestions appreciated!

Project

Edit: Wow, I did not expect to wake up to so many comments and upvotes! I really needed this boost, to be honest. I'm so grateful for everyone's kindness and suggestions, and I'm definitely going to go back and try and tweak some things! I hope I can pay it forward one day, but for now, to fellow noobs who are trying to set up their first project - just go do it! I basically just forced myself to create something after learning the basics, and it really helps the learning process to break things down and figure out how they work outside of a guided tutorial. Keep coding!

Edit 2: I've uploaded a new version of the project since this was posted, taking into account some of the suggestions everyone has made. It's still not perfect, but I think it's time to move onto learning with new projects.

361 Upvotes

68 comments sorted by

View all comments

1

u/pulsarrex May 10 '20

Hey I am about to graduate in social science too. In school, I learnt and used mostly SPSS to analyze data. However in real world, I realized most of the industry does not use SPSS. Those who use SPSS, mostly use it as many tools, including Python, R, SAS etc.

I need some advice. What kind of jobs do we need to look for? I know a bit of python like you do. Just a mere searching for 'social scientist' on indeed does not show many results. A search for 'data analyst' will give me millions of results, most of them out of our scope.

So what would I search for if I am looking for social scientist data science jobs? What kind of companies do I look for if I want to work as a data analyst in social science?

1

u/chaoticneutral May 10 '20

In my experience, it is best to search on skills. techniques, or topics. Titles themselves are mostly meaningless in the job hunt. Keep an eye out for consulting companies and/or in the field of public health, they tend to work on smaller analytic projects that require their consultants to have a little analytical skill (i.e., SPSS).

If you had to search on titles, "research analyst" tends to yield better results.

Specific to your situation:

  • SPSS - Social science, market research, survey research, low programming requirement, more generic "analyst". You might be asked to run some crosstabs, then write a report, and fiddle around in powerpoint.

  • SAS - Social science, Government, Pharma, Finance, more programming skilled is required. You are likely more focused on data management and analysis, less on generic office work.

  • R - Data science, Statistics, Academia, more programmer skilled required. Analytics and modeling. Similar to SAS.

  • Python - I haven't had one of these jobs, but there seems to be more focus on incorporating analysis into data pipe lines (live dashboards/applications), rather than just pure research/analysis itself. Though I could be wrong...

1

u/BeforetheBullfight May 10 '20

Honestly, I'm still in the process of looking for a research job, and it hasn't been easy! I did psych in undergrad and am working towards applying to clinical PhD programs, so that's part of the reason why I'm learning Python - it seems to be a pretty popular language (with R and Matlab being the next most popular) in labs, so I wanted to boost my competitiveness.

What you should do really depends on your long-term goals. Since I want to return to school, I'm focusing on applying to psych labs that are hiring research assistants, or similar, in order to gain experience. With that said, programming is a bonus and not the end-goal (I don't plan on being a data scientist for a living) for me. Do you want to work in the private or public sector? Academia or no? That will make a big difference. I can really only speak to academia personally. I'm happy to talk more about that if you want though! I can say that job titles with "scientist" are basically always geared towards those with grad degrees. "Analyst" or "assistant" are better bets.

I hope that's at least somewhat helpful! I'm still figuring this out myself.