r/datascience • • Sep 16 '19

Projects Top 5 Data Science Projects with Source Code to kick-start your Career

https://data-flair.training/blogs/data-science-projects-code/
118 Upvotes

12 comments sorted by

14

u/[deleted] Sep 16 '19

I've randomly opened Fraud Detection project and that just does not seem right. Frauds are typicaly anomaly type problems for which is nearly always necessary use some oversampling/undersampling technique and evaluate the results with confusion matrix or a recall curve. What the code there does is simply using logistic regression and roc curve, which is obviously very high.

5

u/blitz_ares Sep 16 '19

Yeah we should always implement some class imbalance handling mechanism in fraud detection and the performance metric will be generally recall/sensitivity

4

u/[deleted] Sep 16 '19

Yes. NN might catch something but in my experiences, techniques like random undersample with NearMiss algorithm or SMOTE for oversampling performs usually better.

2

u/[deleted] Sep 16 '19

[removed] — view removed comment

3

u/[deleted] Sep 16 '19

Sure.

Imagine you have 1 fraud per 1,000 cases. Most algorithms just miss that one, so you need to balance the dataset somehow in order to avoid underfitting. There're basically two options to do that: 1) You can limit the number of non-frauds to match the number of frauds, which is called undersampling, or 2) you can create synthetic points within the fraud group and than that's called oversampling. You need ideally 50:50 dataset frauds:non-frauds to properly train an algorithm and that's the whole idea behind.

The thing with roc curve is it essentially measures total number of correctly recognized predictions, which in case of anomaly type dataset will be like 99.999%. So, confusion matrix or recall/sensitivity curve should be used instead to properly evaluate the model.

3

u/ranran9991 Sep 16 '19

Think about the data that is being used when considering the problem of Fraud Detection. The amount of Frauds occuring is very very low compared to the amount of normal transactions. A model that says that the transaction is valid (not a fraud) will get very high accuracy, but that doesn't mean much, it can't detect fraud.

Some kind of mechanism that addresses that problem needs to be implemented. For example, like others suggested over/under sampling

2

u/[deleted] Sep 16 '19

Nice work man, you should post this in r/datascienceproject

1

u/Aakashdata Sep 16 '19

Yeah sure!!

0

u/rizkifn3105 Sep 16 '19

Hi is there any similar guidance for the projects with python? Currently I'm stuck because I don't know what are the projects expected to be done for a fresher (bachelors in EEE) to be accepted in DS/ Data Analyst junior role / internship I've put projects for each ML algorithm but still not getting a call back from a company that I have applied

•

u/Omega037 PhD | Sr Data Scientist Lead | Biotech Sep 16 '19

This violates Rule 5.

-1

u/toantam1290 Sep 16 '19

Amazing!!!