r/madeinpython • • Sep 05 '20

I created a tool to use machine learning without writing code

I started a project that will allows people to use machine learning without the need to write code. All you need is a yaml file, where you need to describe what you are trying to do. That's it!

What are your thoughts on this?

here is the link to the repo https://github.com/nidhaloff/igel

Link to the docs: https://igel.readthedocs.io/en/latest/

There is a quick start and end to end usage in the readme ;)

20 Upvotes

7 comments sorted by

3

u/hotcodist Sep 06 '20

This is very nice! I can see how many people will have fun with this and enjoy running a few things.

But --and not to discourage you-- I must say this is in a way has limited use for practical applications. This would work very well for handling ML toy benchmark datasets, but not for handling 'commercial' ML datasets, even if one is not optimizing yet and only looking for a proof-of-concept.

The problem often is the inconsistency or inapplicability of the raw feature set available relative to the model to be used (data types, categoricals, normalizing, outliers, dealing with zeros, NAs, etc., you probably know the drill).

The pre-ML steps, from gathering the data to selecting the features to cleaning up takes up the bulk of the work (and some coding unfortunately). By the time you get to the training, the actual ML algo coding workload is essentially a few lines.

If you can automate some of the pre-processing workload (including hypothetical exploration based on some heuristics and best practices), or make that process easier and intuitive for non-coders, that would tremendously increase the value of IGEL.

2

u/nidhaloff Sep 06 '20

u/hotcodist Hi, thanks for your feedback. Of course my goal is to make it robust so that it will also handle preprocessing operations. I do know that we write more code for preprocessing than for the machine learning algorithm. I should ve said that the project is still under heavy development. I started developing this week actually.

So, yes in the future, the user will be able to write the preprocessing operation he wants to do in the yaml file and igel will automate this ;)

1

u/hotcodist Sep 06 '20

Looking forward to that, my friend!

1

u/nidhaloff Sep 08 '20

I already added some preprocessing methods in the new release ;)

1

u/hotcodist Sep 08 '20

Cool! Browsed your code. I think it is a good addition. But do note that the strategy for missing values often differ per column/feature, so you may want to think about allowing some flexibility there.

Anyway, good luck on this project!

2

u/[deleted] Sep 05 '20

Nice! Also, what does IGEL mean?

1

u/nidhaloff Sep 06 '20

it means Hedgehog in german :D

I thought of naming it to something related to both scikit-learn and pyyaml first but then I noticed that it would be kinda ugly. Therefore, igel is a better choice ;)