r/Python • • Nov 28 '20

Intermediate Showcase "Sillynium" - Auto generate working Python Selenium scripts by drawing coloured rectangles around web elements on a page that you want to automate

TLDR: 60 sec video here:https://streamable.com/1y17lt

TLDW: When I want to automate actions on a site, such as logins or forms, or scraping pages with JavaScript, I manually inspect each web element I need and begin writing a script.

I'm lazy though and had the idea to automate the creation of these automation/testing scripts. And thus "Sillynium" was born.

Sillynium allows you to draw boxes around the elements you require on a page and automatically gets the element and its properties for you. Different coloured rectangles tell the program you want to do different things. Eg: Red means "Input text", Green means "Click button".

When you've finished drawing boxes, a working python selenium script is generated. If you run that script, it does exactly what you told it to do! All this without you writing any code, and losing time.

Working 60 second video link of program in action: https://streamable.com/1y17lt

I made this project over the course of a day as a quick and dirty proof of concept. Its very flawed in its current iteration (taking a screenshot of webpage), so V2 I'm trying to figure out how to draw directly to the browser. Critique it and rip it to shreds. I'm aware of browser recorders btw so I know those exist, this is my twist on automation

Edit: I was not prepared for the amount of interest in this little proof of concept! So thank you all very much for your time you’ve made my day :)

In the interest of transparency and to answer your questions about the code and my plans:

I originally thought about monetisation (web extension etc) after finishing this POC (**sigh i know I’m a greedy bastard) but now I’m in 2 minds about it!

On the one hand I want to make it free for personal use, on the other hand I’d like to potentially charge for commercial use (once its finished).

Final edit 2 The community has spoken, I WILL BE RELEASING THIS VERSION AS OPEN SOURCE! I did some light refactoring, and have added it to a repo which will be shared in a follow up. It shows the POC and the community is welcome to build on the original idea :)

I will create a follow up post with links to repo once I’ve created it, this will be my first project on GitHub so try be nice ;) pretty nervous about sharing my code :D

Thank you all for your patience, interest, and awesome discussions

1.5k Upvotes

171 comments sorted by

View all comments

24

u/SharksPreedateTrees Nov 28 '20

Amazing idea, but the devil is in the details. I noticed your script has s tendency to choose the wrong element (either the parent or the child of the desired element). Your project will suffer for the same reason other recording software(e.g. katalon) fails to generate selenium scripts. Great effort though

6

u/[deleted] Nov 28 '20

Good point (and eye)! This is just the early POC, and you’re probably spot on there! But hoping to iron out the kinks in V2 ;)

8

u/SharksPreedateTrees Nov 28 '20

Just make sure to have realistic expectations. You are attempting to trivialize an entire field of Software Engineering(really QA engineering). Even the original selenium devs tried to make something like this work (selenium IDE) and it fails for 95% of use cases

6

u/[deleted] Nov 28 '20

I understand where you’re coming from 100% Sharks, and I’m really hoping something great comes of it! The way I see it is if it has a similar outcome as software like Selenium IDE thats a good first step, and where I fail others can improve on the idea (or hopefully it inspires new ideas in others). Failing upwards :)