r/github • u/charliie_chiu • Apr 09 '24
This GitHub tool is much more useful than giving a CV
https://gitroll.io/profile/u7mhNR0QEphODHWTzfgjMydmfRcO2
This GitHub tool is a game-changer!
GitRoll helps you analyze GitHub profiles, saving you heaps of time as an interviewer. Instead of the tediously task of scrolling through GitHub profiles. GitRoll does the hard work for you, providing an in-depth look at a candidate's skills in no time flat.
Here's the scoop on what it does:
A deep dive into code quality: This feature is a dream come true for tech geeks like myself. GitRoll doesn't just spot potential bugs or vulnerabilities, it also appreciates the beauty of "tasteful code." It's like having a sommelier for code!
Assessing a coder's skills: GitRoll evaluates a coder's skills based on their repositories, giving more weight to recent work. This way, you can easily gauge a candidate's skill level, which makes preparing for the interview a breeze.
Insight into language proficiency and open-source contributions: GitRoll gives you a peek into a coder's familiarity with different programming languages and their contributions to open-source projects. For example, it noticed my contributions to facebookresearch/pytorch3d.
And, fingers crossed, I'm hoping they'll soon add features to support compiled languages like C, C++, Java, etc.
18
32
u/pfc-anon Apr 09 '24
So if I don't have my profile as public or my employer has all repos private, this tool fucks me.
1
u/gowithflow192 Apr 09 '24
You shouldn't use the same user account for your work for your employer.
I've worked with team mates who have tried to do that and make their profile look better, I've nipped that in the bud and told them not to mix personal and work.
4
u/pfc-anon Apr 09 '24
May I know why that is? GitHub does a great job of segregating personal and org repos. If you don't login to work, you cannot access your work repos on your personal devices. At the same time publicly your org repos won't be visible.
Switching accounts on the other hand is awful experience like say on a mobile device, I can do quick reviews on my phone app if needed, switching account everytime is a hassle. Or say you use global configs like dotfiles, then it becomes a hassle to keep changes in sync.
GitHub suggests it too:
You can have different keys to sign your work in org and personal too. I actually find it weird people use different accounts for the same thing.
3
u/gowithflow192 Apr 09 '24
There are a ton of discussions about this on Reddit. I take the view that especially for legal reasons I don want one account giving access to both personal and work stuff. I'd rather complete separation.
I know GitHub advises against that. I think that's a bad thing.
2
Apr 09 '24
I've worked with team mates who have tried to do that and make their profile look better
Or they were just too bored to juggle multiple profiles. Have you ever considered the probability that not 100% of github users think like you?
1
u/gowithflow192 Apr 10 '24
Don't second guess, you weren't there. It was nothing to do with juggling profiles.
11
u/Bloodsucker_ Apr 09 '24
Heya everyone, I barely ever look at your GitHub accounts when interviewing for any level of engineering for my team. I don't care about any of your half baked projects random HelloWorld nor I'd spend my time looking at random code without any context.
TL;DR: GitHub is there to share code so I won't look at it unless you want to share code with me.
9
u/Ni_ph Apr 09 '24
Not many languages supported so it's very limited
1
u/kamil314 Apr 09 '24
Currently supported languages: HTML, CSS, JavaScript, TypeScript, Vue, Kotlin, Jupyter Notebook and Python
lol
7
u/Signal_Lamp Apr 09 '24
Github profiles are simply not a good way to measure the skills of a candidate. There are plenty of people that don't spend the time to make sure their code is committed in git to be shown off. There are also plenty of people like me with half finished projects that simply wanted to explore an idea with no goal in mind.
You can access a candidates skill level by asking questions. Surely, a company with senior staff engineers can assess the quality of a candidate through the answers they provide to open-ended questions
1
u/SP-120 Apr 09 '24
I think it's useful in getting the interview in the first place. After that, it's fair game.
7
u/serverhorror Apr 09 '24
Stop using GitHub and hobbies as a hiring tool. It's a flawed idea to think that you can use this as an accurate reflection of the work a person does.
5
u/TotesMessenger Apr 09 '24
3
u/TimJoijers Apr 09 '24
To me it just says the user does not have any scannable repository. My repo is public. What could be the cause?
7
u/TimJoijers Apr 09 '24
Currently supported languages: HTML, CSS, JavaScript, TypeScript, Vue, Kotlin, Jupyter Notebook and Python
I guess that is why. I do C++ mostly.
1
3
3
Apr 20 '24
So, how are people writing so secure code? What happens if an idiot uploads his `node_modules`? I see a lot of room for improvement.
5
Apr 09 '24 edited Sep 19 '25
hospital selective historical slim straight books busy scale support plough
This post was mass deleted and anonymized with Redact
3
u/New_Rhubarb_7527 Apr 09 '24
So, what's your rank?
2
Apr 09 '24 edited Sep 19 '25
selective capable offbeat flag follow head imagine wipe fuzzy enjoy
This post was mass deleted and anonymized with Redact
2
u/gowithflow192 Apr 09 '24
Do you work for them?
I am familiar with this product and I enjoy looking at GitHub profiles but I'm also aware of the drawbacks of this as an assessment method.
I feel like this company's best bet is to get bought out by an ATS company who can integrate the scoring functionality into their own platform.
As a separate paid SaaS product, I think it's doomed to failure. It's such a narrow and a single assessment point.
2
2
u/james2432 Apr 20 '24
This tool is horrible and wrong on so many levels(the results)
big L if anyone uses this and thinks it's an accurate representation of anything
2
u/kristopolous Dec 14 '24
These results are nonsense. They'll scan a forked repository and then ding the user who forked it for bugs inside the code that was forked.
They also run dumb linters on the code and then dings the users for all the false positives that dumb linters make.
If this was widely being used, it's extremely gameable. All you have to do is fork a few repositories that it thinks is amazing and it will say you are an amazing coder.
We're talking going from an F->A in under 45 seconds of effort
1
u/brianw0924 Apr 11 '24
Why does everyone keep downplaying this tool?
You could simply ignore the false negative results and focus on candidates with high scores. For those with lower rankings, you can evaluate their skills from other perspectives.
1
u/NatoBoram Apr 23 '24
You know damn well that someone is going to ignore more skilled candidates because they don't farm the algorithm
1
u/RiddleGull May 08 '24
The Intelligence is kinda lacking in this so called "AI" tool.
The user does not have any scannable repositoryWhilst I have 26 repos (13 of them public) on my github profile.
1
u/Weird-Shake-2896 May 28 '24
Is it just me or is this thing false detecting bugs in everything I write?
My example: I have a server written in Node.js that intiates a worker to compile a markdown file if it isn't already compiled.
My Code:
if (!fs.readdirSync("./pages/help/markdown").includes("markdown.html")) new Worker("./worker.js");The "bug":
Either remove this useless object instantiation of "Worker" or use it.My Question: Isn't there any smarter algorithm to avoid false bugs like these? I mean I just want to initiate a worker for example which doesn't need to have any data transfered to it afterwards. Can't it just understand how worker threads in Node.js work? Apparently, I have 16 "bugs" in my newest repository, but none of them are actual bugs. What's the use of it to find bugs in your code if it can't do it. I find real bugs regularly and unsurprisingly none of them have been found by this tool.
My conclusion: This tool is definitely not ready to be used in real case scenarios since it doesn't really help me in anything right now. Apparently, I'm an embedded systems developer too? I see lots of other people in the comments too who say they've been evaluated as an embedded systems dev which doesn't make any sense to me since I've never touched anything in that area. I don't currently see how this is supposed to replace giving a CV to be honest. I see the potential this has, but sorry: This has been published before it had any real life use case.
1
u/HariSekhon Dec 03 '24
Very interesting.
I just tried it and got heavily penalized on Contribution Score since most of my code is in my own repos instead of famous projects... 1.0/5 - they literally couldn't score me any lower.
I wonder what a grade of "S" means?
https://gitroll.io/profile/u5eNfjd3L4KXzBVekMrxkLvCEmYt2
The Languages and Tech Stacks breakdown donut charts are quite nice to look at though:
https://gitroll.io/profile/u5eNfjd3L4KXzBVekMrxkLvCEmYt2/languages
https://gitroll.io/profile/u5eNfjd3L4KXzBVekMrxkLvCEmYt2/stacks
I've updated my GitHub readme profile with small icons of its results and the full badge at the bottom as my GitHub profile is probably already a bit too busy:
1
u/BAMartin1618 Apr 19 '25
It's pretty shit. I ran a couple profiles of people that I know are cracked developers and it either said they have no scannable repositories or put them at an intern-level rating.
I think this is just a really bad way to hire people. People do their best work at work and can't make their code publicly available for obvious reasons. You can't expect them to dedicate their weekends to building professional-grade projects to convince some recruiter that they can code. That's what a resume and OAs are for.
If anything, someone should make a tool that counters this bullshit by scripting and populating your GitHub with complex, polished projects.
1
119
u/TekintetesUr Apr 09 '24
As an interviewer I never, ever check a Github profile unless the applicants themselves asks for it by including it in the CV or something.
Just because someone doesn't have public projects, they might be excellent developers and coworkers.
I have 25+ yoe, and yet I have exactly 1 public project on GH, that hasn't been maintained for years. Making hiring decision based on the candidate's free time activity is stupid.