r/github • • Apr 09 '24

This GitHub tool is much more useful than giving a CV

https://gitroll.io/profile/u7mhNR0QEphODHWTzfgjMydmfRcO2
This GitHub tool is a game-changer!

GitRoll helps you analyze GitHub profiles, saving you heaps of time as an interviewer. Instead of the tediously task of scrolling through GitHub profiles. GitRoll does the hard work for you, providing an in-depth look at a candidate's skills in no time flat.

Here's the scoop on what it does:

  • A deep dive into code quality: This feature is a dream come true for tech geeks like myself. GitRoll doesn't just spot potential bugs or vulnerabilities, it also appreciates the beauty of "tasteful code." It's like having a sommelier for code!

  • Assessing a coder's skills: GitRoll evaluates a coder's skills based on their repositories, giving more weight to recent work. This way, you can easily gauge a candidate's skill level, which makes preparing for the interview a breeze.

  • Insight into language proficiency and open-source contributions: GitRoll gives you a peek into a coder's familiarity with different programming languages and their contributions to open-source projects. For example, it noticed my contributions to facebookresearch/pytorch3d.

And, fingers crossed, I'm hoping they'll soon add features to support compiled languages like C, C++, Java, etc.

0 Upvotes

53 comments sorted by

119

u/TekintetesUr Apr 09 '24

As an interviewer I never, ever check a Github profile unless the applicants themselves asks for it by including it in the CV or something.

Just because someone doesn't have public projects, they might be excellent developers and coworkers.

I have 25+ yoe, and yet I have exactly 1 public project on GH, that hasn't been maintained for years. Making hiring decision based on the candidate's free time activity is stupid.

13

u/DustyPane Apr 09 '24

If you add your GH profile to your application, you're asking me to take it into account in my hiring decision. At that point a tool like Gitroll could be useful to give me a quick overview.

If you do not want me to consider your GH, don't put it into your CV.

27

u/TekintetesUr Apr 09 '24

If you include it. That's literally what I've said.

10

u/serverhorror Apr 09 '24

I disagree, a lot if this is generated fuzz and now has become a self fulfilling prophecy.

One side needs to start and remove the practice from the whole equation.

2

u/DustyPane Apr 09 '24

just as all kinds of bullshit certifications, useless LinkedIn endorsements, ...

I would never hire anybody solely based on their GitHub profile - or any other individual aspect of their CV. It's all just one part of the entire picture I base a hiring decision on

-5

u/davorg Apr 09 '24

Making hiring decision based on the candidate's free time activity is stupid.

I don't agree. In 35 years as a professional programmer, the best developers I've worked with have usually been the ones who spend a lot of their spare time working on personal passion projects.

8

u/TekintetesUr Apr 09 '24

Personal passion projects may not be related to programming.

4

u/LemonDisasters Apr 09 '24

Davorg is talking about passion projects in a GitHub subreddit thread about using GitHub to showcase portfolios. What did you think they were talking about, skiing? Knitting?

5

u/TekintetesUr Apr 09 '24

That's exactly why I've said that you can be an awesome programmer and still do knitting or skiing or whatvever in your free time.

4

u/LemonDisasters Apr 09 '24

That's fair, I'm sorry -- I interpreted your reply with the worst intentions and I shouldn't have.

2

u/Vanadium_V23 Apr 09 '24

I'm passionate about programming and my personal projects aren't hosted on github. 

A job interviewer who doesn't know there are other versions control solutions on the market is a big redflag.

1

u/davorg Apr 09 '24

No of course not. But the ones that make you a better programmer are.

3

u/TekintetesUr Apr 09 '24

Probably. I'm looking for better crewmates who happen to be "good enough" programmers. Most people I've hired have pretty awesome pastimes, only a few of those are related to writing software. But as long as the product pays the bills, I'm fine with that.

3

u/Vanadium_V23 Apr 09 '24

That's me but my projects aren't hosted on github. 

Your idea is like giving job interview points to a racing driver because they drive the most famous sport car brand. 

-1

u/davorg Apr 09 '24

I've said nothing about expecting anyone to use GitHub.

2

u/vn7yee Apr 09 '24

I'm on your side.

0

u/bdzer0 Apr 09 '24

Neither do I.. been in the industry for over 40 years and I have also never been asked for a link to my GitHub account and never reviewed a candidates GH.

0

u/gowithflow192 Apr 09 '24

Many ATS ask for it. Is not uncommon anymore.

18

u/kendrasimmons Apr 09 '24

I feel like this works better for juniors

32

u/pfc-anon Apr 09 '24

So if I don't have my profile as public or my employer has all repos private, this tool fucks me.

1

u/gowithflow192 Apr 09 '24

You shouldn't use the same user account for your work for your employer.

I've worked with team mates who have tried to do that and make their profile look better, I've nipped that in the bud and told them not to mix personal and work.

4

u/pfc-anon Apr 09 '24

May I know why that is? GitHub does a great job of segregating personal and org repos. If you don't login to work, you cannot access your work repos on your personal devices. At the same time publicly your org repos won't be visible.

Switching accounts on the other hand is awful experience like say on a mobile device, I can do quick reviews on my phone app if needed, switching account everytime is a hassle. Or say you use global configs like dotfiles, then it becomes a hassle to keep changes in sync.

GitHub suggests it too:

https://docs.github.com/en/get-started/learning-about-github/types-of-github-accounts#:~:text=Most%20people%20will%20use%20one,we%20suggest%20combining%20the%20accounts.

You can have different keys to sign your work in org and personal too. I actually find it weird people use different accounts for the same thing.

3

u/gowithflow192 Apr 09 '24

There are a ton of discussions about this on Reddit. I take the view that especially for legal reasons I don want one account giving access to both personal and work stuff. I'd rather complete separation.

I know GitHub advises against that. I think that's a bad thing.

2

u/[deleted] Apr 09 '24

I've worked with team mates who have tried to do that and make their profile look better

Or they were just too bored to juggle multiple profiles. Have you ever considered the probability that not 100% of github users think like you?

1

u/gowithflow192 Apr 10 '24

Don't second guess, you weren't there. It was nothing to do with juggling profiles.

11

u/Bloodsucker_ Apr 09 '24

Heya everyone, I barely ever look at your GitHub accounts when interviewing for any level of engineering for my team. I don't care about any of your half baked projects random HelloWorld nor I'd spend my time looking at random code without any context.

TL;DR: GitHub is there to share code so I won't look at it unless you want to share code with me.

9

u/Ni_ph Apr 09 '24

Not many languages supported so it's very limited

1

u/kamil314 Apr 09 '24

Currently supported languages: HTML, CSS, JavaScript, TypeScript, Vue, Kotlin, Jupyter Notebook and Python

lol

7

u/Signal_Lamp Apr 09 '24

Github profiles are simply not a good way to measure the skills of a candidate. There are plenty of people that don't spend the time to make sure their code is committed in git to be shown off. There are also plenty of people like me with half finished projects that simply wanted to explore an idea with no goal in mind.

You can access a candidates skill level by asking questions. Surely, a company with senior staff engineers can assess the quality of a candidate through the answers they provide to open-ended questions

1

u/SP-120 Apr 09 '24

I think it's useful in getting the interview in the first place. After that, it's fair game.

7

u/serverhorror Apr 09 '24

Stop using GitHub and hobbies as a hiring tool. It's a flawed idea to think that you can use this as an accurate reflection of the work a person does.

5

u/TotesMessenger Apr 09 '24

I'm a bot, bleep, bloop. Someone has linked to this thread from another place on reddit:

 If you follow any of the above links, please respect the rules of reddit and don't vote in the other threads. (Info / ^Contact)

3

u/TimJoijers Apr 09 '24

To me it just says the user does not have any scannable repository. My repo is public. What could be the cause?

7

u/TimJoijers Apr 09 '24

Currently supported languages: HTML, CSS, JavaScript, TypeScript, Vue, Kotlin, Jupyter Notebook and Python

I guess that is why. I do C++ mostly.

1

u/JustAStringVariable Apr 20 '24

Same reason for my repos. Another win for C++ :p

1

u/n1co02_ Apr 20 '24

I use typescript most, still can't scan it

3

u/LordAmras Apr 09 '24

Finally the answer to Leetcode nobody wanted

3

u/[deleted] Apr 20 '24

So, how are people writing so secure code? What happens if an idiot uploads his `node_modules`? I see a lot of room for improvement.

5

u/[deleted] Apr 09 '24 edited Sep 19 '25

hospital selective historical slim straight books busy scale support plough

This post was mass deleted and anonymized with Redact

3

u/New_Rhubarb_7527 Apr 09 '24

So, what's your rank?

2

u/[deleted] Apr 09 '24 edited Sep 19 '25

selective capable offbeat flag follow head imagine wipe fuzzy enjoy

This post was mass deleted and anonymized with Redact

2

u/gowithflow192 Apr 09 '24

Do you work for them?

I am familiar with this product and I enjoy looking at GitHub profiles but I'm also aware of the drawbacks of this as an assessment method.

I feel like this company's best bet is to get bought out by an ATS company who can integrate the scoring functionality into their own platform.

As a separate paid SaaS product, I think it's doomed to failure. It's such a narrow and a single assessment point.

2

u/saamenerve Apr 20 '24

Linus Torvald is an intern front-end developer according to it

2

u/james2432 Apr 20 '24

This tool is horrible and wrong on so many levels(the results)

big L if anyone uses this and thinks it's an accurate representation of anything

2

u/kristopolous Dec 14 '24

These results are nonsense. They'll scan a forked repository and then ding the user who forked it for bugs inside the code that was forked.

They also run dumb linters on the code and then dings the users for all the false positives that dumb linters make.

If this was widely being used, it's extremely gameable. All you have to do is fork a few repositories that it thinks is amazing and it will say you are an amazing coder.

We're talking going from an F->A in under 45 seconds of effort

1

u/brianw0924 Apr 11 '24

Why does everyone keep downplaying this tool?

You could simply ignore the false negative results and focus on candidates with high scores. For those with lower rankings, you can evaluate their skills from other perspectives.

1

u/NatoBoram Apr 23 '24

You know damn well that someone is going to ignore more skilled candidates because they don't farm the algorithm

1

u/RiddleGull May 08 '24

The Intelligence is kinda lacking in this so called "AI" tool.

The user does not have any scannable repository

Whilst I have 26 repos (13 of them public) on my github profile.

1

u/Weird-Shake-2896 May 28 '24

Is it just me or is this thing false detecting bugs in everything I write?

My example: I have a server written in Node.js that intiates a worker to compile a markdown file if it isn't already compiled.

My Code:

if (!fs.readdirSync("./pages/help/markdown").includes("markdown.html")) new Worker("./worker.js");

The "bug":

Either remove this useless object instantiation of "Worker" or use it.

My Question: Isn't there any smarter algorithm to avoid false bugs like these? I mean I just want to initiate a worker for example which doesn't need to have any data transfered to it afterwards. Can't it just understand how worker threads in Node.js work? Apparently, I have 16 "bugs" in my newest repository, but none of them are actual bugs. What's the use of it to find bugs in your code if it can't do it. I find real bugs regularly and unsurprisingly none of them have been found by this tool.

My conclusion: This tool is definitely not ready to be used in real case scenarios since it doesn't really help me in anything right now. Apparently, I'm an embedded systems developer too? I see lots of other people in the comments too who say they've been evaluated as an embedded systems dev which doesn't make any sense to me since I've never touched anything in that area. I don't currently see how this is supposed to replace giving a CV to be honest. I see the potential this has, but sorry: This has been published before it had any real life use case.

1

u/HariSekhon Dec 03 '24

Very interesting.

I just tried it and got heavily penalized on Contribution Score since most of my code is in my own repos instead of famous projects... 1.0/5 - they literally couldn't score me any lower.

I wonder what a grade of "S" means?

https://gitroll.io/profile/u5eNfjd3L4KXzBVekMrxkLvCEmYt2

The Languages and Tech Stacks breakdown donut charts are quite nice to look at though:

https://gitroll.io/profile/u5eNfjd3L4KXzBVekMrxkLvCEmYt2/languages

https://gitroll.io/profile/u5eNfjd3L4KXzBVekMrxkLvCEmYt2/stacks

I've updated my GitHub readme profile with small icons of its results and the full badge at the bottom as my GitHub profile is probably already a bit too busy:

https://github.com/HariSekhon

1

u/BAMartin1618 Apr 19 '25

It's pretty shit. I ran a couple profiles of people that I know are cracked developers and it either said they have no scannable repositories or put them at an intern-level rating.

I think this is just a really bad way to hire people. People do their best work at work and can't make their code publicly available for obvious reasons. You can't expect them to dedicate their weekends to building professional-grade projects to convince some recruiter that they can code. That's what a resume and OAs are for.

If anything, someone should make a tool that counters this bullshit by scripting and populating your GitHub with complex, polished projects.

1

u/Leading-Gas3682 Apr 28 '25

Great way to steal source code.