r/dataengineersindia • • Mar 03 '26

General Data Engineer - Roadmap & Guidance

0 Upvotes

Hi everyone, posting transparently as the mentor here.

I’ve spent 15–20 years in tech (Data engineering), and currently work as an associate director at a Santa Clara–based company. Over the past few years, I’ve been mentoring professionals globally who are transitioning into Data Engineering roles.

I’m sharing this here in case it’s helpful for members who feel stuck or directionless.

A pattern I consistently see:

People don’t struggle because they lack ability.

They struggle because they:

Follow random tutorials without structure

Build projects that don’t reflect production systems

Lack clarity on pipelines, warehousing, and real-world architecture

Aren’t interview-ready

Don’t have a roadmap

What I offer is structured, 1:1 mentorship tailored to your background.

This is not a recorded course or bootcamp.

It’s personalized guidance based on where you are and where you want to go.

What’s included:

Personalized transition roadmap

Industry-relevant hands-on projects (healthcare, automobile, etc.)

Resume and profile positioning

10–15 structured mock interviews(apart from the core sessions)

Interview preparation strategy

Networking and referral guidance where appropriate

One recent mentee transitioned into a Data Engineering role at a large payments company from a quality support background.

I maintain a standard pricing structure, but I try to keep it reasonable and flexible for genuinely committed candidates.

If you’re interested, feel free to DM me with:

Your current background

Target timeline

Biggest blocker

Happy to get on a Google Meet call to discuss your roadmap and see if it’s a good fit.

If anyone would like verification, I’m also happy to share my LinkedIn profile via DM for reference.

No pressure, just offering structured guidance to those who need it.


r/dataengineersindia • • Sep 10 '26

Career Question 4.10 YOE, 30 LPA - am I actually doing well or am I falling behind?

0 Upvotes

I’ve been thinking about this a lot lately, and honestly, I can’t figure out if I’m doing okay or if I’m just telling myself that I am.

I have 4 years and 10 months of experience (including internship) and currently make around 30 LPA.

Sometimes I feel like that’s pretty good. If you had told me a few years ago that I’d be making 30 LPA before completing 5 years of experience, I would’ve been very happy with myself.

But then I go on Reddit or LinkedIn and see people with 3–4 years of experience making 40, 50, 60+ LPA, getting amazing offers, moving to big tech companies, etc.
And suddenly I’m like… am I actually behind?

It’s weird because I don’t necessarily feel unhappy with what I make. It’s more of this constant doubt in the back of my mind.
Like:
Am I growing at a good pace?
Should I be earning more by now?
Am I underpaid?
Or am I just comparing myself with a very skewed group of people online?

I know salary isn’t everything. The work you’re doing, your skills, the kind of companies you’re working at, what you’re learning, and where you’re headed probably matter much more in the long run.
But when you’re in the middle of it, it’s really difficult not to use CTC as some kind of benchmark for your progress.

So I’d genuinely like to hear from people who have 7–15+ years of experience.
When you were around 5 years into your career, where were you? And did you feel like you were doing well at that point?

Looking back now, was your salary at that stage actually important, or were there other things that ended up making a much bigger difference to where you are today?

I’m not really looking for people to tell me “30 LPA is good.”
I think I’m trying to figure out something slightly different:
Am I on a good trajectory, or should I be doing something differently at this point in my career?


r/dataengineersindia • • Feb 08 '26

Career Question Is data engineering will be good field for freshers

0 Upvotes

I looking for a internship as an undergrad if people can help how can I start out with data engineering


r/dataengineersindia • • Jul 28 '25

Career Question Is the course worth to take?

0 Upvotes

I am planning in enroll in trendy tech data engineering course by Sumit sir. The course fee is Rs 72000. But I am bit confused? Please help!!


r/dataengineersindia • • Jul 20 '25

Career Question Advice for someone new

Post image
0 Upvotes

Can yall advice what should I do as a beginner my college starts from tomorrow… i learnt basics in python….had done c++ in my previous grades but that too high school level not anything advance….what should I do can someone advice me and can I please dm you


r/dataengineersindia • • May 02 '26

Career Question Help me choose a better offer

7 Upvotes

Currently working with a product based company with LWD in next 7 days
profile - azure data engineer 5.5 yrs exp

CCTC - 18.5 LPA

  1. Elevar Digital Group ( formerly called as ATC telecom)

- 24 LPA - released offer after fractal

  1. Fractal Analytics

- 19.5 LPA

Fractal has simply just matched my current company's offer without any hike. I dont know how to negotiate or what to say further while Elevar has given me a comparitively better offer. The joining of Elevar is prior to that given by Fractal( 2 days before).

Please help me what to do.
We can discuss further on DM


r/dataengineersindia • • May 07 '26

Rant! Views on afaque ahmed

0 Upvotes

If you dont know him, check him out on linkedin and on youtube. He has some brilliant spark content- very in depth and detailed.

But every now and then he shares or likes posts about his community viz. Muslims being victims in some way or the other. Sometimes in ghaza, sometimes in iran and even in india where this guy works and lives. And this is all on linkedin. I'm not talking about his personal social media.

Once he liked the post, paraphrasing - a 30 yo pony rider got shot in pahalgam while protecting a tourist and still people hate muslims.

Really? Because maybe one of them turned out to be good, u want us to believe the ones who were the perpetrators were not Muslims? 25 men were killed for their religion and this guy has victimhood in his heart.

Forget all of this. U do what u want in ur other social media, why bring it to linkedin?


r/dataengineersindia • • Sep 23 '25

Wholesome Moment Important courses for data engineering

1 Upvotes

Hi guys I have data engineer courses and sql courses

If you want pls ping me on telegram

id : User10047


r/dataengineersindia • • Sep 14 '26

Technical Doubt Cognizant Senior Associate salary for 5 years exp java developer

0 Upvotes

I have cleared cognizant interview for java developer and have 5.1 years of exp. My current ctc is 12 lpa fixed and have offer from epam of 17 lpa fixed , How much can i ask cognizant taking 17lpa as counter offer?


r/dataengineersindia • • 19d ago

Career Question Thoughtworks data engineer review

2 Upvotes

Hi,

I am a 5.2 yoe data engineer from Mumbai.

I recently got a very good offer from Thoughtworks Pune and was inclined towards going there.

Is it better than other sbc like cap, ltm, etc

If anybody works there , or has their colleague, could you let me know about growth, perks, wlb, projects, etc

Note: please don't ask ctc and all , the point of this post is to know more about the work culture.


r/dataengineersindia • • 10d ago

Seeking referral Will give first month salary, if anyone helps me get a 15Lpa job.

Post image
0 Upvotes

r/dataengineersindia • • Feb 19 '26

Career Question Career Transformation to GCP Data Engineering : Vaarahi's Proven Way

0 Upvotes

Hey folks,

let me tell you about something that's genuinely changing lives in the cloud world “Vaarahi Cloud Technologies” and their  approach to mastering GCP Data Engineering. It's 2026, data's exploding everywhere, but most people are still stuck watching YouTube tutorials that go nowhere. Vaarahi? They're different they actually get you building real stuff that lands jobs.

Meet Satish Sir - the guy who's been in the trenches

Picture this: Satish Pantula, 21+ years crushing it in IT, plus 10+ years training people just like you. He's not some certificate mill owner. Satish created this "One Institute, One Course" vibe because he got tired of seeing students drown in 50 different techs without mastering any. At Vaarahi (right by JNTU, Hyderabad), it's ALL IN on GCP Data Engineering. Deep, hands-on, job-ready skills no fluff.

830+ people with jobs who can prove it

Real talk: They've placed 830+ students into MNCs with an 81% success rate. We're talking:

  • That friend stuck in non-IT who now pulls 18 LPA handling BigQuery at a Big4

  • Manual testers who went from clicking buttons to owning Dataflow pipelines

  • Freshers whose resumes actually scare recruiters (in a good way)

Satish puts it simply: "We don't teach tools. We build careers." And the numbers back him up to 25 LPA offers rolling in.

What it's REALLY like in the classroom (not your typical training center)

No Zoom fatigue or "watch me code" demos. Vaarahi does full-day classroom sessions (4-5 hours hands-on daily) where you ROLL UP YOUR SLEEVES:

1. You build stuff that breaks (then fix it)
Remember Ravi? Ex-manual tester who panicked at his first Dataflow crash. Three months later? He's fixing production Pub/Sub streams at 22 LPA. You get real end-to-end pipelines: Pub/Sub streams → Dataflow processing → BigQuery analytics → Cloud Composer (Airflow) orchestration. They even crash things on purpose so you learn to debug under pressure.

2. The 2026 Syllabus Built from Job Descriptions, Not Textbooks

Storage that scales: BigQuery partitioning/ML, Cloud SQL optimization, Hadoop HDFS, GCS lifecycle rules, Fivetran connectors

Real processing: Dataflow streaming + batch, Dataproc Spark clusters, Pub/Sub dead-letter queues, Data Fusion ETL, DBT transformations

Pro orchestration: Composer DAGs with failure recovery, Cloud Functions event triggers, Cloud Run scaling, Airflow sensors

AI/ML Integration: Vertex AI AutoML, Google AI Studio, Gen AI pipelines, Agentic AI workflows, BigQuery ML productionization

What gets you hired: Git workflows, JIRA tickets, Agile sprints, Cloud Build CI/CD, IAM enterprise policies

3. They prep you for the interview war zone
70% of tech hires on communication and code. Vaarahi runs brutal mock interviews , resume glow-ups that highlight "Owned 7 production pipelines," LinkedIn makeovers, even salary negotiation scripts. Non-IT folks walk out sounding like they've been engineers for years.

Real talk from students who've been there

"Day 1: I broke Pub/Sub. Day 90: Recruiter asked how I handled quota limits in production." — Priya, non-IT → Data Engineer
"Other institutes gave certificates. Vaarahi gave me a career." — Former ETL dev, now 20 LPA

Why this matters for YOU right now

2026 GCP jobs aren't for certificate collectors anymore. Companies want people who can deploy Day 1 without handholding. That's Vaarahi's edge near JNTU, flexible batches, way more affordable than Ameerpet showrooms, even free GCP credits to practice.

Ready to stop scrolling and start shipping pipelines?
WhatsApp +91-7893337796 or hit up vaarahicloudtechnologies.com
Batches filling fast don't be the guy still watching tutorials in 2026.

Quick FAQs (because I know you're wondering):

  • Never coded? Basic Python/SQL is enough they teach the rest

  • Full-time job? Morning/evening batches, 3-4 months

  • Proof? Ask for the 830+ placement list

Drop a comment: What's your biggest cloud career roadblock? Satish Sir reads these. Let's chat. 


r/dataengineersindia • • Aug 20 '25

General What would be a good salary for data Engineer with 5YOE?

24 Upvotes

I am having 5YOE and recently made a switch. I am making 40LPA all cash. But seeing people in different domain making around 60-70LPA makes me think if I am being paid right. Or should i target for more?


r/dataengineersindia • • Oct 28 '25

Seeking referral 🚨 Urgent Hiring: DevOps Engineer 🚨

3 Upvotes

Company: MatrixOne Tech Solutions – Your gateway to a diverse IT ecosystem
Location: Remote / Pune
Salary: ₹12 – 24 LPA
Contract: 6 Months | IST Timezone

Must-Have Skills:
✔ 8+ yrs DevOps experience
✔ 4+ yrs AWS experience
✔ CI/CD & Automation

Nice-to-Have:
✔ Automation Processes (3 yrs)
✔ Infrastructure Management (3 yrs)

💼 Apply Now! Don’t miss out – Deadline: 45 hrs 37 mins

📩 DM us, send your CV

MatrixOne Tech Solutions – Flexible, cost-effective, and global IT solutions!


r/dataengineersindia • • Apr 11 '25

General Helping folks with Data Engineering doubts — more calls and DMs open this week!

8 Upvotes

Hey folks 👋

I am a Senior Data Engineer working in corporate across product and service base companies.

Lately, I’ve been having 1:1 chats/calls with a bunch of people who want to break into Data Engineering — and honestly, it’s been the best part of my week.

Super grateful that so many of you have been booking calls, asking thoughtful questions, and just being curious about the field.

Whether you’re figuring out where to start, what tools to learn (like ADF, Databricks, PySpark, etc.), or just feeling stuck — I’ve got a couple of ways we can connect:

Book a quick call
A relaxed 1:1 call where we chat about your learning path, tools like ADF/Databricks, or anything you're struggling with.
☕ Caffeine and Conversations

Don’t need a full call?
Just shoot over your questions anytime — I’ll reply as soon as I can.
📬 Ping Me Anytime


r/dataengineersindia • • Feb 05 '25

General I am planning to make 30 people transition into Data Engineering

0 Upvotes

Hey everyone!

I'm starting a mentorship batch for those who want to learn Azure Data Engineering from scratch or level up their skills. This will be a hands-on LIVE online program with real-world projects, interview prep, and practical guidance.

What’s Included?

✅ Azure Data Engineering Fundamentals (Data Factory, Databricks, ADLS, etc.) ✅ ETL & Data Warehousing Concepts ✅ T-SQL for Data Engineering ✅ Real-World Use Cases & Best Practices ✅ Mock Interviews & Resume Review ✅ One Full Project (End-to-End Data Pipeline using ADF and Databricks)

💰 Fees: ₹ 14999/- ⏳ Duration: 1 -2 month - everyday 1hr 📅 Start Date: 10/02/2025

If you're interested, drop a comment or DM me for details! Let’s get you job-ready in Azure DE. 🚀


r/dataengineersindia • • Mar 08 '26

General Data Engineering - 12 Weeks Live sessions

4 Upvotes

https://www.reddit.com/r/dataengineersindia/s/MKL7sGs50M

(For those who are new to my post. Please refer the above link for context)

Hello everyone, thank you so much for the kind response and it was overwhelming tbh to address so many people all at once. That said, apologise if I wasn't able to reply. Starting Saturday I'll be posting weekly updates on how this batch is running. Let's build a community of learners who just want to make it big in the data world..that said, being completely transparent. 4/5 slots are filled, I'm going to extend to 7 slots, so there are 3 more slots left. Text me incase you want to chat more, to avoid missing out on people I'll make it very easy. If this is something you're genuinely interested in, please follow these steps

  1. Text me with your background and intro

  2. Can expect a response within half an hour

  3. Post that we will get on a gmeet call for 30mins to walk you through the projects, tech stacks and content which you will be learning. We will align on the pricing as well on the call ( this is flexible, if I'm being honest)

I'm keeping this slot open till Tuesday EOD. Post that a common whatsapp/discord group will be created for communications and we will be officially kickstarting the session starting this Saturday. Happy to answer questions. Before the overly skeptical dudebros start spamming my comments, I'm more than happy to share testimonials and my linkedin profile for more credibility and happy to connect over call as well in case u need to verify. So please, if you have any constructive feedback, make sure you're professional enough to have a conversation, if not that's completely fine too.

Once again, I'm really grateful for this community and you guys have been kind enough. I can share my profile via DM for you to cross check. Thank you so much.


r/dataengineersindia • • Aug 31 '26

General Data engineering course

0 Upvotes

I have popular data engineering course available. DM me if you’re interested in enrolling


r/dataengineersindia • • Jul 10 '26

Career Question Looking for a Snowflake + dbt Mentor / Job Support (Paid)

0 Upvotes

Hi everyone,

I'm currently working as a Data Engineer on a Snowflake + dbt project and I'm looking for an experienced mentor who can provide practical guidance during my initial months on the project.

I'm comfortable with the fundamentals, but I'm looking for someone who can help me understand real project workflows, task execution, and best practices.

*What I'm Looking For*

Snowflake & dbt project guidance

SQL query optimization and debugging

Understanding project tasks and implementation approach

Code reviews and best practices

Git/Bitbucket workflow guidance

Help with issue debugging and troubleshooting

Guidance until I become confident working independently

*Tech Stack*

Snowflake

dbt Cloud

SQL

Git / Bitbucket

*Availability*

Looking for support for the next 2–3 months

1–2 hours per day (or as required)

IST morning/evening

Tamil-speaking mentors preferred (for easier communication)

*Compensation*

This is a paid mentorship/job support opportunity. Happy to discuss the charges over DM.

If you're interested or know someone with a strong Snowflake and dbt experience, please send me a DM.

Thank you!


r/dataengineersindia • • Sep 21 '26

Career Question v4c.ai DE CTC???

0 Upvotes

Hi guys
I cleared all rounds for the DE role at v4c.ai
Current ctc is 8lpa
How much should i ask ?

How much are DE people there earning there

tell me please

my exp is 9 months


r/dataengineersindia • • Oct 16 '26

Career Question Applied for GATE DA at 29, is it really worth it?

0 Upvotes

Let me set the context, I have around 8 years of experience as a senior data scientist. I have my bachelors in Mechanical Engineering from a Tier 2 college. For most of my career, I've been working remotely, and was in R&D, at my last company. I've built data pipelines, ML architectures and was part of the company which adopted ML systems when gpt hit mainstream, allowing me to build multi classifier systems with GraphRAG, Agents, etc. I've worked in both data engineering and data science.

But lately I feel there is a lot of technical debt that I have owed over the years. So my background in mechanical meant, I missed out on a lot of core subjects in CS. My work has been hands on, and my knowledge is in bits and pieces and not the full picture, with the kind of work pressure at my current firm, I hardly have time to upskill or close those gaps. I feel extremely burnt out most of the days.

I am currently making around 35 LPA. I want to take a career break, and am preparing for gate 2027, which is a trial run, and aiming to crack at 2028 gate. Is this a right move, I also do to teach at couple of universities, so I'd be able to make a side income without a full time job, and my wife works as well. But this would be a big step.

I want people to give your genuine advice. My target is to get into core gpu systems programming. So would be aiming to do optimisations for ML models on the lowest level possible. I feel this route would keep me safe in regards to getting laid off due to AI. I have experience with tensorrt, mlx, etc. But 0 theoretical knowledge.


r/dataengineersindia • • Nov 04 '25

General Today is first day of orientation in my new company..and the things which they told me i didn't like the company..

5 Upvotes

Is it possible to quite the company now??


r/dataengineersindia • • Dec 13 '25

General [Actively Hiring] Senior Data Engineer/ Analytics Engineer (India-Based) $35-$70 per hour.

5 Upvotes

If you will apply the link below 👇🏼

Responsibilities:

Design, build, and maintain DBT models, macros, and tests following modular data modeling and semantic best practices.

Integrate DBT workflows with Snowflake Cortex CLI, enabling:

Feature engineering pipelines

Model training & inference tasks

Automated pipeline orchestration

Monitoring and evaluation of Cortex-driven ML models

Establish best practices for DBT–Cortex architecture and usage patterns.

Collaborate with data scientists and ML engineers to produce Cortex workloads in Snowflake.

Build and optimise CI/CD pipelines for dbt (GitHub Actions, GitLab, Azure DevOps).

Tune Snowflake compute and queries for performance and cost efficiency.

Troubleshoot issues across DBT arti-facts, Snowflake objects, lineage, and data quality.

Provide guidance on DBT project governance, structure, documentation, and testing frameworks.

Required Qualifications

3+ years experience with DBT Core or DBT Cloud, including macros, packages, testing, and deployments.

Strong expertise with Snowflake (warehouses, tasks, streams, materialised views, performance tuning).

Hands-on experience with Snowflake Cortex CLI, or strong ability to learn it quickly.

Strong SQL skills; working familiarity with Python for scripting and DBT automation.

Experience integrating DBT with orchestration tools (Airflow, Dagster, Prefect, etc.).

Solid understanding of modern data engineering, ELT patterns, and version-controlled analytics development.

Nice-to-Have Skills

Prior experience operationalising ML workflows inside Snowflake.

Familiarity with Snow-park, Python UDFs/UDTFs.

Experience building semantic layers using DBT metrics.

Knowledge of MLOps / DataOps best practices.

Exposure to LLM workflows, vector search, and unstructured data pipelines.

Why Join

You will be an hourly contractor through Mercor, working 20–40 hours per week with flexibility.

Direct opportunity to build next-generation Snowflake AI/ML systems with Cortex.

High-impact ownership of DBT and Snowflake architecture across production pipelines.

Work alongside top-tier ML engineers, data scientists, and research teams.

Fully remote, high-autonomy environment focused on innovation, velocity, and engineering excellence.

If you will apply please,

Up vote, Drop a comment and Dm me if you need help.

https://work.mercor.com/jobs/list_AAABmxFsmzLFlXCBQkpBlJ6T?referralCode=72d674ba-d192-4c2f-8126-b5f386fb4e4b&utm_source=share&utm_medium=referral&utm_campaign=job_referral