r/dataengineeringjobs • u/venkateshan_ • Aug 09 '25
Roast my Data Engineer resume
Roast me
r/dataengineeringjobs • u/venkateshan_ • Aug 09 '25
Roast me
r/dataengineeringjobs • u/Dom775 • Sep 02 '25
🔍 I'm looking for a Pro in Data & Analytics with a very particular set of skills. If you can help me build Microsoft cloud data platforms, please read along and send me a message! 📩
The target audience for this job posting is someone who can analyze our current projects, look a few steps ahead, and proactively manage their own backlog.
This role may be a perfect fit if you'd like to:
Challenge your full-stack data knowledge 📚
Get a backstage pass to a variety of data projects 🎭
Have lots of time flexibility and location independence 🌍
Get paid well for your specialized skillset 🧠
The position is intended to scale quickly if cooperation is successful. Aiming for full involvement, approximately 30 hours per week.
A great candidate will have:
Owned an end-to-end process from data sources connectivity to distributing reports
Seen firsthand which core components make an enterprise data warehouse tick
Interacted with various parts of the Microsoft Power Platform
Day to day, you should be able to:
Provision cloud infrastructure, secure it, and grant delimited access
Apply software development practices to data on Azure
Translate between SQL and Python
Configure a Spark pool and optimize job performance
r/dataengineeringjobs • u/simms4546 • Jul 23 '26
I know a lead for AI engineering job openings for freshers and upto 3 years of experience.
AI knowledge is a must. Degree in any AI related engineering is preferred.
Job location: Near Chennai.
Conditions apply* (Backdoor - 2L)
Salary range 20k - 30k. (INR)
15 vacancies available.
Interested people can DM.
Edit:
I have added the expected payment for backdoor process so that people who are not interested can simply ignore instead of flooding my DM
r/dataengineeringjobs • u/Old-Bag236 • Aug 01 '26
Most of what I know about data engineering, I learned from things that were already broken.
A client came to me with 18 months of history missing from their Kafka pipeline and no error trail. A failed migration had been dropping events on partial failure, silently, for a year and a half. Finding that was the easy half. Recovering it meant dealing with a 200M+ row Cassandra table whose scans locked the cluster before they ever finished. I ended up writing a Python framework that split the keyspace along Murmur3 token-ring boundaries into range slices that could be queried independently, which sidestepped full-table scans entirely. A job that had been failing outright became a stable multi-hour backfill with zero production impact
That’s the kind of work I’m good at, and it’s the kind of work I’m looking for more of.
Quick profile
• 5+ years as a data engineer. Currently contracting for US and European clients.
• Python is my primary language. SQL close behind.
• Stack: Snowflake, dbt Core, Apache Airflow, Spark, Kafka, Fivetran, AWS DMS, AWS (S3, Glue, EMR, Lambda, Redshift, Athena, IAM), Terraform/Terragrunt, Docker, Kubernetes, Jenkins, GitLab CI.
• AWS Certified Developer – Associate + Cloud Practitioner.
• Three first-authored peer-reviewed papers in Springer Nature journals. Which mostly means I can write clearly for people who will check my reasoning.Some things I’ve actually built
Greenfield AWS data lake. Architected the whole thing from nothing and led the design reviews that set the storage and partitioning standards. S3/Parquet partitioned by source, date and region, Glue Catalog for metadata, EMR-scheduled Spark for transformation, Snowflake as the consumption warehouse. Same Terraform module set deployed across three countries with no duplicated code. Partitioning and columnar pruning cut Athena/Spark scan volumes and compute cost substantially against the raw-file baseline.
Snowflake + dbt analytics platform for an AI product. Their agent product was emitting dense OpenTelemetry logs into a void, so nobody could see how it was failing. I replaced a brittle nightly script with scheduled Fivetran ingestion, wrote the Python connectors, then built a three-layer dbt project: staging to normalise messy schemas, intermediate to reconstruct sessions and interaction chains out of raw event streams, marts exposing KPIs and error rates to dashboards. Data freshness went from ~24 hours to under 60 seconds.
Batch orchestration with Airflow. Multiple source systems landing on their own schedules, which mostly meant landing late. Built sensor-based DAGs that held downstream tasks until upstream data had actually arrived instead of assuming a fixed window. Killed the manual reruns and made pipeline completion something downstream could actually trust.
Azure SQL to Snowflake migration. The interesting part wasn’t the migration, it was the dbt validation layer I built afterward that compared row counts, null rates and key business aggregates between source and target. I wouldn’t let anything downstream cut over until every discrepancy was explained. I’d rather delay a cutover than explain a wrong number afterwards.
CDC platform at scale. AWS DMS to Kafka, replicating MariaDB change events across topics with ledger-based SHA dedup for exactly-once semantics downstream. The Kubernetes-native replication service sustains tens of thousands of change events per second while remapping schemas in flight, so upstream schema changes stop breaking downstream consumers.
Infrastructure tooling. Collapsed a 47-step manual runbook into one idempotent command. Automated Snowflake schema provisioning, Glue job scaffolding, Kafka topic creation and IAM role binding. New environments now stand up from a config file.
On timezones
I’m based in South Korea (KST, UTC+9) and I already run engagements for US and European clients, so I’m used to bending my schedule around other people’s business hours. I’ll do EST, PST, CET, GMT, whatever the team actually runs on. This isn’t a “I’ll try my best” thing, it’s just how I’ve worked for the last two years. If your standup is at 9am in New York, I’ll be at it.
Why I’m looking hard right now
I’m finishing up a PhD (flood prediction using ensemble ML and deep learning, which is where the papers come from), and I’m close enough to the end that I’m actively lining up what comes next. For the last couple of years I’ve been splitting my attention between research and contract work. I’m looking to stop splitting it. That means I’m genuinely motivated rather than casually browsing, and it means I’m available now on contract with capacity to go full-time as I wrap up.
The research background isn’t just a line on a CV either. Building ML pipelines on multi-decade climate datasets, reproducing results other people will scrutinise, and writing up limitations honestly turns out to be very good training for data engineering. Both jobs are mostly about not fooling yourself.
What I’m after
Remote. Contract or full-time, both work. Data platform work, pipeline building, or the messy diagnostic stuff nobody else wants to own. I’m happy on greenfield builds and equally happy inheriting something that’s broken and figuring out why.
CV, GitHub and references available on request. Comment or DM and I’ll get back to you quickly.
GitHub: github.com/harksodje
LinkedIn: linkedin.com/in/adisa-akinsoji
r/dataengineeringjobs • u/Simple-Particular323 • Aug 21 '24
I [F29] currently in India as Data Engineer, am seeing a trend remote only (US) I am looking for remote only senior data engineering jobs Be it in Europe, US or anywhere but fully remote. What all portals can I check? Need salary range $70k to $110k.
r/dataengineeringjobs • u/Uniastrolysis • Dec 04 '25
Hello everyone so our company is starting a new project. We are trying to fine tune an older version of chat gpt 3.5 into a new and revised model that will be optimized for specific tasks. We will be integrating multiple other models include Llava for image generation, Llama 3 (if they do provide marketing privellages)
Therefore we need a lot of data for this job. We have already started gathering the hardware and pretty much the work is going to be remote. Let me know if you are interested in the job by dropping me a quick DM
It will be an hourly paid job. The pay would be decided according to experience and skill and the work hours would be flexible. The expected pay range will be $10/hr to $30/hr
Drop me a DM to learn more. Thanks!
r/dataengineeringjobs • u/CopyInteresting4394 • Jul 05 '26
After done with my last job i learned new skill and made projects hope this will suits any available job description :)
r/dataengineeringjobs • u/Key_Advertising_7918 • Aug 20 '26
Hii guys, so I am a recent graduate of the 2026 batch I'm having a data engineering interview for an internship, the problem is I am a beginner extremely beginner in this domain, even currently I am an sde intern but because I find this opportunity really good and I want to get into this one because I want to change my toxic job anyhow and ik I can learn and work, in college I have studied few of things my sql is decent because it comes in my domain but still I need to practice...... I need guidance and genuine help what can I do immediately that can help .......my interview is on Saturday noon 😭😭😭😭
r/dataengineeringjobs • u/PossessionNatural769 • Jul 02 '25
Hi all, i am looking for for a part time job in (aws, snowflake, python sql & gen ai) to be able to do asking work my regular job.
Any leads or referral would need helpful
r/dataengineeringjobs • u/Scared-Car-8106 • Oct 20 '25
Check out our ML team TechSydney profile: https://www.techsydney.com.au/u/taher-nematollahi
r/dataengineeringjobs • u/dchoi823 • May 17 '22
if anyone is interested in taking a look, my firm is hiring: https://www.unifyconsulting.com/
we are hiring in the bay area, seattle, oregon, texas, illinois, utah, dakota's and missouri. if you'd like to connect directly, feel free to DM me or shoot me an email to david-dot-choi AT unifyconsulting-dot-com
r/dataengineeringjobs • u/Vegetable-Bet-9279 • Nov 04 '25
I have 3 years of good experience as Data Engineer. I’m struggling a lot to find something. Applied for a lot and only got called for 3 interviews. If someone please could help I would appreciate very much. I know the referrals are easier although I don’t have a good network in Dublin
r/dataengineeringjobs • u/DataEngineeringJobs • Mar 10 '25
r/dataengineeringjobs • u/Aggressive_Valen_669 • 21d ago
Data engineering role tech stacks requirement
r/dataengineeringjobs • u/satish_karuturi • 20d ago
Hi everyone!
My organisation is looking for an experienced Azure Data Engineer (10-12 years of experience) to join our team.
Required technical skills:
- Microsoft Azure
- PySpark
- Azure Data Factory (ADF)
- Apache Airflow
- Azure Databricks
We’re looking for someone with strong hands-on experience in data engineering and building scalable data pipelines using the above technologies.
If you’re interested or know someone who might be a good fit, please feel free to DM me for more details.
Thanks!
r/dataengineeringjobs • u/Inevitable_City_8912 • Apr 27 '25
Hi, I am a Data Engineer with 1 year of experience. I have the following skills: AWS, Iceberg, PySpark, Docker, SQL, Python, and Kafka.
Currently, I am working in an MNC (a German company). I joined at a package of 4.5 LPA (3.9 LPA in-hand after deductions like PF, tax, and canteen charges).
In my 1-year journey: I reduced their AWS costs by 70%. I optimized PySpark scripts, resulting in a 30% monthly cost reduction for one project. I completed multiple projects before deadlines without any formal training or KT (Knowledge Transfer) sessions. During the appraisal cycle, my expectation was to match the market valuation for my job role. However, during the discussion, my manager said things like "I know your worth" and "I will take care." But after the appraisal, I saw only a 12% hike in my compensation — it increased to 5 LPA (4.5 LPA in-hand). Could you please tell me: What should be the market valuation for my profile? Is this hike fair or not? What should be the expected compensation for my skills and performance? My personal expectation is around 12–14 LPA. Please guide me on this.
r/dataengineeringjobs • u/InevitableClassic261 • Aug 23 '26
Hi everyone,
We wanted to share something a little different today.
We created a short BricksNotes anthem for data professionals who are learning data engineering while balancing work, family, projects, certifications, and career goals.
It is not a technical tutorial.
It is more of a small motivation piece for the people who keep showing up quietly.
After work.
During weekends.
Before interviews.
Before certification exams.
Between responsibilities.
A lot of data engineering learning can feel heavy because there are so many topics:
SQL
PySpark
Databricks
Pipelines
Data modeling
Data quality
Performance tuning
Cloud tools
Now data + AI and agents
The idea behind BricksNotes is simple:
Learn one concept clearly.
Practice it.
Build confidence.
Then move to the next one.
One brick at a time.
Here is the song:
https://youtu.be/fVLYC9EIrFg?si=O9nDv4cUI694DRP3
Would love to hear your thoughts.
Do you think learning platforms should create more motivational content like this, or should they stay focused only on tutorials and technical guides?
r/dataengineeringjobs • u/EitherElevator652 • Aug 14 '25
I’m based in India and want to work as a remote Data Engineer for companies abroad. What are the typical requirements, skills, or certifications needed, and where should I start looking?
r/dataengineeringjobs • u/RobDoesData • Jul 08 '25
Hi all,
I'm a US based data professional who runs a data engineering, data analytics, and Microsoft Azure consulting company.
With a decade of experience we are well suited to solve short term problems and help you achieve your long term goals. We are well versed in best practices and take pride in providing better knowledge transfer than almost anyone else!
We are comfortable working remotely and serve clients across Europe and the US.
If you need a consultant we offer a free initial consultation. Check out our website www.atlonglastanalytics.com for our services and to book a free discovery call with us!
Feel free to direct message me here on Reddit and I'm happy to share my LinkedIn profile with you.
r/dataengineeringjobs • u/throwaway20190928 • May 12 '25
I’m a senior data engineer with 8 YOE, and over the past 2 years I’ve actually been splitting my time between being a senior data engineer and a level 1 software engineer (same company but they let me join a second team because I was interested). I’ve been interested in the adult entertainment industry ever since I learned about its effect on growth of technology (e.g., VHS v Betamax) and I’m at the point where I want to work in a field I’m interested in and believe in for the rest of my career.
My question is, does anyone know if there are jobs in the USA (ideally west coast), and if so how to find them? The only things I’ve been able to find are Aylo.com (formally Mind Geek), but they appear to only be outside the USA; or NSFWJobs.com, but that site doesn’t feel completely legitimate / maintained.
r/dataengineeringjobs • u/Less_Interaction6863 • Sep 18 '25
Hi i am working in a startup and our company has 6 openings mostly data engineer roles . Its completely 9 hr daily office rule and no work from homes . If anyone is interested ping me your resumes will refer you .
r/dataengineeringjobs • u/AskAnAIEngineer • Oct 16 '25
We’re helping top data engineers land roles at some of the fastest-growing AI startups and tech companies in the US.
Who We’re Looking For:
3+ years of experience as a Data Engineer
Strong with Python, SQL, and modern data stacks (Airflow, dbt, Spark, Kafka, etc.)
Experience building and maintaining scalable pipelines or data infrastructure
Bonus: experience with cloud platforms (AWS, GCP, Azure) and streaming data systems
Why Apply:
One profile → multiple interview invites
Transparent salaries & equity details
Dedicated recruiter support
100% free for engineers
Details:
🌎 Remote (US only), hybrid options in SF or NYC
💰 $150K–$250K+ base + equity for senior roles
👉 Apply here: talent.fonzi.ai
If you’re a data engineer ready for a faster, higher-signal way to find your next role, this is your shortcut to top-tier companies.
r/dataengineeringjobs • u/mkithan • Jun 16 '26
Mercor is hiring Data Engineers (Coding Agent Experience) to evaluate how well AI coding agents handle real-world data infrastructure, pipelines, and large-scale data engineering workflows.
Opportunity highlights:
$80 per/hr equivalent
Remote Hourly Contract
$400 per accepted task
Typical tasks take 2-3 hours after ramp-up
What you'll dive into:
Use AI coding agents to solve and evaluate complex data engineering tasks
Review implementations involving ETL pipelines, data warehouses, analytics platforms, and distributed data systems
Identify bugs, scalability bottlenecks, and failure modes • Compare outputs from multiple frontier AI models
Eligibility:
2+ years of professional data engineering experience
Hands-on experience building ETL pipelines, data warehouses, or distributed data platforms
Regular use of AI coding tools like Cursor, Claude Code, Codex, Windsurf, or Gemini CLI
Strong judgment in evaluating data infrastructure and pipeline implementations
Nice to bring: Experience operating production-scale data platforms
Apply now: https://t.mercor.com/KRpTi
Ideal for Data Engineers, Analytics Engineers, and Data Platform Engineers
r/dataengineeringjobs • u/Significant_Role_52 • Apr 13 '26
Don’t get me wrong—I still think every organization will need engineers to effectively use these tools. But instead of maintaining teams of 20+, you can likely reduce headcount to just 2–3 top performers and still achieve greater output by leveraging tools like Kiro or Claude Code. Ignoring the warnings from Elon Musk and Dario Amodei feels like denial at this point.
Pretty scared at this point to be competing with the top talent for a job. People have no clue whats coming and the agents were able to build out quickly.
Again its not going to replace all, but I agree with an unemployment rate at 20-30 (probs higher) %. Those who say ai slop - you are not prompting it right from my experience