r/dataengineeringjobs • • Aug 09 '25

Roast my Data Engineer resume

Post image
1 Upvotes

Roast me


r/dataengineeringjobs • • Sep 02 '25

Looking for a Pro in Data & Analytics

0 Upvotes

🔍 I'm looking for a Pro in Data & Analytics with a very particular set of skills. If you can help me build Microsoft cloud data platforms, please read along and send me a message! 📩

The target audience for this job posting is someone who can analyze our current projects, look a few steps ahead, and proactively manage their own backlog.

This role may be a perfect fit if you'd like to:

  1. Challenge your full-stack data knowledge 📚

  2. Get a backstage pass to a variety of data projects 🎭

  3. Have lots of time flexibility and location independence 🌍

  4. Get paid well for your specialized skillset 🧠

The position is intended to scale quickly if cooperation is successful. Aiming for full involvement, approximately 30 hours per week.

A great candidate will have:

  • Owned an end-to-end process from data sources connectivity to distributing reports

  • Seen firsthand which core components make an enterprise data warehouse tick

  • Interacted with various parts of the Microsoft Power Platform

Day to day, you should be able to:

  • Provision cloud infrastructure, secure it, and grant delimited access

  • Apply software development practices to data on Azure

  • Translate between SQL and Python

  • Configure a Spark pool and optimize job performance


r/dataengineeringjobs • • Jul 23 '26

[Hiring] AI engineers. Freshers and upto 3 years of Exp only.

0 Upvotes

I know a lead for AI engineering job openings for freshers and upto 3 years of experience.

AI knowledge is a must. Degree in any AI related engineering is preferred.

Job location: Near Chennai.

Conditions apply* (Backdoor - 2L)

Salary range 20k - 30k. (INR)

15 vacancies available.

Interested people can DM.

Edit:

I have added the expected payment for backdoor process so that people who are not interested can simply ignore instead of flooding my DM


r/dataengineeringjobs • • Aug 01 '26

[FOR HIRE] Senior Data Engineer — Python, Snowflake, dbt, Spark, Kafka, AWS. 5+ yrs, remote, any timezone. Wrapping up a PhD and going full-time.

0 Upvotes

Most of what I know about data engineering, I learned from things that were already broken.

A client came to me with 18 months of history missing from their Kafka pipeline and no error trail. A failed migration had been dropping events on partial failure, silently, for a year and a half. Finding that was the easy half. Recovering it meant dealing with a 200M+ row Cassandra table whose scans locked the cluster before they ever finished. I ended up writing a Python framework that split the keyspace along Murmur3 token-ring boundaries into range slices that could be queried independently, which sidestepped full-table scans entirely. A job that had been failing outright became a stable multi-hour backfill with zero production impact

That’s the kind of work I’m good at, and it’s the kind of work I’m looking for more of.

Quick profile

•	5+ years as a data engineer. Currently contracting for US and European clients.

•	Python is my primary language. SQL close behind.

•	Stack: Snowflake, dbt Core, Apache Airflow, Spark, Kafka, Fivetran, AWS DMS, AWS (S3, Glue, EMR, Lambda, Redshift, Athena, IAM), Terraform/Terragrunt, Docker, Kubernetes, Jenkins, GitLab CI.

•	AWS Certified Developer – Associate + Cloud Practitioner.

•	Three first-authored peer-reviewed papers in Springer Nature journals. Which mostly means I can write clearly for people who will check my reasoning.

Some things I’ve actually built

Greenfield AWS data lake. Architected the whole thing from nothing and led the design reviews that set the storage and partitioning standards. S3/Parquet partitioned by source, date and region, Glue Catalog for metadata, EMR-scheduled Spark for transformation, Snowflake as the consumption warehouse. Same Terraform module set deployed across three countries with no duplicated code. Partitioning and columnar pruning cut Athena/Spark scan volumes and compute cost substantially against the raw-file baseline.

Snowflake + dbt analytics platform for an AI product. Their agent product was emitting dense OpenTelemetry logs into a void, so nobody could see how it was failing. I replaced a brittle nightly script with scheduled Fivetran ingestion, wrote the Python connectors, then built a three-layer dbt project: staging to normalise messy schemas, intermediate to reconstruct sessions and interaction chains out of raw event streams, marts exposing KPIs and error rates to dashboards. Data freshness went from ~24 hours to under 60 seconds.

Batch orchestration with Airflow. Multiple source systems landing on their own schedules, which mostly meant landing late. Built sensor-based DAGs that held downstream tasks until upstream data had actually arrived instead of assuming a fixed window. Killed the manual reruns and made pipeline completion something downstream could actually trust.

Azure SQL to Snowflake migration. The interesting part wasn’t the migration, it was the dbt validation layer I built afterward that compared row counts, null rates and key business aggregates between source and target. I wouldn’t let anything downstream cut over until every discrepancy was explained. I’d rather delay a cutover than explain a wrong number afterwards.

CDC platform at scale. AWS DMS to Kafka, replicating MariaDB change events across topics with ledger-based SHA dedup for exactly-once semantics downstream. The Kubernetes-native replication service sustains tens of thousands of change events per second while remapping schemas in flight, so upstream schema changes stop breaking downstream consumers.

Infrastructure tooling. Collapsed a 47-step manual runbook into one idempotent command. Automated Snowflake schema provisioning, Glue job scaffolding, Kafka topic creation and IAM role binding. New environments now stand up from a config file.

On timezones

I’m based in South Korea (KST, UTC+9) and I already run engagements for US and European clients, so I’m used to bending my schedule around other people’s business hours. I’ll do EST, PST, CET, GMT, whatever the team actually runs on. This isn’t a “I’ll try my best” thing, it’s just how I’ve worked for the last two years. If your standup is at 9am in New York, I’ll be at it.

Why I’m looking hard right now

I’m finishing up a PhD (flood prediction using ensemble ML and deep learning, which is where the papers come from), and I’m close enough to the end that I’m actively lining up what comes next. For the last couple of years I’ve been splitting my attention between research and contract work. I’m looking to stop splitting it. That means I’m genuinely motivated rather than casually browsing, and it means I’m available now on contract with capacity to go full-time as I wrap up.

The research background isn’t just a line on a CV either. Building ML pipelines on multi-decade climate datasets, reproducing results other people will scrutinise, and writing up limitations honestly turns out to be very good training for data engineering. Both jobs are mostly about not fooling yourself.

What I’m after

Remote. Contract or full-time, both work. Data platform work, pipeline building, or the messy diagnostic stuff nobody else wants to own. I’m happy on greenfield builds and equally happy inheriting something that’s broken and figuring out why.

CV, GitHub and references available on request. Comment or DM and I’ll get back to you quickly.

GitHub: github.com/harksodje

LinkedIn: linkedin.com/in/adisa-akinsoji


r/dataengineeringjobs • • Aug 21 '24

Career How can I find good remote jobs from India

1 Upvotes

I [F29] currently in India as Data Engineer, am seeing a trend remote only (US) I am looking for remote only senior data engineering jobs Be it in Europe, US or anywhere but fully remote. What all portals can I check? Need salary range $70k to $110k.


r/dataengineeringjobs • • Dec 04 '25

Need some PHD Data Engineers

0 Upvotes

Hello everyone so our company is starting a new project. We are trying to fine tune an older version of chat gpt 3.5 into a new and revised model that will be optimized for specific tasks. We will be integrating multiple other models include Llava for image generation, Llama 3 (if they do provide marketing privellages)

Therefore we need a lot of data for this job. We have already started gathering the hardware and pretty much the work is going to be remote. Let me know if you are interested in the job by dropping me a quick DM

It will be an hourly paid job. The pay would be decided according to experience and skill and the work hours would be flexible. The expected pay range will be $10/hr to $30/hr

Drop me a DM to learn more. Thanks!


r/dataengineeringjobs • • Jul 05 '26

Looking for Data association role both remote or on-site, India

Post image
0 Upvotes

After done with my last job i learned new skill and made projects hope this will suits any available job description :)


r/dataengineeringjobs • • Aug 20 '26

Need urgent help !!!!!

0 Upvotes

Hii guys, so I am a recent graduate of the 2026 batch I'm having a data engineering interview for an internship, the problem is I am a beginner extremely beginner in this domain, even currently I am an sde intern but because I find this opportunity really good and I want to get into this one because I want to change my toxic job anyhow and ik I can learn and work, in college I have studied few of things my sql is decent because it comes in my domain but still I need to practice...... I need guidance and genuine help what can I do immediately that can help .......my interview is on Saturday noon 😭😭😭😭


r/dataengineeringjobs • • Jul 02 '25

Looking for a part time DE job

0 Upvotes

Hi all, i am looking for for a part time job in (aws, snowflake, python sql & gen ai) to be able to do asking work my regular job.

Any leads or referral would need helpful


r/dataengineeringjobs • • Oct 20 '25

Heeeyyyyy

0 Upvotes

Check out our ML team TechSydney profile: https://www.techsydney.com.au/u/taher-nematollahi


r/dataengineeringjobs • • May 17 '22

My firm is hiring - Data Engineers and Data Analysts

0 Upvotes

if anyone is interested in taking a look, my firm is hiring: https://www.unifyconsulting.com/

we are hiring in the bay area, seattle, oregon, texas, illinois, utah, dakota's and missouri. if you'd like to connect directly, feel free to DM me or shoot me an email to david-dot-choi AT unifyconsulting-dot-com


r/dataengineeringjobs • • Nov 04 '25

Need referral for Data Engineer in Dublin

0 Upvotes

I have 3 years of good experience as Data Engineer. I’m struggling a lot to find something. Applied for a lot and only got called for 3 interviews. If someone please could help I would appreciate very much. I know the referrals are easier although I don’t have a good network in Dublin


r/dataengineeringjobs • • Mar 10 '25

Data Engineer - Remote Only - 80k-100k

Thumbnail
dataengjobs.com
0 Upvotes

r/dataengineeringjobs • • 21d ago

Data engineering roles requirements?...

0 Upvotes

Data engineering role tech stacks requirement


r/dataengineeringjobs • • 20d ago

Hiring Senior Data Engineer | 10+ years of experience

0 Upvotes

Hi everyone!

My organisation is looking for an experienced Azure Data Engineer (10-12 years of experience) to join our team.

Required technical skills:

- Microsoft Azure

- PySpark

- Azure Data Factory (ADF)

- Apache Airflow

- Azure Databricks

We’re looking for someone with strong hands-on experience in data engineering and building scalable data pipelines using the above technologies.

If you’re interested or know someone who might be a good fit, please feel free to DM me for more details.

Thanks!


r/dataengineeringjobs • • Apr 27 '25

Salary Salary hike suggestion

2 Upvotes

Hi, I am a Data Engineer with 1 year of experience. I have the following skills: AWS, Iceberg, PySpark, Docker, SQL, Python, and Kafka.

Currently, I am working in an MNC (a German company). I joined at a package of 4.5 LPA (3.9 LPA in-hand after deductions like PF, tax, and canteen charges).

In my 1-year journey: I reduced their AWS costs by 70%. I optimized PySpark scripts, resulting in a 30% monthly cost reduction for one project. I completed multiple projects before deadlines without any formal training or KT (Knowledge Transfer) sessions. During the appraisal cycle, my expectation was to match the market valuation for my job role. However, during the discussion, my manager said things like "I know your worth" and "I will take care." But after the appraisal, I saw only a 12% hike in my compensation — it increased to 5 LPA (4.5 LPA in-hand). Could you please tell me: What should be the market valuation for my profile? Is this hike fair or not? What should be the expected compensation for my skills and performance? My personal expectation is around 12–14 LPA. Please guide me on this.


r/dataengineeringjobs • • Aug 23 '26

Career We made a small anthem for data professionals who are learning after work and on weekends

0 Upvotes

Hi everyone,

We wanted to share something a little different today.

We created a short BricksNotes anthem for data professionals who are learning data engineering while balancing work, family, projects, certifications, and career goals.

It is not a technical tutorial.

It is more of a small motivation piece for the people who keep showing up quietly.

After work.
During weekends.
Before interviews.
Before certification exams.
Between responsibilities.

A lot of data engineering learning can feel heavy because there are so many topics:

SQL
PySpark
Databricks
Pipelines
Data modeling
Data quality
Performance tuning
Cloud tools
Now data + AI and agents

The idea behind BricksNotes is simple:

Learn one concept clearly.
Practice it.
Build confidence.
Then move to the next one.

One brick at a time.

Here is the song:

https://youtu.be/fVLYC9EIrFg?si=O9nDv4cUI694DRP3

Would love to hear your thoughts.

Do you think learning platforms should create more motivational content like this, or should they stay focused only on tutorials and technical guides?


r/dataengineeringjobs • • Aug 14 '25

Career Global opportunities

2 Upvotes

I’m based in India and want to work as a remote Data Engineer for companies abroad. What are the typical requirements, skills, or certifications needed, and where should I start looking?


r/dataengineeringjobs • • Jul 08 '25

Data Engineering Freelancer/Consultant

1 Upvotes

Hi all,

I'm a US based data professional who runs a data engineering, data analytics, and Microsoft Azure consulting company.

With a decade of experience we are well suited to solve short term problems and help you achieve your long term goals. We are well versed in best practices and take pride in providing better knowledge transfer than almost anyone else!

We are comfortable working remotely and serve clients across Europe and the US.

If you need a consultant we offer a free initial consultation. Check out our website www.atlonglastanalytics.com for our services and to book a free discovery call with us!

Feel free to direct message me here on Reddit and I'm happy to share my LinkedIn profile with you.


r/dataengineeringjobs • • May 12 '25

Career Are there jobs in the adult entertainment industry in the US? How do you find them? NSFW

1 Upvotes

I’m a senior data engineer with 8 YOE, and over the past 2 years I’ve actually been splitting my time between being a senior data engineer and a level 1 software engineer (same company but they let me join a second team because I was interested). I’ve been interested in the adult entertainment industry ever since I learned about its effect on growth of technology (e.g., VHS v Betamax) and I’m at the point where I want to work in a field I’m interested in and believe in for the rest of my career.

My question is, does anyone know if there are jobs in the USA (ideally west coast), and if so how to find them? The only things I’ve been able to find are Aylo.com (formally Mind Geek), but they appear to only be outside the USA; or NSFWJobs.com, but that site doesn’t feel completely legitimate / maintained.


r/dataengineeringjobs • • Sep 18 '25

Hiring Hiring

0 Upvotes

Hi i am working in a startup and our company has 6 openings mostly data engineer roles . Its completely 9 hr daily office rule and no work from homes . If anyone is interested ping me your resumes will refer you .


r/dataengineeringjobs • • Oct 16 '25

Hiring [HIRING] Data Engineers – Remote (US Only)

0 Upvotes

We’re helping top data engineers land roles at some of the fastest-growing AI startups and tech companies in the US.

Who We’re Looking For:

  • 3+ years of experience as a Data Engineer

  • Strong with Python, SQL, and modern data stacks (Airflow, dbt, Spark, Kafka, etc.)

  • Experience building and maintaining scalable pipelines or data infrastructure

  • Bonus: experience with cloud platforms (AWS, GCP, Azure) and streaming data systems

Why Apply:

  • One profile → multiple interview invites

  • Transparent salaries & equity details

  • Dedicated recruiter support

  • 100% free for engineers

Details:
🌎 Remote (US only), hybrid options in SF or NYC
💰 $150K–$250K+ base + equity for senior roles

👉 Apply here: talent.fonzi.ai

If you’re a data engineer ready for a faster, higher-signal way to find your next role, this is your shortcut to top-tier companies.


r/dataengineeringjobs • • Jun 16 '26

Hiring Data Engineers with AI Coding Agentsexperience - Remote | $80 per hour

Post image
0 Upvotes

Mercor is hiring Data Engineers (Coding Agent Experience) to evaluate how well AI coding agents handle real-world data infrastructure, pipelines, and large-scale data engineering workflows.

Opportunity highlights:

  1. $80 per/hr equivalent

  2. Remote Hourly Contract

  3. $400 per accepted task

  4. Typical tasks take 2-3 hours after ramp-up

What you'll dive into:

  • Use AI coding agents to solve and evaluate complex data engineering tasks

  • Review implementations involving ETL pipelines, data warehouses, analytics platforms, and distributed data systems

  • Identify bugs, scalability bottlenecks, and failure modes • Compare outputs from multiple frontier AI models

Eligibility:

  • 2+ years of professional data engineering experience

  • Hands-on experience building ETL pipelines, data warehouses, or distributed data platforms

  • Regular use of AI coding tools like Cursor, Claude Code, Codex, Windsurf, or Gemini CLI

  • Strong judgment in evaluating data infrastructure and pipeline implementations

Nice to bring: Experience operating production-scale data platforms

Apply now: https://t.mercor.com/KRpTi

Ideal for Data Engineers, Analytics Engineers, and Data Platform Engineers


r/dataengineeringjobs • • Apr 13 '26

After Using Agentic AI IDEs Like Kiro, I Don’t See a Future for Most Knowledge based Jobs

19 Upvotes

Don’t get me wrong—I still think every organization will need engineers to effectively use these tools. But instead of maintaining teams of 20+, you can likely reduce headcount to just 2–3 top performers and still achieve greater output by leveraging tools like Kiro or Claude Code. Ignoring the warnings from Elon Musk and Dario Amodei feels like denial at this point.

Pretty scared at this point to be competing with the top talent for a job. People have no clue whats coming and the agents were able to build out quickly.

Again its not going to replace all, but I agree with an unemployment rate at 20-30 (probs higher) %. Those who say ai slop - you are not prompting it right from my experience