r/hadoop • u/gheesh • Dec 15 '17
r/hadoop • u/jordimaister • Dec 10 '13
Big Data: Hadoop on a virtual machine, for the poor and lazy
r/hadoop • u/DisregardMyPants • Jun 09 '13
Apparently the NSA Uses Hadoop for their Surveillance-Related MapReduce
r/hadoop • u/rathboma • Sep 07 '16
A Beginner's Guide to Hadoop Storage Formats (or File Formats)
r/hadoop • u/czmx2000 • May 27 '13
Hadoop 2.0: New Big Data Possibilities
r/hadoop • u/rogueleaderr • Oct 03 '12
Quickstart guide to set up a fully distributed Hadoop/HBase cluster in about an hour.
r/hadoop • u/runsleeprepeat • Mar 19 '20
free HDP Users: did you migrate to something else?
Till September 2019, it was possible to get the Hortonworks Data Platform (HDP) binary packages and use them free of charge.
After the merger with Cloudera, you need either a subscription or just get access to the plain source code which you need to fiddle out how to get your local HDP cluster to update.
Who used the Hortonworks Platform or another Hadoop "distribution" without subscription and what are you using in 2020?
r/hadoop • u/anon_indian • Aug 02 '16
Preparing for Hadoop Admin interview. What are the tips you guys can share on the possible interview questions?
Hi, long time lurker here.
I am preparing for hadoop admin interview. I am fairly new to hadoop and would like to know what are the things I need to prepare and look for the interview.
Thank you
r/hadoop • u/hadoopooa • Mar 31 '16
How to get started with hadoop?
I have a new job and they are planning on training me as a hadoop developer.
I have been looking online but there's not much out there to help a complete beginner get started with hadoop!
What is the best way to get started with hadoop?
r/hadoop • u/lefthandben • Feb 01 '16
Q&A with Hadoop co-creator Doug Cutting at the 10-year mark: "I guess I'd call it adolescence."
r/hadoop • u/thetinot • Sep 23 '15
Google introduces managed Spark/Hadoop - per minute billing, insanely fast startup times, interoperability, industry-leading SSD speeds
r/hadoop • u/huitseeker • Oct 11 '14
Spark Breaks Previous Large-Scale Sort Record
r/hadoop • u/nothingtolookat • Nov 19 '13
How To Explain Hadoop To Non-Geeks
r/hadoop • u/skiterr • Apr 15 '13
Hue 2.3, an open source UI for making it easier to use Apache Hadoop
cloudera.github.comr/hadoop • u/Sufficient_Exam_2104 • Nov 22 '20
Any happy users for Hadoop?
I know we are solving bigdata challenges in Hadoop. This is not a new tech anymore. Lots of prod deployments are many apps are currently running on top of it. Now in 2020 i am asking are you happy with your investment?
Is it too difficult to manage? Users are complaining about slow ness? Cluster Management is a challenge? On top of it HDFS/Hive 2.x to 3.x conversion ie CDH cloudera to CDP cloudera is it worth it?
How is ur leadership looking into it? They still believe this is revolutionary or kind of fed up with bigdata hype?
r/hadoop • u/azdatasci • Jun 21 '17
Building a Hadoop and Spark Cluster
I am hoping someone here can point me to a good resource. I have a project this year at work to standup a data science / Hadoop / Spark platform. Out initial focus was going to be leveraging AWS or Azure to do this (EMR or HDInsight). Well, we're getting push-back and the cloud thing doesn't seem to be happening quickly. My contingency plan is to purchase some hardware on our internal cloud infrastructure (these would not be physical, they'd be virtual, but on my own dedicated hosts).
Due to this, my focus has been on the data science, machine learning, scala, python, etc.. Since a cloud solution would have taken care of the actual configuration of the Hadoop / Spark clusters for me, I have not worked on that as much. I have worked in IT for over 15 years and have experience from an system administration and architecture perspective. Setting something up would not be impossible, it's just a reality now.
My question - are there any good solid resources (books from Amazon, documentation, etc.) that I can leverage when planning a cluster out and doing all of the configuration and integration? This is what I am looking at:
~20 node cluster
Both Spark and Hadoop
Management tools like Yarn and Mesos
Other tools that will aid in the use and monitoring of the cluster.
I'd like one good or a few solid resources that will guide my to building, configuring, monitoring and managing this cluster. Also something more recent that covers the new versions and how compatible they are (Hadoop 2.x with Spark 2.x). I have an affinity toward O'Reilly books, but I'm not opposed to other resources.
Any suggestions or recommendations from a systems architecture, admin, etc. roll would be great. Thanks so much!
r/hadoop • u/evidanary • Jul 11 '16
HDFS cheatsheet
Here's my HDFS cheatsheet https://greppage.com/evidanary/10 Another one I use often is Java cheatsheet https://greppage.com/evidanary/16
Is anything important missing?
r/hadoop • u/jkestelyn • Sep 09 '15
Replacing MapReduce with Spark: The Work to be Done
r/hadoop • u/jkestelyn • Oct 15 '14