About Me

self_pic

 

 

 

 

 

I am an author, Hadoop enthusiast and a software developer who loves to learn and build new things. I work for a Hadoop company now and am enjoying every bit of it.

I try and blog about almost everything I learn.

Read, Frequently Asked Questions if you have some basic questions related to Hadoop.

46 Comments About Me

  1. Sri

    Hi,

    I am working as Informatica Developer with oracle and teradata right now. I am thinking to learn Hadoop with idea that it would boost up my career line. Can you please suggest me what are the prerequisite skills to learn Hadoop. I have very basic knowledge of Java and not worked on it anytime.
    Please suggest me if Hadoop will suit my career path.
    thanks,
    Shipra

    Reply
    1. Rohit Menon

      Hi Shipra,

      Having an inclination towards understanding how multiple computers work together is enough for you to get into Hadoop. With the basic knowledge of Java is always a plus.
      I am not sure if I could comment on your career path, but the field of Big Data and Data Analytics is coming up in a big way and if you have knowledge of the tools that are used to process large amounts of data, it will greatly benefit you.
      All the best !

      Reply
  2. Rajendra

    Hi
    I am working as a Asp.net developer in local company in pune and my experience is 2 year i want to change to cloud computing so will it be good for me to do the hadoop course .. is there is good career chances for fresher in hadoop ??

    Reply
    1. Rohit Menon

      Hi Rajendra,

      I really can’t comment on your career, but the field of distributed computing is gaining a lot of momentum, so learning Hadoop and applying it in any form (for e.g. open source projects) is going to really help.
      Do let me know if you need any information.

      Reply
    1. Rohit Menon

      Hi Aman,
      I would recommend starting with the Yahoo Developer Network Hadoop Tutorial which is available online and then move onto Hadoop in Action followed by the definitive guide.

      Reply
  3. Rick

    hi Rohit,

    Congrats on clearing CCHD. I was in Java dev for 5.5 yrs and in app support for an oracle suite product for 3 years now. i would like to shift my career into an evolving technologies and chose hadoop(Big data) one of them .

    I’m planning to undergo a training on the same. i have few queries on this filed though , before i make a decision and you being in the field for sometime , hope u can help me with clarifying them.
    1. How is the job market for Big Data analytics field from ur perspective?
    2. What is takes to become a cloudera certified developer? any prior work exp in Hadoop is required?
    3. How is the Banking & Financial sector vieweing big data ? can we anticipate more hadoop jobs from this sector?
    4. Is East coast is better for Big data job search or the silicon valley.?
    5. If i had to do a self study , can i get free version of MapR dist?

    Thanks in advance.

    Regards,
    Rick

    Reply
    1. Rohit Menon

      Hi Rick,

      I shall try my best to answer your queries:

      1. Big Data Analytics is already out there and there are many organizations trying to leverage on their archived data. It is the present and is going to be a bigger future.
      2. No prior work exprience in Hadoop is required.
      3. Any data that sees potential in mining and analyzing their data can be make use of Hadoop or similar systems. Banking and Financial sectors are surely using such systems internally.
      4. I don’t know about the East Coast, but the Silicon Valley is definitely a good place to start looking of jobs in this field.
      5. The Yahoo Developer Network Hadoop Tutorial provides a Linux Image with Hadoop pre-installed. I recommend it. I don’t know if there is any free version of MapR distribution.

      Also, I have just started http://www.hadoopscreencasts.com and you may find it useful. Hope you like it.

      Do let me know if you need any information.

      Reply
      1. Rick

        thanks Rohit & I really appreciate your response. By the way i have chosen a trainer for me and i have a laptop with 32 bit processer and running on Windows Vista OS. Is this config ok for me to start pracrticing hadoop programming ?

        Reply
  4. Lal Prasad R

    Hi Rohit,

    I’m looking for ideas on creating a demo project using apache big data tools (hadoop,hive etc), so that I can understand more on these tools and get some hands on. Any leads on this is appreciable.

    Regards
    Lal

    Reply
    1. Rohit Menon

      Hi Lal,

      Search for the several free data sets available online. Once you have that you could analyze, build recommendation systems, visualize it etc using the various tools available in the Apache Hadoop ecosystem.

      Reply
  5. basha

    Hi Rohit,
    I’m working as a Java developer for the last couple of years. I am learning Hadoop currently. Is also necessary to learn BigData as well? And is this needed for a Java developer like me? Please give me some suggestions on the same. And if possible some related articles as well.

    Reply
  6. Vijay

    hi Rohit,
    I am a c# and sql developer and now I am trying to switch over to Hadoop and bigdata. I was wondering if we need to do some coding in JAVA. I have no idea of java. I mean to ask that in real time should we write the code to read the files etc..need advise on this.

    Reply
      1. Vijay

        Hi Rohit,

        Are these Map reduce programs written in Java.. Can you tell me about the abstractions Pig and Hive..Are these like running through the commands..My concern was regarding the java coding..

        Reply
    1. Vijay

      Hi Sundeep,

      I am not sure if this will help you or not. I got one number from other sources. I guess you can get training class room or online.
      Contact the person on this number for training in Bangalore +91-90 36 298 699.

      Reply
  7. Smita

    Hi Rohit,

    Nice blog and the posts. I am going through all the posts. Nice work!!
    I have a query. Being a 6+ years experienced IT professional, having very little knowledge on Java/Unix, do you think it would be easy to change the career to Analytics field? Mainly Big Data.My area of expertise is Mainframes Technology. . I am in dilemma. I do have strong analytic s , programming and database skills. But unsure how easy it would be for me to learn new things.
    Any thoughts?

    Thanks!!

    Reply
    1. Rohit Menon

      Hi Smita,

      I am glad that you liked the blog. Your skills seem good to enter any stream of analytics. I would recommend going through the technologies that interests you, and see if you connect with it.
      If you do, try doing some sample projects and take it from there.
      Do let me know if you need any information.

      Reply
  8. Phani

    Hi Rohit,

    Could you help me in understanding few things on Hadoop/Bigdata..?

    Firstly i am a 5+ exp Informatica Developer having good knowledge on Oracle DB, SQL & PL/SQL.

    1. What exactly difference b/w Hadoop & Bigdata.. Is it a Technology/Tool/Process..? I am seeing many of them often using Hadoop & Bigdata terms interchangeably.

    2. I don’t know ABCD’s in Java 🙂 Can we manage with out knowing Java if i decided to move on to Hadoop.

    3. I heard few other terms like Hive, Pig, Scoop, casendra etc… what exactly these are..?

    4. What exactly Hadoop eco system mean..?

    5. Finally being from Business Intelligence(BI) domain, to what extent can i connect Hadoop to my current role. or is it a completely new show.?

    Thanks in Advance.

    Thanks
    Phani

    Reply
    1. Rohit Menon

      Hi Phani,

      1. What exactly difference b/w Hadoop & Bigdata.. Is it a Technology/Tool/Process..? I am seeing many of them often using Hadoop & Bigdata terms interchangeably.
      [Rohit] – Hadoop is a framework and BigData is a marketing term coined to emphasize the the importance of the growing data and the opportunities it presents to generate real value.

      2. I don’t know ABCD’s in Java 🙂 Can we manage with out knowing Java if i decided to move on to Hadoop.
      [Rohit] – Yes

      3. I heard few other terms like Hive, Pig, Scoop, casendra etc… what exactly these are..?
      [Rohit] These are components that are written for Apache Hadoop. You can read more about each of these components from their respective project sites.

      4. What exactly Hadoop eco system mean..?
      [Rohit] The Hadoop Ecosystem comprises of the core Apache Hadoop framework along with all the components needed to work with data.

      5. Finally being from Business Intelligence(BI) domain, to what extent can i connect Hadoop to my current role. or is it a completely new show.?
      [Rohit] Bing in BI, you will appreciate the value of data and importance of processing and analysis of data. You sure are a good fit to get your hands on Hadoop.

      Reply
  9. Ankit Misra

    Hi Rohit,

    I have installed hadoop and setup pseudo cluster. But unable to find a way to create a job. so can you please tell me how can i create jobs and which tools are required for the development. I am working on linux.

    Reply
  10. Rahul

    Hi Rohit,
    Awesome blog and fantastic tutorials.
    For hadoop programming perspective kindly suggest a minimum configuration required for a machine to run psuedo distributed mode with ease. I couldn’t find answers for this query on Internet also. Looking forward for your advice.
    Regards,
    Rahul.

    Reply
  11. soma

    hi!

    Very simple and impressive site. I would be going thru the Screencasts … I am interested in distributed DB etc.. Have a java development, leadership and design work experience for 13+years total exp. – but now want to switch back to techno-leadership role with Hadoop – any thoughts ?

    Have some experience on integration work with opensources like jasper/pentaho/kettle etc.. – i like playing around with data. I would appriciate if you can reply.

    Reply
  12. Sanjit

    Hi Rohit
    Great Blog !

    We would like to use realtime 3D and Augmented Reality to visualize Big Data. Can you give me some inputs/pointers/suggestions ? You know anyone else doing this ?

    Thanks !
    Sanjit

    Reply
  13. Abhijit

    Hi Rohit Sir
    I have just started my M.Tech thesis on Big Data Analysis. I have found your blog very useful and also your page http://www.hadoopscreencasts.com/ .
    I am very thankful to you for sharing your knowledge over here 🙂
    I wish I could work with you and learn much from you 🙂

    Reply
  14. Ankit sharma

    Hi Rohit,
    I am currently working in BMC software in India as QA engineer,I would like to switch to hadoop so is it possible for me to switch in hadoop…

    Reply
  15. Ripunjay Godhani

    Hi Rohit,
    I just wanted to thank You and Say . You are really Doing A Good Job and helping people with Big Data Queries and sharing knowledge.
    May God Bless You .
    You are giving back to the society , very nice of you

    Thanks & Regards,
    Ripunjay Godhani

    Reply
  16. Vanjaxi

    Hello,
    I am a Hadoop developer. Thanks for the tutorials you have presented .It has been very helpful to understand the concepts after going through your posts. I hope if you can add more about Spark, Storm in your upcoming tutorials.

    Reply
  17. Parag Pattnaik

    Would like to thank you for such an awesome explanation of Pig basics.

    Really it’s very helpful for beginners.

    Looking forward for basic explanation regarding Avro integration with Pig.

    Reply

Leave a Reply

Your email address will not be published. Required fields are marked *