Scribd
Upload
6 views1 page

Optimize MapReduce with Pig Latin

The document discusses Pig, a platform for analyzing large datasets that sits on top of Hadoop. Pig uses a simple scripting language called Pig Latin and can be run via different methods like Grunt, script files, or Ambari.

Uploaded by

Bora Yüret
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as TXT, PDF, TXT or read online on Scribd
6 views1 page

Optimize MapReduce with Pig Latin

The document discusses Pig, a platform for analyzing large datasets that sits on top of Hadoop. Pig uses a simple scripting language called Pig Latin and can be run via different methods like Grunt, script files, or Ambari.

Uploaded by

Bora Yüret
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as TXT, PDF, TXT or read online on Scribd

# Pig sits on top of MapReduce, and uses Pig Latin which looks alot like SQL.

A
very simple way of writing scripts.

# You can set up different relations on your data, so it is a more compact way of
using MapReduce and translate that to MapReduce Tasks

# Pig can let you use your own user-defined functions for running your functions,
with Tez for example.

# Pig running ontop of Tez may run 10x faster then just running it with MapReduce

# Running Pig, 1) you can do it with Grunt (A command line interpreter), 2)


running it with pig script file name, 3) and also running it with Ambari

You might also like