Skip to content

Cluster processing details

Mark Kerzner edited this page Mar 16, 2016 · 3 revisions

The most important, for now, is that you execute this (or similar, with changed parameters) command on the cluster

cd FreeEed; ./run_hadoop_s3.sh 0002.project.s3 /freeeed/output 1

FreeEedUI does it by logging in with SSH and issuing the command. If you want to run it manually on the cluster, it will also work. Just make sure you have added the needed utilities on every one of the cluster servers, just as you would for running FreeEed locally.

Clone this wiki locally