Skip to content

0xdata Machine Info

knormoyle edited this page Mar 12, 2013 · 3 revisions

External ip addresses: DemoURL 50.0.250.3

Snowball is the Windows Server which is being used as DHCP and DNS box.

192.168.1.200

Wireless Access Points

192.168.1.99 is the new "Black Knight" 2.5G and 5G access point (admin/admin) HEXADATA_2G and HEXDATA_5G SSIDs.

cdh4 cluster

hdfs/mapreduce CDH4 cluster exists here.

h2o "hdfs_version='cdh4"
h2o "-hdfs=hdfs://192.168.1.151"

default hdfs ports for namenode.

cloudera manager: point browser to http://192.168.1.151:7180 (admin/admin)

hdfs dirs are in /home/data/5 and /home/data/mapred.

cdh3u5 cluster

hdfs/mapreduce CDH4 cluster exists here.

h2o "hdfs_version='cdh3u5"
h2o "-hdfs=hdfs://192.168.1.176"

default hdfs ports for namenode.

cloudera manager: point browser to http://192.168.1.176:7180 (admin/admin)

hdfs dirs are in /home/cdh3/dfs and /home/cdh3/mapred

i5 cluster

All have 32GB dram 3+ghz i5. 4 cores/4 threads. /home disk (RE4) is identical to the i7 machines. 250GB RE3 /home/0xdiag/datasets should be used for datasets. 192.168.1.171 only has one 1TB disk, slightly slower.

192.168.1.171
192.168.1.172
192.168.1.173
192.168.1.174
192.168.1.175

i7 cluster

All have 32GB dram. 3+ghz i7. 4 cores/ 8 threads. 250GB (RE4) system disk. 1TB disk (RE4 for /home and /home2) hdfs dirs are in /home/cdh3

192.168.1.176
192.168.1.177
192.168.1.178
192.168.1.179
192.168.1.180

HP DL380 G4 (Centos) Cluster

Two cpus per server, 1 core per cpu. 2 threads per cpu. 90nm?

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 15
model	: 4
model name	: Intel(R) Xeon(TM) CPU 3.20GHz
stepping	: 3
cpu MHz	: 3200.000
cache size	: 2048 KB (shared L2? no L3?)



192.168.1.150
192.168.1.151
192.168.1.152
192.168.1.153
192.168.1.154
192.168.1.155

Each have 12GB dram.

jenkins

There is a jenkins installed at http://192.168.1.150:8080 There is a jenkins installed at http://192.168.1.171:8080

Ubuntu 12.04 LTS boxes

192.168.1.171-175: Intel(R) Core(TM) i5-3550 CPU @ 3.30GHz

192.168.1.176-180: Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz

oracle 1.7 java is installed via ppa in the repo following http://www.webupd8.org/2012/01/install-oracle-java-jdk-7-in-ubuntu-via.html

# java -version
java version "1.7.0_17"
Java(TM) SE Runtime Environment (build 1.7.0_17-b02)
Java HotSpot(TM) 64-Bit Server VM (build 23.7-b01, mixed mode)
# javac -version
javac 1.7.0_17

It's possible to go backwards or forwards with these installers and apt-get install.

# apt-cache search oracle
oracle-java7-installer - Oracle Java(TM) Development Kit (JDK) 7
oracle-java6-installer - Oracle Java(TM) Development Kit (JDK) 6
oracle-java8-installer - Oracle Java(TM) Development Kit (JDK) 8
oracle-java7-set-default - Set Oracle JDK 7 as default Java
oracle-java6-set-default - Set Oracle JDK 6 as default Java
oracle-java8-set-default - Set Oracle JDK 8 as default Java

HP DL380 G4 Centos 6.4 boxes

linux kernel 2.6.32-358.0.1.el6.x86_64

The openjdk 1.6 is cleanly installed with yum both java and javac

$ alternatives --config java

There are 3 programs which provide 'java'.

   Selection    Command
   -----------------------------------------------
   *+ 1           /usr/lib/jvm/jre-1.6.0-openjdk.x86_64/bin/java
      2           /usr/lib/jvm/jre-1.5.0-gcj/bin/java
      3           /usr/java/latest/bin/java


$ cd /usr/java
$ ls -ltr
drwxr-xr-x 7 root root 4096 Mar 11 11:27 jdk1.6.0_43
lrwxrwxrwx 1 root root   21 Mar 11 11:27 latest -> /usr/java/jdk1.6.0_43
lrwxrwxrwx 1 root root   16 Mar 11 11:27 default -> /usr/java/latest

$ rpm -qa | grep jdk
java-1.6.0-openjdk-devel-1.6.0.0-1.57.1.11.9.el6_4.x86_64
java-1.6.0-openjdk-1.6.0.0-1.57.1.11.9.el6_4.x86_64
jdk-1.6.0_43-fcs.x86_64


$ java -version
java version "1.6.0_24"
OpenJDK Runtime Environment (IcedTea6 1.11.9) (rhel-1.57.1.11.9.el6_4-x86_64)
OpenJDK 64-Bit Server VM (build 20.0-b12, mixed mode)
[kevin@192.168.1.151 ~]$ javac -version
javac 1.6.0_24

Sun Oracle java 1.6 is installed/available, but not used as default. Can be selected. Visible with

rpm -qa  | grep jdk

alternatives --config java
alternatives --config javac
Clone this wiki locally