Actualizar 'pruebas_spark.md'

README.md

@@ -2,27 +2,39 @@
 
 Pruebas de  creación de un grupo de clusters con raspberry pi y orange pi
 
+![Foto 1](fotos/foto_1.jpg)
+![Foto 2](fotos/foto_2.jpg)
+
+
 ## ToDo
 
 - [x]  Diseño Soporte.
 - [ ]  Instalación Hardware y cableado
-- [ ]  Instalación Sistema operativo
+- [x]  Instalación Sistema operativo
-- [ ]  Configuración de red
+- [x]  Configuración de red
-- [ ]  Pruebas de red
+- [x]  Pruebas de red
 - [ ]  Backup de sistema operativo con dd
 - [ ]  Instalacion Hadoop
 - [ ]  Pruebas Hadoop
-- [ ]  Instalacion Spark
+- [x]  Instalacion Spark
-- [ ]  Pruebas de Spark
+- [x]  Pruebas de Spark
 
 ## Maquinas
 
 Maquina | Descripcion | usuario |  ip | host |
 :------------ | :-------------|  :------------- | :-------------| :-------------
-mdc_mq1 | RaspberryPi 3| pi | 192.168.1.105 | mdc_mq1
+mdc_mq1 | RaspberryPi 3| mdchaparror | 192.168.1.105 | mdc_mq1
-mdc_mq2 | RaspberryPi 2| pi | 192.168.1.171 | mdcmq2
+mdc_mq2 | RaspberryPi 2| mdchaparror | 192.168.1.171 | cluster_slave2
-mdc_mq3 | OrangePi PC| mdcmq3 | 192.168.1.172 | mdcmq3
+mdc_mq3 | OrangePi PC| mdchaparror | 192.168.1.172 | cluster_master
-mdc_mq4 | OrangePi PC| mdcmq4 | 192.168.1.173 | mdcmq4
+mdc_mq4 | OrangePi PC| mdchaparror | 192.168.1.173 | cluster_slave1
+
+    sudo nano /etc/hosts
+
+```
+192.168.1.172 clustermaster
+192.168.1.173 cluster_slave1
+192.168.1.171 cluster_slave2
+```
 
 ### Especificación OrangePi PC
 
@@ -97,4 +109,9 @@ Weight | 38g
 
 ## Referencias
 [http://www.orangepi.org/orangepipc/](http://www.orangepi.org/orangepipc/)
+
 [https://www.armbian.com/orange-pi-pc/](https://www.armbian.com/orange-pi-pc/)
+
+[http://bailiwick.io/2015/07/07/create-your-own-apache-spark-cluster-using-raspberry-pi-2/](http://bailiwick.io/2015/07/07/create-your-own-apache-spark-cluster-using-raspberry-pi-2/)
+
+[https://www.dinofizzotti.com/blog/2020-04-10-raspberry-pi-cluster-part-1-provisioning-with-ansible-and-temperature-monitoring-using-prometheus-and-grafana/](https://www.dinofizzotti.com/blog/2020-04-10-raspberry-pi-cluster-part-1-provisioning-with-ansible-and-temperature-monitoring-using-prometheus-and-grafana/)

pruebas_spark.md

@@ -0,0 +1,57 @@
+# Pruebas Cluster spark
+
+## Comandos:
+
+### Instalar Java
+
+``` 
+sudo apt install -y openjdk-8-jdk
+
+``` 
+
+### Iniciar master
+
+``` 
+ssh cluster_master ~/Documentos/spark/sbin/start-master.sh
+```
+### Detener master
+
+``` 
+ssh cluster_master ~/Documentos/spark/sbin/stop-master.sh
+
+```
+![master](fotos/spark/master_spark.png)
+
+### Iniciar Workers
+
+``` 
+ssh cluster_master ~/Documentos/spark/sbin/start-workers.sh
+```
+### Detener Workers
+
+``` 
+ssh cluster_master ~/Documentos/spark/sbin/stop-workers.sh
+
+```
+![master](fotos/spark/workers_spark.png)
+
+## Carga de archivos
+
+Para cargar datos es necesario enviarlos a todos los nodos , se podria enviar a cada nodo con **scp** o crear un archivo con el nombre del host de cada nodo.
+
+```bash
+for i in `cat slaves`; do
+scp data.csv $i:~/dataSpark/
+done
+```
+
+### Crear carpeta de datos
+Todo:
+
+- [ ] montar carpeta compartida Samba
+
+```bash 
+for i in `cat slaves`; do
+ssh $i mkdir ~/dataSpark
+done
+```