Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Next revisionBoth sides next revision
doku:bigdata [2021/06/23 09:36] – [Apache Spark on VSC] dieterdoku:bigdata [2022/12/20 09:46] – [MapReduce: Concepts and example] dieter
Line 41: Line 41:
  
 Let us calculate the value of pi by means of the following Python script <html><span style="color:#cc3300;font-size:100%;">&dzigrarr;</span> </html> ''pi.py'' (from the Spark distribution): Let us calculate the value of pi by means of the following Python script <html><span style="color:#cc3300;font-size:100%;">&dzigrarr;</span> </html> ''pi.py'' (from the Spark distribution):
-<code>+<code python>
 from __future__ import print_function from __future__ import print_function
  
Line 76: Line 76:
 In order to submit this python job to the queuing system we use the SLURM script <html><span style="color:#cc3300;font-size:100%;">&dzigrarr;</span> </html> ''pi.slrm'': In order to submit this python job to the queuing system we use the SLURM script <html><span style="color:#cc3300;font-size:100%;">&dzigrarr;</span> </html> ''pi.slrm'':
  
-<code>+<code bash>
 #!/bin/bash #!/bin/bash
 #SBATCH --nodes=1 #SBATCH --nodes=1
Line 122: Line 122:
 An example is  An example is 
  
-<code>+<code bash>
 #!/bin/bash #!/bin/bash
 #SBATCH --job-name=simple_mapreduce #SBATCH --job-name=simple_mapreduce
  • doku/bigdata.txt
  • Last modified: 2023/05/11 08:52
  • by katrin