This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision |
| doku:bigdata [2023/05/11 08:52] – katrin | doku:bigdata [2024/07/05 07:16] (current) – [Apache Spark on VSC] grokyta |
|---|
| ==== Apache Spark on VSC ==== | ==== Apache Spark on VSC ==== |
| |
| There are many frameworks in Data Science that are using <html><span style="color:#cc3300;font-size:100%;">⟿</span> </html> [[https://spark.apache.org|Apache Spark]]<html><sup>TM</sup></html> , for instance, [[https://adam.readthedocs.io|ADAM]] for genomic analysis, [[https://geotrellis.io|GeoTrellis]] for geospatial data analysis, or [[https://koalas.readthedocs.io/en/latest/#|Koalas]] (distributed Pandas). | There are many frameworks in Data Science that are using [[https://spark.apache.org|Apache Spark]]<sup>TM</sup>, for instance, [[https://adam.readthedocs.io|ADAM]] for genomic analysis, [[https://geotrellis.io|GeoTrellis]] for geospatial data analysis, or [[https://koalas.readthedocs.io/en/latest/#|Koalas]] (distributed Pandas). |
| |
| === Example slurm & python scripts === | === Example slurm & python scripts === |